A Primer on Data Logging to Support Extraction of Meaningful Information from Educational Games

A Primer on Data Logging to Support Extraction of Meaningful Information from Educational Games PDF Author: Gregory K. W. K. Chung
Publisher:
ISBN:
Category :
Languages : en
Pages : 27

Book Description
In this primer we briefly describe our perspective and experience in using data logging to support measurement of student learning in a game testbed ("Save Patch") we developed for research purposes. The goal of data logging is to support the derivation of cognitively meaningful measures and affectively meaningful measures from a combination of player behaviors, game events, and game states. Key best practices we have developed are to record data that reflects behavior rather than inferences about the behavior, specify the behavior to log ahead of time, log in-game behaviors that map directly to targeted knowledge, skills, and attitudes, encode sufficient information so that the data elements are unambiguous at the desired grain size, capture context to allowing linking of the data element to an individual's specific game experience (e.g., school, teacher, period, stage, level, game event, game state), and use a structured and delimited record format. The capturing of behavioral events that presumably is a manifestation of cognitive and affective processes allows for the investigation of numerous research questions that connect game play to students' background, strategy use, knowledge, and cognitive processes. Appended are: (1) Brief Summary of Save Patch; and (2) Data Code Definition for Save Patch. (Contains 5 tables and 3 footnotes.) [This paper was supported under the Educational Research and Development Centers Program.].

Educational Measurement

Educational Measurement PDF Author: Craig S. Wells
Publisher: Guilford Publications
ISBN: 1462525636
Category : Social Science
Languages : en
Pages : 514

Book Description
This book introduces and explores major topics in contemporary educational measurement: criterion-referenced testing, item response theory (IRT), computer-based testing, cross-lingual and cross-cultural assessment, and accountability testing. Psychometric experts describe forward-looking measurement practices and provide a contextualized understanding of how and why they were developed, how they can be used, and where they may go in the future. In addition to presenting key concepts and formulas, the volume covers established and emerging applications and discusses recurrent challenges that require additional research. A helpful glossary of abbreviations is included. The book is grounded in the work of Ronald K. Hambleton.

Using Cognitive and Affective Metrics in Educational Simulations and Games

Using Cognitive and Affective Metrics in Educational Simulations and Games PDF Author: Harold F. O'Neil
Publisher: Routledge
ISBN: 1000390098
Category : Education
Languages : en
Pages : 268

Book Description
Presenting original studies and rich conceptual analyses, this volume explores how cognitive and affective metrics can be used to effectively assess, modify, and enhance learning and assessment outcomes of simulations and games used in education and training. The volume responds to the increasing use of computer-based simulations and games across academic and professional sectors by bringing together contributions from different research communities, including K-12 and postsecondary education, medical, and military contexts. Drawing on empirical results, the chapter authors focus on the design and assessment of educational simulations and games. They describe how quantitative and qualitative metrics can be used effectively to evaluate and tailor instructional resources to the cognitive and affective needs of the individual learner. In doing so, the volume enhances understanding of how games and simulations can intersect with the science of learning to improve educational outcomes. Given its rigorous and multidisciplinary approach, this book will prove an indispensable resource for researchers and scholars in the fields of educational assessment and evaluation, educational technology, military psychology, and educational psychology.

Using Games and Simulations for Teaching and Assessment

Using Games and Simulations for Teaching and Assessment PDF Author: Harold F. O'Neil
Publisher: Routledge
ISBN: 1317814665
Category : Computers
Languages : en
Pages : 357

Book Description
Using Games and Simulations for Teaching and Assessment: Key Issues comprises a multidisciplinary investigation into the issues that arise when using games and simulations for educational purposes. Using both theoretical and empirical analyses, this collection examines cognitive, motivational, and psychometric issues with a focus on STEM content. Unlike other research-based volumes that focus solely on game design or the theoretical basis behind gaming, this book unites previously disparate communities of researchers—from civilian to military contexts as well as multiple disciplines—to critically explore current problems and illustrate how instructionally effective games and simulations should be planned and evaluated. While computer-based simulations and games have the potential to improve the quality of education and training, Using Games and Simulations for Teaching and Assessment: Key Issues shows how the science of learning should underlie the use of such technologies. Through a wide-ranging yet detailed examination, chapter authors provide suggestions for designing and developing games, simulations, and intelligent tutoring systems that are scientifically-based, outcomes-driven, and cost-conscious.

The Wiley Handbook of Cognition and Assessment

The Wiley Handbook of Cognition and Assessment PDF Author: Andre A. Rupp
Publisher: John Wiley & Sons
ISBN: 1118956613
Category : Education
Languages : en
Pages : 792

Book Description
This state-of-the-art resource brings together the most innovative scholars and thinkers in the field of testing to capture the changing conceptual, methodological, and applied landscape of cognitively-grounded educational assessments. Offers a methodologically-rigorous review of cognitive and learning sciences models for testing purposes, as well as the latest statistical and technological know-how for designing, scoring, and interpreting results Written by an international team of contributors at the cutting-edge of cognitive psychology and educational measurement under the editorship of a research director at the Educational Testing Service and an esteemed professor of educational psychology at the University of Alberta as well as supported by an expert advisory board Covers conceptual frameworks, modern methodologies, and applied topics, in a style and at a level of technical detail that will appeal to a wide range of readers from both applied and scientific backgrounds Considers emerging topics in cognitively-grounded assessment, including applications of emerging socio-cognitive models, cognitive models for human and automated scoring, and various innovative virtual performance assessments

Validation of Score Meaning for the Next Generation of Assessments

Validation of Score Meaning for the Next Generation of Assessments PDF Author: Kadriye Ercikan
Publisher: Routledge
ISBN: 1317483332
Category : Education
Languages : en
Pages : 218

Book Description
Despite developments in research and practice on using examinee response process data in assessment design, the use of such data in test validation is rare. Validation of Score Meaning in the Next Generation of Assessments Using Response Processes highlights the importance of validity evidence based on response processes and provides guidance to measurement researchers and practitioners in creating and using such evidence as a regular part of the assessment validation process. Response processes refer to approaches and behaviors of examinees when they interpret assessment situations and formulate and generate solutions as revealed through verbalizations, eye movements, response times, or computer clicks. Such response process data can provide information about the extent to which items and tasks engage examinees in the intended ways. With contributions from the top researchers in the field of assessment, this volume includes chapters that focus on methodological issues and on applications across multiple contexts of assessment interpretation and use. In Part I of this book, contributors discuss the framing of validity as an evidence-based argument for the interpretation of the meaning of test scores, the specifics of different methods of response process data collection and analysis, and the use of response process data relative to issues of validation as highlighted in the joint standards on testing. In Part II, chapter authors offer examples that illustrate the use of response process data in assessment validation. These cases are provided specifically to address issues related to the analysis and interpretation of performance on assessments of complex cognition, assessments designed to inform classroom learning and instruction, and assessments intended for students with varying cultural and linguistic backgrounds. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.

The Testing and Learning Revolution

The Testing and Learning Revolution PDF Author: Kavitha Rajagopalan
Publisher: Springer
ISBN: 1137519967
Category : Education
Languages : en
Pages : 193

Book Description
Gordon shows how we can use assessment to support teaching and develop students' competencies. Between 2011 and 2013, Gordon chaired an interdisciplinary commission of scholars and thinkers, who connected transformative research and ideas on learning, teaching, measurement, the nature of tests, intelligence, capability, technology, and policy.

Serious Games Analytics

Serious Games Analytics PDF Author: Christian Sebastian Loh
Publisher: Springer
ISBN: 3319058347
Category : Education
Languages : en
Pages : 497

Book Description
This volume brings together research on how gameplay data in serious games may be turned into valuable analytics or actionable intelligence for performance measurement, assessment, and improvement. Chapter authors use empirical research methodologies, including existing, experimental, and emerging conceptual frameworks, from various fields, such as: computer science software engineering educational data mining statistics information visualization. Serious games is an emerging field where the games are created using sound learning theories and instructional design principles to maximize learning and training success. But how would stakeholders know what play-learners have done in the game environment, and if the actions performance brings about learning? Could they be playing the game for fun, really learning with evidence of performance improvement, or simply gaming the system, i.e., finding loopholes to fake that they are making progress? This volume endeavors to answer these questions.

The Coding Manual for Qualitative Researchers

The Coding Manual for Qualitative Researchers PDF Author: Johnny Saldana
Publisher: SAGE
ISBN: 1446200124
Category : Reference
Languages : en
Pages : 282

Book Description
The Coding Manual for Qualitative Researchers is unique in providing, in one volume, an in-depth guide to each of the multiple approaches available for coding qualitative data. In total, 29 different approaches to coding are covered, ranging in complexity from beginner to advanced level and covering the full range of types of qualitative data from interview transcripts to field notes. For each approach profiled, Johnny Saldaña discusses the method’s origins in the professional literature, a description of the method, recommendations for practical applications, and a clearly illustrated example.

Learning, Creating, and Using Knowledge

Learning, Creating, and Using Knowledge PDF Author: Joseph D. Novak
Publisher: Routledge
ISBN: 1135184461
Category : Education
Languages : en
Pages : 334

Book Description
This fully revised and updated edition of Learning, Creating, and Using Knowledge recognizes that the future of economic well being in today's knowledge and information society rests upon the effectiveness of schools and corporations to empower their people to be more effective learners and knowledge creators. Novak’s pioneering theory of education presented in the first edition remains viable and useful. This new edition updates his theory for meaningful learning and autonomous knowledge building along with tools to make it operational ─ that is, concept maps, created with the use of CMapTools and the V diagram. The theory is easy to put into practice, since it includes resources to facilitate the process, especially concept maps, now optimised by CMapTools software. CMapTools software is highly intuitive and easy to use. People who have until now been reluctant to use the new technologies in their professional lives are will find this book particularly helpful. Learning, Creating, and Using Knowledge is essential reading for educators at all levels and corporate managers who seek to enhance worker productivity.