Automated Scoring of Complex Tasks in Computer-based Testing PDF Download

Author: David M. Williamson
Publisher: Psychology Press
ISBN: 0805846344
Category : Education
Languages : en
Pages : 437

View

Book Description
This is the first volume to provide the latest methods and examples of "best practices" in the design, implementation, and evaluation of automated scoring for complex assessments. The contributing authors, all noted leaders in the field, introduce each m

Author: Patrick Griffin
Publisher: Springer Science & Business Media
ISBN: 9400723245
Category : Education
Languages : en
Pages : 359

View

Book Description
Rapid—and seemingly accelerating—changes in the economies of developed nations are having a proportional effect on the skill sets required of workers in many new jobs. Work environments are often technology-heavy, while problems are frequently ill-defined and tackled by multidisciplinary teams. This book contains insights based on research conducted as part of a major international project supported by Cisco, Intel and Microsoft. It faces these new working environments head-on, delineating new ways of thinking about ‘21st-century’ skills and including operational definitions of those skills. The authors focus too on fresh approaches to educational assessment, and present methodological and technological solutions to the barriers that hinder ICT-based assessments of these skills, whether in large-scale surveys or classrooms. Equally committed to defining its terms and providing practical solutions, and including international perspectives and comparative evaluations of assessment methodology and policy, this volume tackles an issue at the top of most educationalists’ agendas.

Author: Victoria Yaneva
Publisher: Taylor & Francis
ISBN: 1000904199
Category : Education
Languages : en
Pages : 339

View

Book Description
Advancing Natural Language Processing in Educational Assessment examines the use of natural language technology in educational testing, measurement, and assessment. Recent developments in natural language processing (NLP) have enabled large-scale educational applications, though scholars and professionals may lack a shared understanding of the strengths and limitations of NLP in assessment as well as the challenges that testing organizations face in implementation. This first-of-its-kind book provides evidence-based practices for the use of NLP-based approaches to automated text and speech scoring, language proficiency assessment, technology-assisted item generation, gamification, learner feedback, and beyond. Spanning historical context, validity and fairness issues, emerging technologies, and implications for feedback and personalization, these chapters represent the most robust treatment yet about NLP for education measurement researchers, psychometricians, testing professionals, and policymakers. The Open Access version of this book, available at www.taylorfrancis.com, has been made available under a Creative Commons Attribution-NonCommercial-No Derivatives 4.0 license.

Author: Michael Fetzer
Publisher: Springer Science & Business Media
ISBN: 146147681X
Category : Psychology
Languages : en
Pages : 281

View

Book Description
​This book provides a comprehensive and state-of-the-art overview of simulation development, technologies, and implementation, including real-world examples and results followed by a preview of what’s on the horizon that will further revolutionize the industry. More than a handful of books have been written on the use of simulations for training purposes, but this book focuses solely on simulations in employee selection contexts (e.g., hiring, promotion), making it a truly unique and valuable resource for both practitioners and academics. The science and practice of employee selection has advanced at a steady pace over the past two or three decades. However, recent advancements in both technology and assessment methods have been the catalyst for an evolutionary leap in the use of simulations in this area.

Author: Craig N. Mills
Publisher: Routledge
ISBN: 1135651655
Category : Education
Languages : en
Pages : 339

View

Book Description
Although computer-based tests (CBT) have been administered for many years, improvements in the speed and power of computers coupled with reductions in their cost have made large-scale computer delivery of tests increasingly feasible. CBT is now a common form of test delivery for licensure, certification, and admissions tests. Many large-scale, high-stakes testing programs have introduced CBT either as an option or as the sole means of test delivery. Although this movement to CBT has, to a great extent, been successful, it has not been without problems. Advances in psychometrics are required to ensure that those who rely on test results can have at least the same confidence in CBTs as they have in traditional forms of assessment. This volume stems from an ETS-sponsored colloquium in which more than 200 measurement professionals from eight countries and 29 states convened to assess the current and future status of CBT. The formal agenda for the colloquium was divided into three major segments: Test Models, Test Administration, and Test Analysis and Scoring. Each segment consisted of several presentations followed by comments from noted psychometricians and a break-out session in which presenters and discussants identified important issues and established priorities for a CBT research agenda. This volume contains the papers presented at the colloquium, the discussant remarks based on those papers, and the research agenda that was generated from the break-out sessions. Computer-Based Testing: Building the Foundation for Future Assessments is must reading for professionals, scholars, and advanced students working in the testing field, as well as people in the information technology field who have an interest in testing.

Author: Fritz Drasgow
Publisher: Routledge
ISBN: 1317975898
Category : Education
Languages : en
Pages : 376

View

Book Description
From early answer sheets filled in with number 2 pencils, to tests administered by mainframe computers, to assessments wholly constructed by computers, it is clear that technology is changing the field of educational and psychological measurement. The numerous and rapid advances have immediate impact on test creators, assessment professionals, and those who implement and analyze assessments. This comprehensive new volume brings together leading experts on the issues posed by technological applications in testing, with chapters on game-based assessment, testing with simulations, video assessment, computerized test development, large-scale test delivery, model choice, validity, and error issues. Including an overview of existing literature and ground-breaking research, each chapter considers the technological, practical, and ethical considerations of this rapidly-changing area. Ideal for researchers and professionals in testing and assessment, Technology and Testing provides a critical and in-depth look at one of the most pressing topics in educational testing today. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.

Author: Hong Jiao
Publisher: IAP
ISBN: 1681239310
Category : Education
Languages : en
Pages : 310

View

Book Description
Assessment innovation tied to technology is greatly needed in a wide variety of assessment applications. This book adopts an interdisciplinary perspective to learn from advances in developing technology enhanced innovative assessments from multiple fields. The book chapters address the development of virtual assessments including game?based assessment, simulation?based assessment, and narrative based assessment as well as how simulation and game based assessments serve both formative and summative purposes. Further, chapters address the critical challenge of integrating assessment directly into the learning process so that teacher effectiveness and student learning can be enhanced. Two chapters specifically address the psychometric challenges related to innovative items. One chapter talks about evaluating the psychometric properties of innovative items while the other chapter presents a new psychometric model for calibrating innovative items embedded in multiple contexts. In addition, validity issues are addressed related to technology enhanced innovative assessment. It is hoped that the book provides readers with rich and useful information about the development of several types of virtual assessments from multiple perspectives. The authors include experts from industry where innovative items have been used for many years and experts from research institutes and universities who have done pioneering work related to developing innovative items with formative applications to facilitate learning. In addition, expert advice has been provided on validating such work.

Author: Suzanne Lane
Publisher: Routledge
ISBN: 1136242562
Category : Education
Languages : en
Pages : 1025

View

Book Description
The second edition of the Handbook of Test Development provides graduate students and professionals with an up-to-date, research-oriented guide to the latest developments in the field. Including thirty-two chapters by well-known scholars and practitioners, it is divided into five sections, covering the foundations of test development, content definition, item development, test design and form assembly, and the processes of test administration, documentation, and evaluation. Keenly aware of developments in the field since the publication of the first edition, including changes in technology, the evolution of psychometric theory, and the increased demands for effective tests via educational policy, the editors of this edition include new chapters on assessing noncognitive skills, measuring growth and learning progressions, automated item generation and test assembly, and computerized scoring of constructed responses. The volume also includes expanded coverage of performance testing, validity, fairness, and numerous other topics. Edited by Suzanne Lane, Mark R. Raymond, and Thomas M. Haladyna, The Handbook of Test Development, 2nd edition, is based on the revised Standards for Educational and Psychological Testing, and is appropriate for graduate courses and seminars that deal with test development and usage, professional testing services and credentialing agencies, state and local boards of education, and academic libraries serving these groups.

Author: Linda Darling-Hammond
Publisher: John Wiley & Sons
ISBN: 1118889290
Category : Education
Languages : en
Pages : 464

View

Book Description
Performance assessment is a hot topic in school systems, and educators continue to analyze its costs, benefits, and feasibility as a replacement for high-stakes testing. Until now, researchers and policymakers have had to dig to find out what we know and what we still have to learn about performance assessment. Beyond the Bubble Test: How Performance Assessments Support 21st Century Learning synthesizes the latest findings in the field, and not a moment too soon. Statistics indicate that the United States is in danger of falling behind if it fails to adapt to our changing world. The memory and recall strategies of traditional testing are no longer adequate to equip our students with the skills they need to excel in the global economy. Instead teachers need to engage students in deeper learning, assessing their ability to use higher-order skills. Skills like synthesizing information, understanding evidence, and critical problem-solving are not achieved when we teach to multiple-choice exams. Examples in Beyond the Bubble Test paint a useful picture of how schools can begin to supplement traditional tests with something that works better. This book provides new perspectives on current performance assessment research, plus an incisive look at what’s possible at the local and state levels. Linda Darling-Hammond, with a team of leading scholars, bring together lessons learned, new directions, and solid recommendations into a single, readily accessible compendium. Beyond the Bubble Test situates the current debate on performance assessment within the context of testing in the United States. This comprehensive resource also looks beyond our U.S. borders to Singapore, Hong Kong, and other places whose reform-mindedness can serve as an example to us.

Author: Robert W. Lissitz
Publisher: IAP
ISBN: 1617357278
Category : Education
Languages : en
Pages : 325

View

Book Description
The Race To The Top program strongly advocates the use of computer technology in assessments. It dramatically promotes computer-based testing, linear or adaptive, in K-12 state assessment programs. Moreover, assessment requirements driven by this federal initiative exponentially increase the complexity in assessment design and test development. This book provides readers with a review of the history and basics of computer-based tests. It also offers a macro perspective for designing such assessment systems in the K-12 setting as well as a micro perspective on new challenges such as innovative items, scoring of such items, cognitive diagnosis, and vertical scaling for growth modeling and value added approaches to assessment. The editors’ goal is to provide readers with necessary information to create a smarter computer-based testing system by following the advice and experience of experts from education as well as other industries. This book is based on a conference (http://marces.org/workshop.htm) held by the Maryland Assessment Research Center for Education Success. It presents multiple perspectives including test vendors and state departments of education, in designing and implementing a computer-based test in the K-12 setting. The design and implementation of such a system requires deliberate planning and thorough considerations. The advice and experiences presented in this book serve as a guide to practitioners and as a good source of information for quality control. The technical issues discussed in this book are relatively new and unique to K-12 large-scale computer-based testing programs, especially due to the recent federal policy. Several chapters provide possible solutions to psychometricians dealing with the technical challenges related to innovative items, cognitive diagnosis, and growth modeling in computer-based linear or adaptive tests in the K-12 setting.