Assessing Measurement Invariance Using Factor Analysis and Item Response Theory PDF Download

Author: Kimberly C. Blackwell
Publisher:
ISBN:
Category : Factor analysis
Languages : en
Pages : 242

View

Book Description

Author: Craig S. Wells
Publisher: Cambridge University Press
ISBN: 1108485227
Category : Education
Languages : en
Pages : 417

View

Book Description
This user-friendly guide illustrates how to assess measurement invariance using computer programs, statistical methods, and real data.

Author: Steven P. Reise
Publisher: Routledge
ISBN: 131756569X
Category : Psychology
Languages : en
Pages : 710

View

Book Description
Item response theory (IRT) has moved beyond the confines of educational measurement into assessment domains such as personality, psychopathology, and patient-reported outcomes. Classic and emerging IRT methods and applications that are revolutionizing psychological measurement, particularly for health assessments used to demonstrate treatment effectiveness, are reviewed in this new volume. World renowned contributors present the latest research and methodologies about these models along with their applications and related challenges. Examples using real data, some from NIH-PROMIS, show how to apply these models in actual research situations. Chapters review fundamental issues of IRT, modern estimation methods, testing assumptions, evaluating fit, item banking, scoring in multidimensional models, and advanced IRT methods. New multidimensional models are provided along with suggestions for deciding among the family of IRT models available. Each chapter provides an introduction, describes state-of-the art research methods, demonstrates an application, and provides a summary. The book addresses the most critical IRT conceptual and statistical issues confronting researchers and advanced students in psychology, education, and medicine today. Although the chapters highlight health outcomes data the issues addressed are relevant to any content domain. The book addresses: IRT models applied to non-educational data especially patient reported outcomes Differences between cognitive and non-cognitive constructs and the challenges these bring to modeling. The application of multidimensional IRT models designed to capture typical performance data. Cutting-edge methods for deriving a single latent dimension from multidimensional data A new model designed for the measurement of constructs that are defined on one end of a continuum such as substance abuse Scoring individuals under different multidimensional IRT models and item banking for patient-reported health outcomes How to evaluate measurement invariance, diagnose problems with response categories, and assess growth and change. Part 1 reviews fundamental topics such as assumption testing, parameter estimation, and the assessment of model and person fit. New, emerging, and classic IRT models including modeling multidimensional data and the use of new IRT models in typical performance measurement contexts are examined in Part 2. Part 3 reviews the major applications of IRT models such as scoring, item banking for patient-reported health outcomes, evaluating measurement invariance, linking scales to a common metric, and measuring growth and change. The book concludes with a look at future IRT applications in health outcomes measurement. The book summarizes the latest advances and critiques foundational topics such a multidimensionality, assessment of fit, handling non-normality, as well as applied topics such as differential item functioning and multidimensional linking. Intended for researchers, advanced students, and practitioners in psychology, education, and medicine interested in applying IRT methods, this book also serves as a text in advanced graduate courses on IRT or measurement. Familiarity with factor analysis, latent variables, IRT, and basic measurement theory is assumed.

Author: Rens Van De Schoot
Publisher: Frontiers Media SA
ISBN: 288919650X
Category : Psychology
Languages : en
Pages : 219

View

Book Description
Multi-item surveys are frequently used to study scores on latent factors, like human values, attitudes and behavior. Such studies often include a comparison, between specific groups of individuals, either at one or multiple points in time. If such latent factor means are to be meaningfully compared, the measurement structures including the latent factor and their survey items should be stable across groups and/or over time, that is ‘invariant’. Recent developments in statistics have provided new analytical tools for assessing measurement invariance (MI). The aim of this special issue is to provide a forum for a discussion of MI, covering some crucial ‘themes’: (1) ways to assess and deal with measurement non-invariance; (2) Bayesian and IRT methods employing the concept of approximate measurement invariance; and (3) new or adjusted approaches for testing MI to fit increasingly complex statistical models and specific characteristics of survey data. The special issue started with a kick-off meeting where all potential contributors shared ideas on potential papers. This expert workshop was organized at Utrecht University in The Netherlands and was funded by the Netherlands Organization for Scientific Research (NWO-VENI-451-11-008). After the kick-off meeting the authors submitted their papers, all of which were reviewed by experts in the field. The papers in the eBook are listed in alphabetical order, but in the editorial the papers are introduced thematically. Although it is impossible to cover all areas of relevant research in the field of MI, papers in this eBook provide insight on important aspects of measurement invariance. We hope that the discussions included in this special issue will stimulate further research on MI and facilitate further discussions to support the understanding of the role of MI in multi-item surveys.

Author: Roger E. Millsap
Publisher: Routledge
ISBN: 1136761128
Category : Psychology
Languages : en
Pages : 359

View

Book Description
This book reviews the statistical procedures used to detect measurement bias. Measurement bias is examined from a general latent variable perspective so as to accommodate different forms of testing in a variety of contexts including cognitive or clinical variables, attitudes, personality dimensions, or emotional states. Measurement models that underlie psychometric practice are described, including their strengths and limitations. Practical strategies and examples for dealing with bias detection are provided throughout. The book begins with an introduction to the general topic, followed by a review of the measurement models used in psychometric theory. Emphasis is placed on latent variable models, with introductions to classical test theory, factor analysis, and item response theory, and the controversies associated with each, being provided. Measurement invariance and bias in the context of multiple populations is defined in chapter 3 followed by chapter 4 that describes the common factor model for continuous measures in multiple populations and its use in the investigation of factorial invariance. Identification problems in confirmatory factor analysis are examined along with estimation and fit evaluation and an example using WAIS-R data. The factor analysis model for discrete measures in multiple populations with an emphasis on the specification, identification, estimation, and fit evaluation issues is addressed in the next chapter. An MMPI item data example is provided. Chapter 6 reviews both dichotomous and polytomous item response scales emphasizing estimation methods and model fit evaluation. The use of models in item response theory in evaluating invariance across multiple populations is then described, including an example that uses data from a large-scale achievement test. Chapter 8 examines item bias evaluation methods that use observed scores to match individuals and provides an example that applies item response theory to data introduced earlier in the book. The book concludes with the implications of measurement bias for the use of tests in prediction in educational or employment settings. A valuable supplement for advanced courses on psychometrics, testing, measurement, assessment, latent variable modeling, and/or quantitative methods taught in departments of psychology and education, researchers faced with considering bias in measurement will also value this book.

Author: Craig Wells
Publisher:
ISBN: 9781108750561
Category : PSYCHOLOGY
Languages : en
Pages :

View

Book Description
"Assessing Measurement Invariance for Applied Research will provide psychometricians and researchers across diverse disciplines in the social sciences the necessary knowledge and skills to select and apply appropriate methods to assess measurement invariance. It is a user-friendly guide that describes a variety of statistical methods using a pedagogical framework emphasizing conceptual understanding with extensive illustrations that demonstrate how to use software to analyze real data. A companion website (people.umass.edu/cswells) provides downloadable computer syntax and the data sets demonstrated in this book so readers can use them to become familiar with the analyses and understand how to apply the methods with proficiency to their own work. Evidence-supported methods that can be readily applied to real world data are described and illustrated, providing researchers with many options from which to select given the characteristics of their data. The approaches include observed-score methods and those that use item response theory models and confirmatory factor analysis,"--

Author: Jennifer McGee Reyes
Publisher:
ISBN:
Category :
Languages : en
Pages :

View

Book Description
The purpose of the present study was to examine the invariance of the factor structure and item response model parameter estimates obtained from a set of 27 items selected from the 2002 and 2003 forms of Your First College Year (YFCY). The first major research question of the present study was: How similar/invariant are the factor structures obtained from two datasets (i.e., identical items, different people)? The first research question was addressed in two parts: (1) Exploring factor structures using the YFCY02 dataset; and (2) Assessing factorial invariance using the YFCY02 and YFCY03 datasets. After using exploratory and confirmatory and factor analysis for ordered data, a four-factor model using 20 items was selected based on acceptable model fit for the YFCY02 and YFCY03 datasets. The four factors (constructs) obtained from the final model were: Overall Satisfaction, Social Agency, Social Self Concept, and Academic Skills. To assess factorial invariance, partial and full factorial invariance were examined. The four-factor model fit both datasets equally well, meeting the criteria for partial and full measurement invariance. The second major research question of the present study was: How similar/invariant are person and item parameter estimates obtained from two different datasets (i.e., identical items, different people) for the homogenous graded response model (Samejima, 1969) and the partial credit model (Masters, 1982)? To evaluate measurement invariance using IRT methods, the item discrimination and item difficulty parameters obtained from the GRM need to be equivalent across datasets. The YFCY02 and YFCY03 GRM item discrimination parameters (slope) correlation was 0.828. The YFCY02 and YFCY03 GRM item difficulty parameters (location) correlation was 0.716. The correlations and scatter plots indicated that the item discrimination parameter estimates were more invariant than the item difficulty parameter estimates across the YFCY02 and YFCY03 datasets.

Author: Craig S. Wells
Publisher: Cambridge University Press
ISBN: 1108620744
Category : Psychology
Languages : en
Pages : 418

View

Book Description
This book focuses on the practical application of statistical techniques for assessing measurement invariance with less emphasis on theoretical development or exposition. Instead, it describes the methods using a pedagogical framework followed by extensive illustrations that demonstrate how to use software to analyze real data. The chapters illustrate the practical methods to assess measurement invariance and shows how to apply them to a range of data. The computer syntax and data sets used in this book are available for download here: people.umass.edu/cswells.

Author: M.D. Reckase
Publisher: Springer Science & Business Media
ISBN: 0387899766
Category : Social Science
Languages : en
Pages : 355

View

Book Description
First thorough treatment of multidimensional item response theory Description of methods is supported by numerous practical examples Describes procedures for multidimensional computerized adaptive testing

Author: Frank B. Baker
Publisher: Springer
ISBN: 3319542052
Category : Social Science
Languages : en
Pages : 177

View

Book Description
This graduate-level textbook is a tutorial for item response theory that covers both the basics of item response theory and the use of R for preparing graphical presentation in writings about the theory. Item response theory has become one of the most powerful tools used in test construction, yet one of the barriers to learning and applying it is the considerable amount of sophisticated computational effort required to illustrate even the simplest concepts. This text provides the reader access to the basic concepts of item response theory freed of the tedious underlying calculations. It is intended for those who possess limited knowledge of educational measurement and psychometrics. Rather than presenting the full scope of item response theory, this textbook is concise and practical and presents basic concepts without becoming enmeshed in underlying mathematical and computational complexities. Clearly written text and succinct R code allow anyone familiar with statistical concepts to explore and apply item response theory in a practical way. In addition to students of educational measurement, this text will be valuable to measurement specialists working in testing programs at any level and who need an understanding of item response theory in order to evaluate its potential in their settings.