Advancing Validity in Outcome Evaluation: Theory and Practice PDF Download

Author: Huey T. Chen
Publisher: John Wiley & Sons
ISBN: 1118159195
Category : Education
Languages : en
Pages : 157

View

Book Description
Exploring the influence and application of Campbellian validity typology in the theory and practice of outcome evaluation, this volume addresses the strengths and weaknesses of this often controversial evaluation method and presents new perspectives for its use. Editors Huey T. Chen, Stewart I. Donaldson and Melvin M. Mark provide a historical overview of the Campbellian typology adoption, contributions and criticism. Contributing authors propose strategies in developing a new perspective of validity typology for advancing validity in program evaluation including Enhance External Validity Enhance Precision by Reclassifying the Campbellian Typology Expand the Scope of the Typology The volume concludes with William R. Shadish's spirited rebuttal to earlier chapters. A collaborator with Don Campbell, Shadish provides a balance to the perspective of the issue with a clarification and defense of Campbell's work. This is the 129th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

Author: Huey T. Chen
Publisher: John Wiley & Sons
ISBN: 1118159179
Category : Education
Languages : en
Pages : 138

View

Book Description
Exploring the influence and application of Campbellian validity typology in the theory and practice of outcome evaluation, this volume addresses the strengths and weaknesses of this often controversial evaluation method and presents new perspectives for its use. Editors Huey T. Chen, Stewart I. Donaldson and Melvin M. Mark provide a historical overview of the Campbellian typology adoption, contributions and criticism. Contributing authors propose strategies in developing a new perspective of validity typology for advancing validity in program evaluation including Enhance External Validity Enhance Precision by Reclassifying the Campbellian Typology Expand the Scope of the Typology The volume concludes with William R. Shadish's spirited rebuttal to earlier chapters. A collaborator with Don Campbell, Shadish provides a balance to the perspective of the issue with a clarification and defense of Campbell's work. This is the 129th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

Author: Huey T. Chen
Publisher: Jossey-Bass
ISBN: 9781118094075
Category : Education
Languages : en
Pages : 136

View

Book Description
Exploring the influence and application of Campbellian validity typology in the theory and practice of outcome evaluation, this volume addresses the strengths and weaknesses of this often controversial evaluation method and presents new perspectives for its use. Editors Huey T. Chen, Stewart I. Donaldson and Melvin M. Mark provide a historical overview of the Campbellian typology adoption, contributions and criticism. Contributing authors propose strategies in developing a new perspective of validity typology for advancing validity in program evaluation including Enhance External Validity Enhance Precision by Reclassifying the Campbellian Typology Expand the Scope of the Typology The volume concludes with William R. Shadish's spirited rebuttal to earlier chapters. A collaborator with Don Campbell, Shadish provides a balance to the perspective of the issue with a clarification and defense of Campbell's work. This is the 129th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

Author: Apollo M. Nkwake
Publisher: Springer Nature
ISBN: 3031456149
Category : Psychology
Languages : en
Pages : 199

View

Book Description
This book focuses on methods of choice in program evaluation. Credible methods choice lies in the assumptions we make about the appropriateness and validity of selected methods and the validity of those assumptions. As evaluators make methodological decisions in various stages of the evaluation process, a number of validity questions arise. Yet unexamined assumptions are a risk to useful evaluation. The first edition of this book discussed the formulation of credible methodological arguments and methods of examining validity assumptions. However, previous publications suggest advantages and disadvantages of using various methods and when to use them. Instead, this book analyzes assumptions underlying actual methodological choices in evaluation studies and how these influence evaluation quality. This analysis is the basis of suggested tools. The second edition extends the review of methodological assumptions to the evaluation of humanitarian assistance. While evaluators of humanitarian action apply conventional research methods and standards, they have to adapt these methods to the challenges and constraints of crisis contexts. For example, the urgency and chaos of humanitarian emergencies makes it hard to obtain program documentation; objectives may be unclear, and early plans may quickly become outdated as the context changes or is clarified. The lack of up-to-date baseline data is not uncommon. Neither is staff turnover. Differences in perspective may intensify and undermine trust. The deviation from ideal circumstances challenges evaluation and calls for methodological innovation. And how do evaluators work with assumptions in non-ideal settings? What tools are most relevant and effective? This revised edition reviews major evaluations of humanitarian action and discusses strategies for working with evaluation assumptions in crises and stable program settings.

Author: Catherine S. Taylor
Publisher: Oxford University Press
ISBN: 019979104X
Category : Psychology
Languages : en
Pages : 217

View

Book Description
Validity and Validation is an introduction to validity theory and to the methods used to obtain evidence for the validity of research and assessment results. The book briefly describes the philosophy of science roots of validity theory and how these philosophical perspectives influence concepts of internal and external validity in research methodology.

Author: Marvin C. Alkin
Publisher: SAGE Publications
ISBN: 1483333078
Category : Social Science
Languages : en
Pages : 441

View

Book Description
Evaluation Roots: A Wider Perspective of Theorists’ Views and Influences, Second Edition provides an updated examination of current evaluation theories and traces their evolution. Marvin C. Alkin shows how theories build upon theories and how the theories are related to each other. The way in which these evaluation "roots" grew to form a tree helps to provide a better understanding of evaluation theory. In addition to the editor's overview, the book contains essays by leading evaluation theorists. In these pieces, the evaluators comment on their own development and give their views of their placement upon the tree. **All royalties from sales of this book are donated to support the AEA Research on Evaluation Student Award.**

Author: Randy E. Bennett
Publisher: Springer
ISBN: 3319586890
Category : Education
Languages : en
Pages : 717

View

Book Description
This book is open access under a CC BY-NC 2.5 license.​​ This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.

Author: Garth den Heyer
Publisher: Springer Nature
ISBN: 3031171012
Category : Social Science
Languages : en
Pages : 255

View

Book Description
The volume aims to increase knowledge and understanding of how evidence-based policing is being adopted and implemented by police agencies in the United States and whether it is affecting the agencies' processes, strategies, community relationships and delivery of community-oriented policing services. This exploration is based on data drawn from the literature, interviews and extensive field research that resulted in the case studies presented and discussed in the book. The goal of this text will be to provide the reader with a thorough analysis of the concepts, arguments and challenges facing evidence-based policing. The history of evidence-based policing, how evidence-based practices are used in the health and social sectors, and in the United Kingdom will be examined. In addition, reasonable options for improving the use of evidence-based policing will be proposed. Overall, very practical policy implications will be outlined by a highly recognized professional who has considerable experience in policing and related research.

Author: R. Stockmann
Publisher: Springer
ISBN: 1137012471
Category : Political Science
Languages : en
Pages : 349

View

Book Description
By explaining the role of evaluation in modern societies and its historical development in the USA and Europe this book highlights the scientific roots of Evaluation and offers an overview of its fundamental theories and concepts. The process of collecting, analyzing and interpreting is explored giving an insight into the course of an evaluation.

Author: Stewart I. Donaldson
Publisher: SAGE Publications
ISBN: 1483313611
Category : Social Science
Languages : en
Pages : 353

View

Book Description
Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable “who’s who” in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.