Working with Assumptions in International Development Program Evaluation PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Working with Assumptions in International Development Program Evaluation PDF full book. Access full book title Working with Assumptions in International Development Program Evaluation by Apollo M. Nkwake. Download full books in PDF and EPUB format.
Author: Apollo M. Nkwake Publisher: Springer Science & Business Media ISBN: 1461447976 Category : Social Science Languages : en Pages : 191
Book Description
A major reason complex programs are so difficult to evaluate is that the assumptions that inspire them are poorly articulated. Stakeholders of such programs are often unclear about how the change process will unfold. Thus, it is so difficult to reasonably anticipate the early and midterm changes that need to happen in order for a longer-term goalto be reached. The lack of clarity about the “mini-steps” that must be taken to reach a long-term outcome not only makes the task of evaluating a complex initiative challenging, but reduces the likelihood that all of the important factors related to the long term goal will be addressed. Most of the resources that have attempted to address this dilemma have been popularized as theory of change or sometimes program theory approaches. Although these approaches emphasize and elaborate the sequence of changes/mini steps that lead to the long-term goal of interest and the connections between program activities and outcomes that occur at each step of the way, they do not do enough to clarify how program managers or evaluators should deal with assumptions. Assumptions, the glue that holds all the pieces together, remain abstract and far from applicable. In this book the author tackles this important assumptions theme head-on-covering a breadth of ground from the epistemology of development assumptions, to the art of making logical assumptions as well as recognizing, explicit zing and testing assumptions with in an elaborate program theory from program design, implementation, monitoring and evaluation.
Author: Apollo M. Nkwake Publisher: Springer Science & Business Media ISBN: 1461447976 Category : Social Science Languages : en Pages : 191
Book Description
A major reason complex programs are so difficult to evaluate is that the assumptions that inspire them are poorly articulated. Stakeholders of such programs are often unclear about how the change process will unfold. Thus, it is so difficult to reasonably anticipate the early and midterm changes that need to happen in order for a longer-term goalto be reached. The lack of clarity about the “mini-steps” that must be taken to reach a long-term outcome not only makes the task of evaluating a complex initiative challenging, but reduces the likelihood that all of the important factors related to the long term goal will be addressed. Most of the resources that have attempted to address this dilemma have been popularized as theory of change or sometimes program theory approaches. Although these approaches emphasize and elaborate the sequence of changes/mini steps that lead to the long-term goal of interest and the connections between program activities and outcomes that occur at each step of the way, they do not do enough to clarify how program managers or evaluators should deal with assumptions. Assumptions, the glue that holds all the pieces together, remain abstract and far from applicable. In this book the author tackles this important assumptions theme head-on-covering a breadth of ground from the epistemology of development assumptions, to the art of making logical assumptions as well as recognizing, explicit zing and testing assumptions with in an elaborate program theory from program design, implementation, monitoring and evaluation.
Author: Apollo M. Nkwake Publisher: Springer Nature ISBN: 3030330044 Category : Social Science Languages : en Pages : 223
Book Description
This book discusses the crucial place that assumptions hold in conceptualizing, implementing, and evaluating development programs. It suggests simple ways for stakeholders and evaluators to 1) examine their assumptions about program theory and environmental conditions and 2) develop and carry out effective program monitoring and evaluation in light of those assumptions. A survey of evaluators from an international development agency reviewed the state of practice on assumptions-aware evaluation. This 2nd edition has been updated with further illustrations, case studies, and frameworks that have been researched and tested in the years since the first edition. Regardless of geography or goal, development programs and policies are fueled by a complex network of implicit ideas. Stakeholders may hold assumptions about purposes, outcomes, methodology, and the value of project evaluation and evaluators—which may or may not be shared by the evaluators. A major barrier to viable program evaluations is that development programs are based on assumptions that often are not well articulated. In designing programs, stakeholders often lack clear outlines for how implemented interventions will bring desired changes. This lack of clarity masks critical risks to program success and makes it challenging to evaluate such programs. Methods that have attempted to address this dilemma have been popularized as theory of change or other theory‐based approaches. Often, however, theory-based methods do not sufficiently clarify how program managers or evaluators should work with the assumptions inherent in the connections between the steps. The critical examination of assumptions in evaluation is essential for effective evaluations and evaluative thinking. "How does one think evaluatively? It all begins with assumptions. Systematically articulating, examining, and testing assumptions is the foundation of evaluative thinking... This book, more than any other, explains how to build a strong foundation for effective interventions and useful evaluation by rigorously working with assumptions." —Michael Quinn Patton, PhD. Author of Utilization-Focused Evaluation and co-editor of THOUGHTWORK: Thinking, Action, and the Fate of the World, USA. "This updated edition presents us with a new opportunity to delve into both the theoretical and practical aspects of paradigmatic, prescriptive, and causal assumptions. We need to learn, and apply these insights with the deep attention they deserve." —Zenda Ofir, PhD. Independent Evaluator, Richard von Weizsäcker Fellow, Robert Bosch Academy, Berlin, Germany. Honorary Professor, School of Public Leadership, Stellenbosch University, South Africa. “This thought-provoking book explains why assumptions are an essential condition within the theories and methodologies of evaluation; and how assumptions influence the ways that evaluators approach their work...It will enrich the ways that evaluators develop their models, devise their methodologies, interpret their data, and interact with their stakeholders.” —Jonny Morell, Ph.D., President, 4.669... Evaluation and Planning, Editor Emeritus, Evaluation and Program Planning
Author: Luca Simeone Publisher: Edward Elgar Publishing ISBN: 1803927712 Category : Business & Economics Languages : en Pages : 354
Book Description
This book offers insights into how the Theory of Change framework can be effectively employed in a wide range of social interventions. Presenting its potential to support strategy and strategic thinking, this book offers an entry point to understanding how Theory of Change can be applied beyond the typical domain of aid projects.
Author: Wendy Goff Publisher: Cambridge University Press ISBN: 1108904807 Category : Education Languages : en Pages : 223
Book Description
Partnerships with Families and Communities: Building Dynamic Relationships is a comprehensive and accessible resource that provides pre-service teachers with the tools required to build effective, sustainable and proactive partnerships in both early childhood and primary educational settings. This text introduces models of home-school-community partnerships in educational contexts and presents a comprehensive partnerships approach for best practice in applying and leading effective relationships with key stakeholders. It explores essential underpinning policies, legislation and research theories that position strong, positive and proactive partnerships as a systemic solution to children's learning development. Key topics covered include diversity in partnership work, reflective practice and tools for evaluating working partnerships. Each chapter includes focused pedagogy, key terms and definitions, scenarios and review questions, which enable readers to deeply engage with new concepts. 'Proactive Partners' boxes explore real-world scenarios and encourage readers to link theory with practice.
Author: Apollo M. Nkwake Publisher: Springer ISBN: 9783031456138 Category : Psychology Languages : en Pages : 0
Book Description
This book focuses on methods of choice in program evaluation. Credible methods choice lies in the assumptions we make about the appropriateness and validity of selected methods and the validity of those assumptions. As evaluators make methodological decisions in various stages of the evaluation process, a number of validity questions arise. Yet unexamined assumptions are a risk to useful evaluation. The first edition of this book discussed the formulation of credible methodological arguments and methods of examining validity assumptions. However, previous publications suggest advantages and disadvantages of using various methods and when to use them. Instead, this book analyzes assumptions underlying actual methodological choices in evaluation studies and how these influence evaluation quality. This analysis is the basis of suggested tools. The second edition extends the review of methodological assumptions to the evaluation of humanitarian assistance. While evaluators of humanitarian action apply conventional research methods and standards, they have to adapt these methods to the challenges and constraints of crisis contexts. For example, the urgency and chaos of humanitarian emergencies makes it hard to obtain program documentation; objectives may be unclear, and early plans may quickly become outdated as the context changes or is clarified. The lack of up-to-date baseline data is not uncommon. Neither is staff turnover. Differences in perspective may intensify and undermine trust. The deviation from ideal circumstances challenges evaluation and calls for methodological innovation. And how do evaluators work with assumptions in non-ideal settings? What tools are most relevant and effective? This revised edition reviews major evaluations of humanitarian action and discusses strategies for working with evaluation assumptions in crises and stable program settings.
Author: Donna M. Mertens Publisher: Guilford Press ISBN: 1462503241 Category : Social Science Languages : en Pages : 642
Book Description
This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large- and small-scale evaluations. Numerous sample studies—many with reflective commentary from the evaluators—reveal the process through which an evaluator incorporates a paradigm into an actual research project. The book shows how theory informs methodological choices (the specifics of planning, implementing, and using evaluations). It offers balanced coverage of quantitative, qualitative, and mixed methods approaches. Useful pedagogical features include: *Examples of large- and small-scale evaluations from multiple disciplines. *Beginning-of-chapter reflection questions that set the stage for the material covered. *"Extending your thinking" questions and practical activities that help readers apply particular theoretical paradigms in their own evaluation projects. *Relevant Web links, including pathways to more details about sampling, data collection, and analysis. *Boxes offering a closer look at key evaluation concepts and additional studies. *Checklists for readers to determine if they have followed recommended practice. *A companion website with resources for further learning.
Author: Apollo M. Nkwake Publisher: Springer Nature ISBN: 3031456149 Category : Psychology Languages : en Pages : 199
Book Description
This book focuses on methods of choice in program evaluation. Credible methods choice lies in the assumptions we make about the appropriateness and validity of selected methods and the validity of those assumptions. As evaluators make methodological decisions in various stages of the evaluation process, a number of validity questions arise. Yet unexamined assumptions are a risk to useful evaluation. The first edition of this book discussed the formulation of credible methodological arguments and methods of examining validity assumptions. However, previous publications suggest advantages and disadvantages of using various methods and when to use them. Instead, this book analyzes assumptions underlying actual methodological choices in evaluation studies and how these influence evaluation quality. This analysis is the basis of suggested tools. The second edition extends the review of methodological assumptions to the evaluation of humanitarian assistance. While evaluators of humanitarian action apply conventional research methods and standards, they have to adapt these methods to the challenges and constraints of crisis contexts. For example, the urgency and chaos of humanitarian emergencies makes it hard to obtain program documentation; objectives may be unclear, and early plans may quickly become outdated as the context changes or is clarified. The lack of up-to-date baseline data is not uncommon. Neither is staff turnover. Differences in perspective may intensify and undermine trust. The deviation from ideal circumstances challenges evaluation and calls for methodological innovation. And how do evaluators work with assumptions in non-ideal settings? What tools are most relevant and effective? This revised edition reviews major evaluations of humanitarian action and discusses strategies for working with evaluation assumptions in crises and stable program settings.
Author: Paul J. Gertler Publisher: World Bank Publications ISBN: 1464807809 Category : Business & Economics Languages : en Pages : 444
Book Description
The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.
Author: Linda G. Morra-Imas Publisher: World Bank Publications ISBN: 0821379119 Category : Business & Economics Languages : en Pages : 611
Book Description
'The Road to Results: Designing and Conducting Effective Development Evaluations' presents concepts and procedures for evaluation in a development context. It provides procedures and examples on how to set up a monitoring and evaluation system, how to conduct participatory evaluations and do social mapping, and how to construct a "rigorous" quasi-experimental design to answer an impact question. The text begins with the context of development evaluation and how it arrived where it is today. It then discusses current issues driving development evaluation, such as the Millennium Development Goals and the move from simple project evaluations to the broader understandings of complex evaluations. The topics of implementing 'Results-based Measurement and Evaluation' and constructing a 'Theory of Change' are emphasized throughout the text. Next, the authors take the reader down 'the road to results, ' presenting procedures for evaluating projects, programs, and policies by using a 'Design Matrix' to help map the process. This road includes: determining the overall approach, formulating questions, selecting designs, developing data collection instruments, choosing a sampling strategy, and planning data analysis for qualitative, quantitative, and mixed method evaluations. The book also includes discussions on conducting complex evaluations, how to manage evaluations, how to present results, and ethical behavior--including principles, standards, and guidelines. The final chapter discusses the future of development evaluation. This comprehensive text is an essential tool for those involved in development evaluation.
Author: Michael Bamberger Publisher: SAGE Publications ISBN: 1544318766 Category : Social Science Languages : en Pages : 747
Book Description
RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints addresses the challenges of conducting program evaluations in real-world contexts where evaluators and their clients face budget and time constraints. The book is organized around the authors’ seven-step model that has been tested in workshops and practice environments to help the evaluation implementers and managers make the best choices when faced with real world constraints. The Third Edition includes a new chapter on gender equality and women’s empowerment and discussion of digital technology and data science.
Author: Apollo M. Nkwake
Author: Apollo M. Nkwake
Author: Apollo M. Nkwake
Author: Luca Simeone
Author: Wendy Goff
Author: Apollo M. Nkwake
Author: Donna M. Mertens
Author: Apollo M. Nkwake
Author: Paul J. Gertler
Author: Linda G. Morra-Imas
Author: Michael Bamberger