Evaluating Evaluations

Program Evaluation: Embedding Evaluation into Program Design and Development provides an in-depth examination of the foundations, methods, and relevant issues in the field of evaluation. With an emphasis on an embedded approach, where evaluation is an explicit part of a program that leads to the refinement of the program, students will learn how to conduct effective evaluations that foster continual improvement and enable data-based decision making. This text provides students with both the theoretical understanding and the practical tools to conduct effective evaluations while being rigorous enough for experienced evaluators looking to expand their approach to evaluation.

How can programs and organizations ensure they are adhering to core principles--and assess whether doing so is yielding desired results? From evaluation pioneer Michael Quinn Patton, this book introduces the principles-focused evaluation (P-FE) approach and demonstrates its relevance and application in a range of settings. Patton explains why principles matter for program development and evaluation and how they can serve as a rudder to navigate the uncertainties, turbulence, and emergent challenges of complex dynamic environments. In-depth exemplars illustrate how the unique GUIDE framework is used to determine whether principles provide meaningful guidance (G) and are useful (U), inspiring (I), developmentally adaptable (D), and evaluable (E). User-friendly features include rubrics, a P-FE checklist, firsthand reflections and examples from experienced P-FE practitioners, sidebars and summary tables, and end-of-chapter application exercises. ÿ

Including a new section on evaluation accountability, this Third Edition details 30 standards which give advice to those interested in planning, implementing and using program evaluations.

This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large- and small-scale evaluations. Numerous sample studies—many with reflective commentary from the evaluators—reveal the process through which an evaluator incorporates a paradigm into an actual research project. The book shows how theory informs methodological choices (the specifics of planning, implementing, and using evaluations). It offers balanced coverage of quantitative, qualitative, and mixed methods approaches. Useful pedagogical features include: *Examples of large- and small-scale evaluations from multiple disciplines. *Beginning-of-chapter reflection questions that set the stage for the material covered. *"Extending your thinking" questions and practical activities that help readers apply particular theoretical paradigms in their own evaluation projects. *Relevant Web links, including pathways to more details about sampling, data collection, and analysis. *Boxes offering a closer look at key evaluation concepts and additional studies. *Checklists for readers to determine if they have followed recommended practice.

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

"The Program Evaluation Standards is a 'must-have' book for anyone responsible for reviewing evaluation proposals, planning and conducting evaluations, managing evaluation projects, or judging the merit and worth of evaluations once completed. For experienced practitioners, it provides a set of values and principles by which to guide successful practice, that is, a set of criteria that determines whether educational evaluations are trustworthy and fair. The Standards sets expectations of the design and implementation of educational evaluation for all practitioners in all types of educational arenas, even those involved in social programming endeavors. For newcomers and those less experienced who may be responsible for commissioning and using evaluations, the Standards supplies a useful framework of generating a list of questions to raise about any evaluation plan or final report in an effort to assess its pros and cons. The book is an invaluable 'how-to' resource for graduate students venturing out into the field, and it instills a sense of what it means to be a responsible evaluator. For clients or consumers, the book offers advice on what they should expect of an evaluation"--Publisher description.

"The book's chapters provide background on how and why the CIPP (Context, Input, Process, Product) Model was developed; a detailed presentation of the model; an explanation of the key role of an evaluation-oriented leader, who can decide what and when to evaluate; detailed presentations on evaluation design, budgeting, and contracting; procedures and tools for collecting, analyzing, and reporting evaluation information; and procedures for conducting standards-based meta-evaluations (evaluations of evaluations). These topics are interspersed with illustrative evaluation cases in such areas as education, housing, and military personnel evaluation"--

Evaluation research findings should be a key element of the policy-making process, yet in reality they are often disregarded. This valuable book examines the development of evaluation and its impact on public policy by analysing evaluation frameworks and criteria which are available when evaluating public policies and services. It further examines the nature of evidence and its use and non-use by decision-makers and assesses the work of influential academics in the USA and UK in the context of evaluation and policy making. The book emphasises the 'real world' of decision-makers in the public sector and recognises how political demands and economic pressures can affect the decisions of those who commission evaluation research while providing recommendations for policymakers on adopting a different approach to evaluation. This is essential reading for under-graduate and post-graduate students of policy analysis and public sector management, and those who are involved in the planning and evaluation of public policies and services.