Dealing With Complexity In Development Evaluation

Recognizing that complexity calls for innovative, conceptual, and methodological solutions, Dealing with Complexity in Development Evaluation by Michael Bamberger, Jos Vaessen, and Estelle Raimondo offers practical guidance to policymakers, managers, and evaluation practitioners on how to design and implement complexity-responsive evaluations that can be undertaken in the real world of time, budget, data, and political constraints. Introductory chapters present comprehensive, non-technical overviews of the most common evaluation tools and methodologies, and additional content addresses more cutting-edge material. The book also includes six case study chapters to illustrate examples of various evaluation contexts from around the world.

Recognizing that complexity calls for innovative, conceptual, and methodological solutions, this unique book offers practical guidance to policymakers, managers, and evaluation practitioners on how to design and implement complexity-responsive evaluations that can be undertaken in the real world of time, budget, data, and political constraints. Introductory chapters present comprehensive, non-technical overviews of the most common evaluation tools and methodologies, and additional content addresses more cutting-edge material. The book also includes six case study chapters to illustrate examples of various evaluation contexts from around the world.

Developmental evaluation (DE) offers a powerful approach to monitoring and supporting social innovations by working in partnership with program decision makers. In this book, eminent authority Michael Quinn Patton shows how to conduct evaluations within a DE framework. Patton draws on insights about complex dynamic systems, uncertainty, nonlinearity, and emergence. He illustrates how DE can be used for a range of purposes: ongoing program development, adapting effective principles of practice to local contexts, generating innovations and taking them to scale, and facilitating rapid response in crisis situations. Students and practicing evaluators will appreciate the book's extensive case examples and stories, cartoons, clear writing style, "closer look" sidebars, and summary tables. Provided is essential guidance for making evaluations useful, practical, and credible in support of social change. See also Developmental Evaluation Exemplars, edited by Michael Quinn Patton, Kate McKegg, and Nan Wehipeihana, which presents 12 in-depth case studies.

'The Road to Results: Designing and Conducting Effective Development Evaluations' presents concepts and procedures for evaluation in a development context. It provides procedures and examples on how to set up a monitoring and evaluation system, how to conduct participatory evaluations and do social mapping, and how to construct a "rigorous" quasi-experimental design to answer an impact question. The text begins with the context of development evaluation and how it arrived where it is today. It then discusses current issues driving development evaluation, such as the Millennium Development Goals and the move from simple project evaluations to the broader understandings of complex evaluations. The topics of implementing 'Results-based Measurement and Evaluation' and constructing a 'Theory of Change' are emphasized throughout the text. Next, the authors take the reader down 'the road to results, ' presenting procedures for evaluating projects, programs, and policies by using a 'Design Matrix' to help map the process. This road includes: determining the overall approach, formulating questions, selecting designs, developing data collection instruments, choosing a sampling strategy, and planning data analysis for qualitative, quantitative, and mixed method evaluations. The book also includes discussions on conducting complex evaluations, how to manage evaluations, how to present results, and ethical behavior--including principles, standards, and guidelines. The final chapter discusses the future of development evaluation. This comprehensive text is an essential tool for those involved in development evaluation.

This expanded and updated edition of Complexity Theory and the Social Sciences: The State of the Art revisits the use of complexity theory across the social sciences and demonstrates how complexity informs approaches to various contemporary issues in the context of the COVID-19 pandemic, widening social inequality, and impending social and ecological catastrophe wrought by global warming. The book reviews complexity theory in the practice of the social sciences and at their interface with ecological science. It outlines how social theory can be reconciled with complexity thinking and presents a review of the way research can be done using complexity theory. The book suggests how complexity theory can be used to understand and evaluate governance processes, particularly with regard to social inequality and the climate crisis. The impact of the COVID-19 pandemic is also examined through a complexity lens, reviewing how complexity thinking has been employed in relation to the pandemic and how implementing a complexity framework can transform health and social care. The book concludes with a call to action and the use of complexity theory to inform critical thinking in the education system. This textbook will be immensely useful to students and researchers interested in social research methods, social theory, business and organization studies, health, education, urban studies, and development studies.

"Developmental evaluation (DE) provides evaluative information and feedback to social innovators, and their funders and supporters, to inform adaptive development of change initiatives in complex dynamic environments. DE brings to innovation and adaptation the processes of asking evaluative questions, applying evaluation logic, and gathering and reporting evaluative data to inform and support the development of innovative projects, programs, initiatives, products, organizations, and/or systems change efforts with timely feedback. This book presents the current state of the art and practice of DE through 12 case exemplars. The book also answers to common questions about DE, presents a synthesis of patterns, themes, insights and lessons drawn from the case studies, and, for the first time, identifies and explains the essential guiding principles of DE"--

This book discusses the crucial place that assumptions hold in conceptualizing, implementing, and evaluating development programs. It suggests simple ways for stakeholders and evaluators to 1) examine their assumptions about program theory and environmental conditions and 2) develop and carry out effective program monitoring and evaluation in light of those assumptions. A survey of evaluators from an international development agency reviewed the state of practice on assumptions-aware evaluation. This 2nd edition has been updated with further illustrations, case studies, and frameworks that have been researched and tested in the years since the first edition. Regardless of geography or goal, development programs and policies are fueled by a complex network of implicit ideas. Stakeholders may hold assumptions about purposes, outcomes, methodology, and the value of project evaluation and evaluators—which may or may not be shared by the evaluators. A major barrier to viable program evaluations is that development programs are based on assumptions that often are not well articulated. In designing programs, stakeholders often lack clear outlines for how implemented interventions will bring desired changes. This lack of clarity masks critical risks to program success and makes it challenging to evaluate such programs. Methods that have attempted to address this dilemma have been popularized as theory of change or other theory‐based approaches. Often, however, theory-based methods do not sufficiently clarify how program managers or evaluators should work with the assumptions inherent in the connections between the steps. The critical examination of assumptions in evaluation is essential for effective evaluations and evaluative thinking. "How does one think evaluatively? It all begins with assumptions. Systematically articulating, examining, and testing assumptions is the foundation of evaluative thinking... This book, more than any other, explains how to build a strong foundation for effective interventions and useful evaluation by rigorously working with assumptions." —Michael Quinn Patton, PhD. Author of Utilization-Focused Evaluation and co-editor of THOUGHTWORK: Thinking, Action, and the Fate of the World, USA. "This updated edition presents us with a new opportunity to delve into both the theoretical and practical aspects of paradigmatic, prescriptive, and causal assumptions. We need to learn, and apply these insights with the deep attention they deserve." —Zenda Ofir, PhD. Independent Evaluator, Richard von Weizsäcker Fellow, Robert Bosch Academy, Berlin, Germany. Honorary Professor, School of Public Leadership, Stellenbosch University, South Africa. “This thought-provoking book explains why assumptions are an essential condition within the theories and methodologies of evaluation; and how assumptions influence the ways that evaluators approach their work...It will enrich the ways that evaluators develop their models, devise their methodologies, interpret their data, and interact with their stakeholders.” —Jonny Morell, Ph.D., President, 4.669... Evaluation and Planning, Editor Emeritus, Evaluation and Program Planning

Developmental evaluation has emerged fairly recently as a way to support adaptive learning in complex and emergent initiatives. Combining the rigour of evaluation with the flexibility and imagination required for development, this new form of evaluation brings critical thinking to bear on the creative process in initiatives involving high levels of uncertainty, innovation, emergence, and social complexity.