Revisiting Truth Beauty And Justice Evaluating With Validity In The 21st Century

This issue discusses ways of constructing, organizing, and managing arguments for evaluation. Not focued solely on the logic of evaluation or predictive validity, it discusses the various elements needed to construct evaluation arguments that are compelling and influential by virtue of the truth, beauty, and justice they express. Through exposition, original research, critical reflection, and application to case examples, the authors present tools, perspectives, and guides to help evaluators navigate the complex contexts of evaluation in the 21st century. This is the 142nd issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.

This book focuses on methods of choice in program evaluation. Credible methods choice lies in the assumptions we make about the appropriateness and validity of selected methods and the validity of those assumptions. As evaluators make methodological decisions in various stages of the evaluation process, a number of validity questions arise. Yet unexamined assumptions are a risk to useful evaluation. The first edition of this book discussed the formulation of credible methodological arguments and methods of examining validity assumptions. However, previous publications suggest advantages and disadvantages of using various methods and when to use them. Instead, this book analyzes assumptions underlying actual methodological choices in evaluation studies and how these influence evaluation quality. This analysis is the basis of suggested tools. The second edition extends the review of methodological assumptions to the evaluation of humanitarian assistance. While evaluators of humanitarian action apply conventional research methods and standards, they have to adapt these methods to the challenges and constraints of crisis contexts. For example, the urgency and chaos of humanitarian emergencies makes it hard to obtain program documentation; objectives may be unclear, and early plans may quickly become outdated as the context changes or is clarified. The lack of up-to-date baseline data is not uncommon. Neither is staff turnover. Differences in perspective may intensify and undermine trust. The deviation from ideal circumstances challenges evaluation and calls for methodological innovation. And how do evaluators work with assumptions in non-ideal settings? What tools are most relevant and effective? This revised edition reviews major evaluations of humanitarian action and discusses strategies for working with evaluation assumptions in crises and stable program settings.

This volume is devoted to the theme of social responsibility, social justice, and evaluation. It examines the evaluation–social justice interface and: shares a variety of options and examples from different settings, gives voice to populations whose voices are rarely heard, and contributes to fulfilling the potential of the significant role evaluation can have in promoting social change. First discussing issues related to evaluation, social responsibility, social justice, and marginalized populations in general, it goes on to address issues concerning populations marginalized due to health, psychological, and physical difficulties; their cultural or ethnic/national status; or the specific geopolitical context of Israel. This is the 146th issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.

Grassroots Engagement and Social Justice through Cooperative Extension grows out of a commitment to the belief that Cooperative Extension professionals can and should be deeply engaged with the communities they work in to improve life—individually and collectively. Rooted in an understanding of the history and development of Extension, the authors focus on contemporary efforts to address systemic inequities. They offer an alternative to the “expert” model that would have Extension educators provide information detached from the difficult and sometimes contentious issues that shape community work. These essays highlight Extension’s role in and responsibility for culturally relevant community education that is rooted in democratic practices and social justice. The ultimate aim of this book is to offer a vision for the future of Extension as its practitioners continue to reach for cultural competence necessary to address issues of systemic injustice in the communities they serve and of which they are a part.

Evaluation examines policies and programs across every arena of human endeavor, from efforts to stop the spread of HIV/AIDS to programs that drive national science policy. Relying on a vast array of methods, from qualitative interviewing to econometrics, it is a "transdiscipline," as opposed to a formal area of academic study. Accounting for these challenges, Evaluation Foundations Revisited offers an introduction for those seeking to better understand evaluation as a professional field. While the acquisition of methods and methodologies to meet the needs of certain projects is important, the foundation of evaluative practice rests on understanding complex issues to balance. Evaluation Foundations Revisited is an invitation to examine the intellectual, practical, and philosophical nexus that lies at the heart of evaluation. Thomas A. Schwandt shows how to critically engage with the assumptions that underlie how evaluators define and position their work, as well as how they argue for the usefulness of evaluation in society. He looks at issues such as the role of theory, how notions of value and valuing are understood, how evidence is used, how evaluation is related to politics, and what comprises scientific integrity. By coming to better understand the foundations of evaluation, readers will develop what Schwandt terms "a life of the mind of practice," which enables evaluators to draw on a more holistic view to develop reasoned arguments and well fitted techniques.

How do people evaluate in daily life? This issue broaches this topic to better understand this dimension of being human, to develop evaluation theory, and to improve extraprofessional and professional evaluation practice. As part of a larger study addressing these issues in the lives of many professional evaluators around the world, case studies of seven early evaluation theorists and practitioners from North America were conducted. This issue contains articles with stories of some of their evaluation life experiences told and interpreted by these individuals, with commentary by an eighth evaluator. Themes that cross the cases are proposed, and responses by the individuals highlighted are shared in a final article. This is the 150th issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.

Governments and organizations of all shapes and sizes espouse values of equity and social justice. Yet, there are many examples of unfair social arrangements and employment conditions, dysfunctional government practices, and growing income inequality in both developed and developing countries worldwide. The profession and transdiscipline of evaluation is well equipped to address issues of inequality and social injustice, but until recently has been much more focused on primary stakeholder and donor satisfaction (being as useful as possible to funders of interventions and evaluations) and accountability concerns. The authors in this volume challenge the field of evaluation to become more concerned about using evaluation to develop more equitable organizations, governments, and societies. Leading evaluation theorists and practitioners including Michael Scriven, Jennifer Greene, Thomas Schwandt, Emily Gates, Sandra Mathison, Karen Kirkhart, Saville Kushner, Lois-Ellin Datta, Ernest House, Robert Stake, Patricia Rogers, Robert Picciotto and Stewart Donaldson, provide a range of visions for how evaluation can play a much larger role in facilitating social justice across the globe. Evaluation for an Equitable Society will be of great interest to evaluation practitioners, students and scholars. It will be of interest to those teaching and taking introductory evaluation courses, as well as advanced courses focused on improving evaluation theory and practice.

The World Health Organization defines health inequities as differences in health outcomes that are systematic, avoidable, and unjust; and the result of poor social policies, unfair economic arrangements, and bad politics. This volume describes the role that evaluations can play in addressing health inequities. A key focus is on the types of capacities that need to be built to evaluate inequities. Bringing alive these questions around evaluation capacities are theory and practice studies from China, Chile, and India. This volume: Focuses on inequities in evaluation capacity building initiatives. Argues evaluations can be interventions themselves. Explores how evaluations can have influence in addressing inequities. Recognizes that innovations in evaluation capacity experiments are occurring in diverse countries and we have the opportunity to learn from such initiatives. This is the 154th issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.