Evaluation For A Caring Society

This book highlights views on responsive, participatory and democratic approaches to evaluation from an ethos of care. It critically scrutinizes and discusses the invisibility of care in our contemporary Western societies and evaluation practices that aim to measure practices by external standards. Alternatively, the book proposes several foci for evaluators who work from a care perspective or wish to encourage a caring society. This is a society that sees evaluation and care as a continuously unfolding relational practice of moral-political learning contributing to life-sustaining webs. ‘At one level is the evaluator’s immediately responsive and interpersonal encounter with the personal troubles of social actors, most visible, as Mills originally pointed out, in an individual’s biography and in those social settings directly open to the individual’s lived experience. (...) At another level, the sociological and political level, the evaluator operates at what Mills called the arena of public issues where immediate personal troubles are seen not only as problems encountered by individuals but as the result of structural and political arrangements in society (...) evaluation for a caring society is thought to operate at both levels’ (Thomas A. Schwandt, Professor Emeritus, University of Illinois at Urbana-Champaign). ‘The intricate relationship between evaluation and care is hardly addressed by evaluators or caregivers. This book fills a gap, as it focuses on the relationship between evaluation and care and provides a multitude of examples of evaluation as a caring practice (...) the book can serve as an antidote to the present-day haste in social practices, and contribute, in form and content, to developing an evaluation practice which may foster a caring society’ (Guy Widdershoven, Professor of Philosophy and Ethics of Medicine and head of the Department of Medical Humanities at VU University Medical Center, VU University Amsterdam).

Governments and organizations of all shapes and sizes espouse values of equity and social justice. Yet, there are many examples of unfair social arrangements and employment conditions, dysfunctional government practices, and growing income inequality in both developed and developing countries worldwide. The profession and transdiscipline of evaluation is well equipped to address issues of inequality and social injustice, but until recently has been much more focused on primary stakeholder and donor satisfaction (being as useful as possible to funders of interventions and evaluations) and accountability concerns. The authors in this volume challenge the field of evaluation to become more concerned about using evaluation to develop more equitable organizations, governments, and societies. Leading evaluation theorists and practitioners including Michael Scriven, Jennifer Greene, Thomas Schwandt, Emily Gates, Sandra Mathison, Karen Kirkhart, Saville Kushner, Lois-Ellin Datta, Ernest House, Robert Stake, Patricia Rogers, Robert Picciotto and Stewart Donaldson, provide a range of visions for how evaluation can play a much larger role in facilitating social justice across the globe. Evaluation for an Equitable Society will be of great interest to evaluation practitioners, students and scholars. It will be of interest to those teaching and taking introductory evaluation courses, as well as advanced courses focused on improving evaluation theory and practice.

Remember the pots hammered by spoons from high Manhattan windows, and parades of cars and pick-up trucks holding dear the medical professionals responding to covid-19. This book is part of that chorus, that march, to express appreciation for the giving of care. And beyond doctors and nurses, bless their hearts, to mothers caring for their babies, for captains for their teams, for the soon-to-be widowers for their wives and teachers for their students, but also for the ranchers for their cattle and the contemplative world for our environment. This is a book to think more closely of the support for care, individual as it so often will be, to be woven more closely together in a paradigm of care. Care is always prominent. Care for others, of the family, care for those of the tribe, care for animals and homes and gardens and properties, self-care. And the purse. Even without teaching, compensation, or legislation, care survives, but even with these helpings, it falls short of the need. We live in a crisis of care. Thinking explicitly and beyond health care. There is no mechanism of state and conscience that delivers care to all the venues of need, and seldom in the amounts needed. The reservoirs of care are far from empty, but at a mark that needs topping up. There is need for care advocacy, a care ethic, a paradigm. This book is about that paradigm. A care paradigm may bring comfort and recovery more fully to the people and organic creations of the world. The paradigm hears the moan of indifference. It draws upon the eyes of the heart. The paradigm is about how we see the need for care. The care paradigm, the grand beholding, is manifest in how we provide for others, how we nurture them, give succor, how we are disposed, and are not, to sacrifice to relieve their hurt. It is not only caring for those visibly needing care, unable to care for themselves, but caring for all. It is having a disposition that the hurts, large and small, that all of us carry, arouse concern and appreciation from and for each individual, the community and the world.

Democratic evaluation brings a way of thinking about evaluation’s role in society and in particular, its role in strengthening social justice. Yet the reality of applying it, and what happens when it is applied particularly outside the West, is unclear. Set in South Africa, a newly formed democracy in Southern Africa, the book affords an in-depth journey that immerses a reader into the realities of evaluation and its relation to democracy. The book starts with the broader introductory chapters that set the scene for more detailed ones which bring thorough insights into national government, local government, and civil societies’ experience of evaluation, democratic evaluation and their understanding of how it contributes to strengthening democracy (or not). A teaching case, the book concludes by providing guiding questions that encourage reflection, discussion and learning that ultimately aims to inform practice and theory.

The impetus for this volume lives in a rich and vibrant past. It is organized to honor one of the founders and most prolific contributors to the profession and transdiscipline of evaluation -- Professor Michael Scriven, and to illuminate the future of evaluation in society. Professor Scriven often shares stories of his meetings with Albert Einsten and the frame-breaking evaluation revolution he has led against the value free doctrine of the social sciences. Both his wide eyed graduate students and the more grizzled evaluation veterans in his professional development workshops quickly learn that Scriven is well traveled and has exchanged some of the boldest ideas and visions with the most brilliant thinkers of his time. Scriven insisted that the 2011 Stauffer Symposium and this volume be organized in that genre. He urged us to invite the most thoughtful and influential evaluation theorists and practitioners we could find to join him in a conversation about the future of evaluation in society. Scriven challenges us to examine the five great paradigm shifts that have revolutionized the foundations of evaluation, and that he believes will form the basis for a much brighter future for evaluation in society. Scriven’s revolutionary ideas are followed and challenged by a group of thought leaders in evaluation who do not necessarily shared his views on evaluation, but who have earned his deepest respect and whose evaluation work he admires including Michael Quinn Patton, Ernest House, Daniel Stufflebeam, Robert Stake, Jennifer Greene, Karen Kirkhart, Melvin Mark, Rodney Hopson, and Christina Christie. However, despite his insistence that his colleagues stay focused on the future of evaluation, you will find that many have recounted their adventures, exchanges, and debates with him over the years, as well as pointed out the many contributions that he has made to the development of evaluation and to the improvement of society through his amazing portfolio of evaluation contributions. The Future of Evaluation in Society: A Tribute to Michael Scriven will be of great interest to evaluation scholars, practitioners, and students of evaluation. It will be appropriate for use in a wide range of evaluation courses including Introduction to Evaluation, Evaluation Theory, and Evaluation Practice courses.

Are you a grant maker, manager or evaluator who must assess your work to improve as well as be accountable for the use of resources and results? Does the project, program or organization you fund, manage or evaluate contend with substantial uncertainty about what to do and what will be the results? Do you thus experience constant change and unexpected and unforeseeable actors and factors in your intervention? Do you need to know what you are achieving and how in real time? And therefore, do you seek an alternative to conventional monitoring and evaluation of social change results? If yes, then you are the audience for this book. Beginning in 2002, working closely with co-evaluators and commissioners of evaluations, the author developed Outcome Harvesting to enable evaluators, grant makers, and managers to identify, formulate, verify, and make sense of changes that interventions have influenced in a broad range of cutting–edge innovation and development projects and programs around the world. Over these years, he led Outcome Harvesting evaluative exercises involving almost 500 non-governmental organizations, networks, government agencies, funding agencies, community-based organizations, research institutes and university programs. In over fifty evaluations, with forty co-evaluators he has harvested thousands of outcomes on six continents. Outcome Harvesting has proven useful in evaluations of a great diversity of initiatives: human rights advocacy, political, economic and environmental advocacy, arts and culture, health systems, information and communication technology, conflict and peace, water and sanitation, taxonomy for development, violence against women, rural development, organic agriculture, participatory democracy, waste management, public sector reform, good governance, eLearning, social accountability, and business competition, amongst others. In this book, the author explains the steps of Outcome Harvesting and how to customize them according to the nine underlying principles. He shares his experience and gives practical advice on how to work with Outcome Harvesting and remain true to its essential features.

Racial, ethnic, linguistic, and cultural diversity has become of global importance in places where many never would have imagined. Increasing diversity in the U.S., Europe, Africa, New Zealand, and Asia strongly suggests that a homogeneity-based focus is rapidly becoming an historical artifact. Therefore, culturally responsive evaluation (CRE) should no longer be viewed as a luxury or an option in our work as evaluators. The continued amplification of racial, ethnic, linguistic, and cultural diversity and awareness among the populations of the U.S. and other western nations insists that social science researchers and evaluators inextricably engage culturally responsive approaches in their work. It is unacceptable for most mainstream university evaluation programs, philanthropic agencies, training institutes sponsored by federal agencies, professional associations, and other entities to promote professional evaluation practices that do not attend to CRE. Our global demographics are a reality that can be appropriately described and studied within the context of complexity theory and theory of change (e.g., Stewart, 1991; Battram, 1999). And this perspective requires a distinct shift from “simple” linear cause-effect models and reductionist thinking to include more holistic and culturally responsive approaches. The development of policy that is meaningfully responsive to the needs of traditionally disenfranchised stakeholders and that also optimizes the use of limited resources (human, natural, and financial) is an extremely complex process. Fortunately, we are presently witnessing developments in methods, instruments, and statistical techniques that are mixed methods in their paradigm/designs and likely to be more effective in informing policymaking and decision-making. Culturally responsive evaluation is one such phenomenon that positions itself to be relevant in the context of dynamic international and national settings where policy and program decisions take place. One example of a response to address this dynamic and need is the newly established Center for Culturally Responsive Evaluation and Assessment (CREA) in the College of Education at the University of Illinois at Urbana-Champaign. CREA is an outgrowth of the collective work and commitments of a global community of scholars and practitioners who have contributed chapters to this edited volume. It is an international and interdisciplinary evaluation center that is grounded in the need for designing and conducting evaluations and assessments that embody cognitive, cultural, and interdisciplinary diversity so as to be actively responsive to culturally diverse communities and their aspirations. The Center’s purpose is to address questions, issues, theories, and practices related to CRE and culturally responsive educational assessment. Therefore, CREA can serve as a vehicle for our continuing discourse on culture and cultural context in evaluation and also as a point of dissemination for not only the work that is included in this edited volume, but for the subsequent work it will encourage.