Context A Framework For Its Influence On Evaluation Practice

Context is a force in evaluation. It shapes our practice, influencing how we approach and design our studies, how we carry them out, and how we report our findings. Context also moderates and mediates the outcomes of the programs and policies we evaluate. This issue focuses squarely on the role that context plays in practice and illuminates its effect on the implementation and outcomes of programs. Exploring the ways in which attending to context may improve the quality of evaluation practice, the contributions span theory, methods, and practice in an effort to move to a more comprehensive conceptualization of context that can guide our work. It: Provides an historical and theoretical view of evaluators’ treatment of context Illustrates how context has influenced evaluation practice Presents a five-area framework for guiding a contextual analysis of evaluations Introduces “context assessment,” which provides a means of integrating context and its implications within the important stages of evaluation. This is the 135th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

Context is a force in evaluation. It shapes our practice, influencing how we approach and design our studies, how we carry them out, and how we report our findings. Context also moderates and mediates the outcomes of the programs and policies we evaluate. This issue focuses squarely on the role that context plays in practice and illuminates its effect on the implementation and outcomes of programs. Exploring the ways in which attending to context may improve the quality of evaluation practice, the contributions span theory, methods, and practice in an effort to move to a more comprehensive conceptualization of context that can guide our work. It: Provides an historical and theoretical view of evaluators’ treatment of context Illustrates how context has influenced evaluation practice Presents a five-area framework for guiding a contextual analysis of evaluations Introduces “context assessment,” which provides a means of integrating context and its implications within the important stages of evaluation. This is the 135th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

This issue broaden the field’s understanding of Research on Evaluation (RoE) in practice, with a focus on empirical RoE. Considering the full collection of RoE studies, it defines RoE as systematic empirical inquiry resulting in original findings or in reexaminations of existing data about the practice, methods, or profession of program evaluation. RoE inquiries address: the inputs into evaluations, the contexts within which evaluations are conducted, the full range of methods and activities of evaluations, evaluation’s proximal or distal effects, or the professional issues that evaluators encounter. The inquiries include case studies, reflective narratives, studies about evaluation methods, literature reviews, oral histories, bibliometric studies, meta-evaluations, experiments, longitudinal studies, simulations, and time-series studies. This is the 148th issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication of the American Evaluation Association.

Evaluation Practice bridges the apparent gap between practice and research to present a logical, systematic model to guide all professional thinking and action within the context of everyday professional life. Their framework embraces diverse theories, action, and sets of evidence from a range of professional and disciplinary perspectives.

This volume brings together educational effectiveness research and international large-scale assessments, demonstrating how the two fields can be applied to inspire and improve each other, and providing readers direct links to instruments that cover a broad range of topics and have been shown to work in more than 70 countries. The book’s initial chapters introduce and summarize recent discussions and developments in the conceptualization, implementation, and evaluation of international large-scale context assessments and provide an outlook on possible future developments. Subsequently, three thematic sections – “Student Background”, “Outcomes of Education Beyond Achievement”, and “Learning in Schools” – each present a series of chapters that provide the conceptual background for a wide range of important topics in education research, policy, and practice. Each chapter defines a conceptual framework that relates recent findings in the educational effectiveness research literature to current issues in education policy and practice. These frameworks were used to develop interesting and relevant indicators that may be used for meaningful reporting from international assessments, other cross-cultural research, or national studies. Using the example of one particular survey (the Programme for International Student Assessment (PISA 2015)), this volume links all theoretical considerations to fully developed questionnaire material that was field trailed and evaluated in questionnaires for students and their parents as well as teachers and principals in their schools. The primary purposes of this book are to inform readers about how education effectiveness research and international large-scale assessments are already interacting to inform research and policymaking; to identify areas where a closer collaboration of both fields or input from other areas could further improve this work; to provide sound theoretical frameworks for future work in both fields; and finally to relate these theoretical debates to currently available and evaluated material for future context assessments.

An innovative approach to program evaluation that takes readers behind the scenes of real evaluations and the decisions the evaluators made.

Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable “who’s who” in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.

Drawing on more than 40 years of experience conducting applied social science research and program evaluation, author Michael Quinn Patton has crafted the most comprehensive and systematic book on qualitative research and evaluation methods, inquiry frameworks, and analysis options available today. Now offering more balance between applied research and evaluation, this Fourth Edition of Qualitative Research & Evaluation Methods illuminates all aspects of qualitative inquiry through new examples, stories, and cartoons; more than a hundred new summarizing and synthesizing exhibits; and a wide range of new highlight sections/sidebars that elaborate on important and emergent issues. For the first time, full case studies are included to illustrate extended research and evaluation examples. In addition, each chapter features an extended "rumination," written in a voice and style more emphatic and engaging than traditional textbook style, about a core issue of persistent debate and controversy.