Improvement Science In Evaluation Methods And Uses

While improvement science has experienced a surge of interest over the past 30 years, applications of it are rare in the evaluation literature. This issue promotes the cross-fertilization of ideas, techniques, and tools between evaluation and improvement science. There are at least four areas where this cross-fertilization is particularly relevant: learning from error, examining variation, appreciating context, and focusing on systems change. This volume considers: the conceptual similarities and distinctions between improvement science and evaluation; the intellectual foundations, methods, and tools that collectively comprise improvement science; and case chapters that offer an inspiring review of state-of-the-art improvement science applications. Cutting across all of these applications is a shared grounding in systems thinking, a determination to capture and better understand variation and contextual complexity, as well as a sustained commitment to generative learning about projects and programs—all issues of great concern to evaluators. The issue offers producers and users of evaluations the potential benefits of a closer engagement with improvement science. This is the 153rd issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication ofthe American Evaluation Association.

While improvement science has experienced a surge of interest over the past 30 years, applications of it are rare in the evaluation literature. This issue promotes the cross-fertilization of ideas, techniques, and tools between evaluation and improvement science. There are at least four areas where this cross-fertilization is particularly relevant: learning from error, examining variation, appreciating context, and focusing on systems change. This volume considers: the conceptual similarities and distinctions between improvement science and evaluation; the intellectual foundations, methods, and tools that collectively comprise improvement science; and case chapters that offer an inspiring review of state-of-the-art improvement science applications. Cutting across all of these applications is a shared grounding in systems thinking, a determination to capture and better understand variation and contextual complexity, as well as a sustained commitment to generative learning about projects and programs—all issues of great concern to evaluators. The issue offers producers and users of evaluations the potential benefits of a closer engagement with improvement science. This is the 153rd issue in the New Directions for Evaluation series from Jossey-Bass. It is an official publication ofthe American Evaluation Association.

Evaluators who are interested in developing or improving a program or policy frequently look to formative evaluation as a guiding framework. This book shows why those hoping to use evaluation to drive change in complex systems, rather than develop or improve one program, policy, or product, need to shift from the oversimplified idea of formative evaluation to a more specified continuous improvement model grounded in improvement science. In doing so, author Kristen L. Rohanna provides guidance to both evaluators and others, such as K-12 educators or hospital administrators, who lead improvement initiatives in their organizations and seek to solve persistent problems of practice. The book includes an extended case study: a networked improvement community of five public middle and high schools.

Improvement Science: Methods for Researchers and Program Evaluators moves beyond traditional research methods textbooks by responding to people working in improvement science and program evaluation. This book is tailored to the need for specific improvement research methodologies and frameworks collected and presented in an edited volume written by research faculty associated with or teaching in leadership programs.

Practical Mapping for Applied Research and Program Evaluation is the first book to bring the mapping methodology to social research and program evaluation. Bernadette Wright and Steven E. Wallis guide readers through all phases of the research process: learning from stakeholder experience; reviewing existing knowledge in the field; conducting new data collection such as interviews; collaborating with other researchers; and facilitating the use of knowledge for communication, collaboration, and action. With plenty of illustrations and navigational aids such as “travel tips,” the book is an accessible guide for busy students, researchers, and managers of all levels of experience.

While several texts provide pedagogical and theoretical insights on improvement science for faculty, graduate students, and educational leaders, practitioners’ voices are seldom heard. Improvement Science in the Field: Cases of Practitioners Leading Change in Schools fills this gap by presenting real-life cases of K-12 practitioners’ use of improvement science to lead change in their educational systems. Improvement Science in the Field: Cases of Practitioners Leading Change in Schools contains two sections. Part I presents practitioners’ accounts of their use of improvement science to address actual problems of practice, such as closing discipline and achievement gaps, managing teacher stress and mental health, and improving school climate. Part II follows a tradition of case-based teaching in which authors provide part of their improvement journey and then invite readers to practice, discuss, brainstorm, and reflect on how they would address the problem presented using the tools of improvement science.

With increasing diversity and widening disparities in the United States and globally there are significant challenges and opportunities throughout the educational landscape. Today’s educational stakeholders, particulary public school administrators and teachers, must re- envision education and collectively build equity-centered systems, structures, and practices. Confronting systemic inequality in education can be a daunting task, but it is nonetheless imperative. Connecting theory to practice, this book aims to promote inclusive educational excellence, and will offer valuable insights and inspiration to a wide range of educational stakeholders. Affirming diversity and advancing social justice requires dismantling oppressive customs and structures inside and outside of the classroom, fostering an equitable school culture, building inclusive learning environments, and increasing collective efficacy though best practice. Creating healthier schools and communities requires authentically investing in and supporting historically and socially marginalized students and families. Rooted in social justice and weaving together diverse voices from the field of education, this edited volume will examine equity-focused pre-K–12 pedagogical practices and showcase high-impact initiatives. Educators play a vital role in ensuring positive student outcomes and success, but often report feeling inadequately prepared for current challenges. Unfortunately, growing challenges are contributing to turnover rates and shortages as well as perpetuating social inequities among pre-K–12 students instead of dismantling them. A research study by the National Association of Secondary School Principals (NASSP) and the Learning Policy Institute (LPI) reveals that public schools with higher percentages of low-income students and students of color are more likely to experience administrative and teacher turnover, which compounds equity issues affecting already vulnerable students. This edited volume will provide educational stakeholders (i.e., school administrators, teachers, service providers, parents/guardians, nonprofit leaders, community members) with a deeper understanding of pedagogical practices that affirm diversity and promote social justice, while offering a current view of educational inequalities juxtaposed with an urgent call to action. School districts across the United States must recognize inequalities and provide increasingly diverse students with needed support and resources, particularly as social dispairties continue to widen and adversely impact millions of students. Through a collection of diverse voices from the field of education (university educators; pre-K–12 district leaders, schools administrators and teachers; Nonprofit leaders serving children and youth) this book will illuminate current social inequalities impacting pre-K–16 students, establish the need to affirm diversity and advance social justice, share practical examples of transformative initiatives including mindful school-family- community partnerships, feature evidence-based pedagogical practices, and provide an array of helpful resources for 21st century educational stakeholders.

With collaboration of Dr. Steve Krau, Consulting Editor, Drs. Leming-Lee and Watters have created an issue that provides state-of-the-art content on quality improvement. Top authors have contributed clinical reviews on the following topics: Quality improvement: Application of evidence-based practice; The application of the Virginia Mason production system to improve large scale quality outcomes in an acute care hospital; The application of the Toyota production system Lean 5S methodology in the operating room setting; Chart it to stop it: A quality improvement project to increase the reporting of workplace aggression; Reducing pressure injuries in the pediatric intensive care unit; Improving stress-induced hyperglycemic management in the ICU setting; Evaluation of telemetry utilization on medical-surgical floors; Implementation of a nurse-driven CAUTI prevention protocol; A quality improvement project to test the effectiveness of a patient-centered pathway and discharge tool on heart failure patient engagement; Diabetes self-management education provision by an interprofessional collaborative team: A quality improvement project; Increasing effective patient-triage nurse communication using a targeted history question; and Barriers to the implementation of pediatric overweight and obesity guidelines in a school-based health center. Nurses will come away with the current information they need to improve patient outcomes.