Curricular Program Implementation In The Context Of Randomized Field Trials

Abstract curricular program implementation in the context of randomized field trials Gloria Isabel Miller This study examined three cases of commercially available curricular program implementations to determine if a unified approach to measuring the level of implementation was possible (proof of concept). Further, the study investigated whether the level of curriculum and implementation plan specificity made a difference to the strength of implementation achieved in classrooms; and described the implementation evolution in different contexts. The study sample consists of a total of 163 teachers in eight school districts across the United States. In each case teachers were randomly assigned to using the curricular innovation or their currently used materials and processes. The three cases, HS-Math, NewScience, and MathIntervention, were purposely chosen to represent three different points of curricular and implementation specificity and two different subject areas, math and science. Each case features a commercially available program that also had opportunities for teachers to use "electronic" technology to enhance their learning or to engage their students. The cases represent differing student grade levels. The cases are different enough to provide a range that exercises the measurement techniques introduced in this study so results can begin to generalize across curricular programs and grades. However, the cases are similar enough in research design, instrumentation, and data collection methods to make them comparable. A key contribution of this investigation is the creation of a framework to measure the level of implementation (the extent to which the teacher and students display the actions, behaviors, and interactions expected by using the innovation). The unified conceptual framework arrived at by using an Activity Theory perspective together with the analytical methods employed provide a way to view the rich complex interaction of implementation as a system with the larger system of the school organization. Data from the analysis revealed that variations in the level of implementation were no different regardless of the level of specificity. A strong finding of this work is that implementation evolves slowly even when the curricular program is scripted and coaching support is provided to teachers. The paper concludes with implications for policy and future research.

Abstract curricular program implementation in the context of randomized field trials Gloria Isabel Miller This study examined three cases of commercially available curricular program implementations to determine if a unified approach to measuring the level of implementation was possible (proof of concept). Further, the study investigated whether the level of curriculum and implementation plan specificity made a difference to the strength of implementation achieved in classrooms; and described the implementation evolution in different contexts. The study sample consists of a total of 163 teachers in eight school districts across the United States. In each case teachers were randomly assigned to using the curricular innovation or their currently used materials and processes. The three cases, HS-Math, NewScience, and MathIntervention, were purposely chosen to represent three different points of curricular and implementation specificity and two different subject areas, math and science. Each case features a commercially available program that also had opportunities for teachers to use "electronic" technology to enhance their learning or to engage their students. The cases represent differing student grade levels. The cases are different enough to provide a range that exercises the measurement techniques introduced in this study so results can begin to generalize across curricular programs and grades. However, the cases are similar enough in research design, instrumentation, and data collection methods to make them comparable. A key contribution of this investigation is the creation of a framework to measure the level of implementation (the extent to which the teacher and students display the actions, behaviors, and interactions expected by using the innovation). The unified conceptual framework arrived at by using an Activity Theory perspective together with the analytical methods employed provide a way to view the rich complex interaction of implementation as a system with the larger system of the school organization. Data from the analysis revealed that variations in the level of implementation were no different regardless of the level of specificity. A strong finding of this work is that implementation evolves slowly even when the curricular program is scripted and coaching support is provided to teachers. The paper concludes with implications for policy and future research.

The central idea of evidence-based education-that education policy and practice ought to be fashioned based on what is known from rigorous research-offers a compelling way to approach reform efforts. Recent federal trends reflect a growing enthusiasm for such change. Most visibly, the 2002 No Child Left Behind Act requires that "scientifically based [education] research" drive the use of federal education funds at the state and local levels. This emphasis is also reflected in a number of government and nongovernment initiatives across the country. As consensus builds around the goals of evidence-based education, consideration of what it will take to make it a reality becomes the crucial next step. In this context, the Center for Education of the National Research Council (NRC) has undertaken a series of activities to address issues related to the quality of scientific education research. In 2002, the NRC released Scientific Research in Education (National Research Council, 2002), a report designed to articulate the nature of scientific education research and to guide efforts aimed at improving its quality. Building on this work, the Committee on Research in Education was convened to advance an improved understanding of a scientific approach to addressing education problems; to engage the field of education research in action-oriented dialogue about how to further the accumulation of scientific knowledge; and to coordinate, support, and promote cross-fertilization among NRC efforts in education research. The main locus of activity undertaken to meet these objectives was a year-long series of workshops. This report is a summary of the third workshop in the series, on the implementation and implications of randomized field trials in education.

The central idea of evidence-based education-that education policy and practice ought to be fashioned based on what is known from rigorous research-offers a compelling way to approach reform efforts. Recent federal trends reflect a growing enthusiasm for such change. Most visibly, the 2002 No Child Left Behind Act requires that "scientifically based [education] research" drive the use of federal education funds at the state and local levels. This emphasis is also reflected in a number of government and nongovernment initiatives across the country. As consensus builds around the goals of evidence-based education, consideration of what it will take to make it a reality becomes the crucial next step. In this context, the Center for Education of the National Research Council (NRC) has undertaken a series of activities to address issues related to the quality of scientific education research. In 2002, the NRC released Scientific Research in Education (National Research Council, 2002), a report designed to articulate the nature of scientific education research and to guide efforts aimed at improving its quality. Building on this work, the Committee on Research in Education was convened to advance an improved understanding of a scientific approach to addressing education problems; to engage the field of education research in action-oriented dialogue about how to further the accumulation of scientific knowledge; and to coordinate, support, and promote cross-fertilization among NRC efforts in education research. The main locus of activity undertaken to meet these objectives was a year-long series of workshops. This report is a summary of the third workshop in the series, on the implementation and implications of randomized field trials in education.

Randomized controlled trials (RCTs) are considered by many researchers and providers to be the gold standard of health and social service effectiveness research. However, there exist scant resources that deal with the complex nature of designing and implementing RCTs in community-based settings. This clearly written pocket guide provides researchers and social service practitioners insight into each step of an RCT. The goal of this text is to enable readers to understand, design, and implement a community-based RCT. From the initial stage of planning the RCT and developing its conceptual foundations through implementation, the authors provide a wealth of detail and case studies from social work practice research that assist readers to comprehend the detailed information provided. Accessible, concrete advice is woven throughout the text and tackles the many design and implementation challenges that arise in community practice settings. The importance of utilizing a mix of qualitative and quantitative methods is encouraged due to the intricate nature of RCT research in community-based environments. Through utilizing practical case examples, this pocket guide reviews the essentials of RCTs in a manner that will appeal to researchers, practitioners and students alike who are seeking the necessary tools to build the empirical knowledge base for community-based psychosocial interventions for social work.

This volume focuses on context considerations in family-school partnership research. The book examines how cultural diversity, including differences in parenting (e.g., race, education, family history) and diverse school variables (e.g., location, population, organization,) can affect family-school partnerships. Its bio ecological perspective pinpoints critical areas that studies need to address for real-world utility, such as parental commitment and developmental considerations. Although the book’s focus is research, chapters present program designs and evaluations along with ideas for community involvement and policy. The authors also explore the changing landscape for home-school partnerships resulting from the impact of technology, which is rapidly becoming a central player in organizing research and bringing interventions to life. Topics covered include: Complexities in field-based partnership research. Family-centered, school-based interventions. A district leadership approach to school, family and community partnerships. Research issues to forward a policy agenda supporting family-school partnerships. Testing statistical moderation in research on home-school partnerships. Integrating current and evolving knowledge toward future directions for research. Contexts of Family-School Partnerships is a valuable resource for researchers, professionals and graduate students in child and school psychology, educational policy and politics, family studies, developmental psychology, sociology of education, sociology and anthropology.

Edited by four leading violence researchers, this book takes a systemic view, offering a critical appraisal of research and theory that focuses on violence in youth, families, and communities.