Evaluating Educational Programs And Products

Abstract: Prepared as a guide and handbook for planners, developers, and evaluators of educational programs and products, practical insights are given on planning and executing effective evaluations. The evaluator's work is viewed as establishing perspective, planning the evaluation, and analyzing the data. Procedures that are appropriate for each of these activities are identified for the reader. The subject matter in this multiauthored book is divided into roles and contexts, models and strategies, and methods and techniques. Contributors also depict today's standards for evaluation and project what those standards will be in the future.

Including a new section on evaluation accountability, this Third Edition details 30 standards which give advice to those interested in planning, implementing and using program evaluations.

This book is open access under a CC BY-NC 2.5 license.​​ This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.

Educational Technology Program and Project Evaluation is a unique, comprehensive guide to the formative and summative evaluation of programs, projects, products, practices and policies involving educational technology. Written for both beginning and experienced evaluators, the book utilizes an integrative, systems-based approach; its practical emphasis on logic models and theories of change will help readers navigate their own evaluation processes to improve interventions and conduct meaningful educational research. Key features include: evidence-based guidelines for constructing and conducting evaluations practical exercises to support the development of knowledge, skills, and program evaluation portfolios a variety of interdisciplinary case studies references and links to pertinent research and resources Using the TELL, ASK, SHOW, DO model first introduced in this series, Educational Technology Program and Project Evaluation provides comprehensive coverage of the concepts, goals, design, implementation, and critical questions imperative to successful technology-enhanced evaluation.

Learn to define a quality program, analyze what is and is not working, and avoid "test score fatigue" with a user-friendly, three-part framework for school improvement.

Attempting fonnally to evaluate something involves the evaluator coming to grips with a number of abstract concepts such as value, merit, worth, growth, criteria, standards, objectives, needs, nonns, client, audience, validity, reliability, objectivity, practical significance, accountability, improvement, process, pro duct, fonnative, summative, costs, impact, infonnation, credibility, and - of course - with the tenn evaluation itself. To communicate with colleagues and clients, evaluators need to clarify what they mean when they use such tenns to denote important concepts central to their work. Moreover, evaluators need to integrate these concepts and their meanings into a coherent framework that guides all aspects of their work. If evaluation is to lay claim to the mantle of a profession, then these conceptualizations of evaluation must lead to the conduct of defensible evaluations. The conceptualization of evaluation can never be a one-time activity nor can any conceptualization be static. Conceptualizations that guide evaluation work must keep pace with the growth of theory and practice in the field. Further, the design and conduct of any particular study involves a good deal of localized conceptualization.

"The Program Evaluation Standards is a 'must-have' book for anyone responsible for reviewing evaluation proposals, planning and conducting evaluations, managing evaluation projects, or judging the merit and worth of evaluations once completed. For experienced practitioners, it provides a set of values and principles by which to guide successful practice, that is, a set of criteria that determines whether educational evaluations are trustworthy and fair. The Standards sets expectations of the design and implementation of educational evaluation for all practitioners in all types of educational arenas, even those involved in social programming endeavors. For newcomers and those less experienced who may be responsible for commissioning and using evaluations, the Standards supplies a useful framework of generating a list of questions to raise about any evaluation plan or final report in an effort to assess its pros and cons. The book is an invaluable 'how-to' resource for graduate students venturing out into the field, and it instills a sense of what it means to be a responsible evaluator. For clients or consumers, the book offers advice on what they should expect of an evaluation"--Publisher description.

Drawing upon experiences at state and local level project evaluation, and based on current research in the professional literature, Payne presents a practical, systematic, and flexible approach to educational evaluations. Evaluators at all levels -- state, local and classroom -- will find ideas useful in conducting, managing, and using evaluations. Special user targets identified are state department of education personnel and local school system administrative personnel. The volume can be used by those doing evaluation projects `in the field', or as a text for graduate courses at an introductory level. The book begins with an overview of the generic evaluation process. Chapter Two is devoted to the criteria for judging the effectiveness of evaluation practice. Chapter Three addresses the all important topic of evaluation goals and objectives. Chapters Four, Five and Six basically are concerned with the approach, framework, or design of an evaluation study. Chapter Four contains a discussion of four major philosophical frameworks or metaphors and the implications of these frameworks for conducting an evaluation. Chapters Five and Six describe predominantly quantitative and qualitative designs, respectively. Design, implementation and operational issues related to instrumentation (Chapter Seven), management and decision making (Chapter Eight), and reporting and utilization of results (Chapter Nine) are next addressed. The final chapter of the book (Chapter Ten) considers the evaluation of educational products and materials.