Standard Setting

"Standard Setting: A Guide to Establishing and Evaluating Performance Standards on Tests is a well-timed text, given the legislated requirement of performance standards in our K-12 educational system, as well as the continued need in the process of credentialing professionals. This book would be useful to individuals retained to produce or coordinate standard-setting activites." --PSYCCRITIQUESIn Standard Setting: A Guide to Establishing and Evaluating Performance Standards on Tests, authors Gregory J. Cizek and Michael B. Bunch provide the only "go-to" reference on how to set standards on tests in education, licensure, and certification. This book is comprehensive in scope, practical in nature, and definitive in terms of cataloguing the essential conceptual and procedural fundamentals of setting performance standards. Key Features: Offers a detailed description of procedures: In a practical, straightforward, and virtually jargon-free style, this book begins with important foundational and conceptual information about standard setting followed by step-by-step procedures for all currently used methods, including Angoff, Item Mapping, Analystic Judgment, etc. In addition, a full chapter is devoted to future issues and research in standard setting. Enables readers to design, implement, and evaluate a standard setting study: Using this book, readers will be able to: select an appropriate standard setting method; schedule and plan implementation; identify and train qualified standard-setting participants; conduct the standard setting meeting; calculate one or more cut scores; and evaluate the success of the procedure they have implemented. Allows readers to adapt written materials to their situation: Examples are provided in widely available formats such as Excel, SPSS, .pdf and Word files so readers do not have to purchase specialized software or learn to use unfamiliar packages. The book includes downloadable forms, sample correspondence, checklists, data sets, and analytical software for performing calculations required for various standard setting procedures. Intended Audience: This is an excellent supplementary textbook for graduate courses such as Applied Measurement in Education; Psychometric Theory; Advanced Educational Measurement; Special Topics in Measurement and Evaluation; Seminar in Educational and Psychological Measurement in the departments of Educational Psychology, Measurement and Evaluation, Psychology, and others.

This book summarizes the international evidence on methodological issues in standard setting in education. By critically discussing the standard-setting practices implemented in the Nordic countries and by presenting new methodological approaches, it offers fresh perspectives on the current research. Standard setting targets crucial societal objectives by defining educational benchmarks at different achievement levels, and provides feedback to policy makers, schools and teachers about the strengths and weaknesses of a school system. Given that the consequences of standard setting can be dramatic, the quality of standard setting is a prime concern. If it fails, repercussions can be expected in terms of arbitrary evaluations of educational policy, wrong turns in school or teacher development or misplacement of individual students. Standard setting therefore needs to be accurate, reliable, valid, useful, and defensible. However, specific evidence on the benefits and limits of different approaches to standard setting is rare and scattered, and there is a particular lack with respect to standard setting in the Nordic countries, where the number of national tests is increasing and there are concerns about the time and effort spent on testing at schools without feedback being provided. Addressing this gap, the book offers a discussion on standard setting by respected experts as well as profound and innovative insights into fundamental aspects of standard setting including conclusions for future methodological and policy-related research.

This book provides a unifying structure for the activities that fall under the process typically called "standard setting" on tests of proficiency. Standard setting refers to the methodology used to identify performance standards on tests of proficiency. The results from standard setting studies are critical for supporting the use of many types of tests. The process is frequently applied to educational, psychological, licensure/certification, and other types of tests and examination systems. The literature on procedures for standard setting is extensive, but the methodology for standard setting has evolved in a haphazard way over many decades without a unifying theory to support the evaluation of the methods and the validation of inferences made from the standards. This text provides a framework for going beyond specific standard setting methods to gain an understanding of the goals for the methods and how to evaluate whether the goals have been achieved. The unifying structure provided in this text considers policy that calls for the existence of performance standards, the relationship of proficiency test design to the policy, and tasks assigned to subject matter experts to help them convert the policy to estimates of locations on the reporting score scale for the test. Guidance is provided for how to connect the psychometric aspects of the standard setting process to the intentions of policy makers as expressed in policy statements. Further, the structure is used support validity arguments for inferences made when using standards. Examples are provided to show how the unifying structure can be used to evaluate and improve standard setting methodology.

Competition and intellectual property rights (IPRs) are both necessary for a market to work efficiently and to promote consumer welfare. Properly applied, intellectual property rules define a legal framework which allows undertakings to profit from their inventions. This in turn encourages competition among firms and enhances dynamic efficiency, to the benefit of consumer welfare. Standard setting represents one of the fields where the interaction between competition law and IPRs clearly comes to light. The collaborative goal of standard setting organizations (SSOs) is to adopt and promote standards that either do not conflict with anyone’s right or, if they do, are developed under condition that patents are licensed under defined terms. This book examines the tension between IPRs and competition in the standard setting field which can arise when innovators over-exploit the rights they have been granted and hold up an entire industry. The book compares EU and U.S. jurisdictions with a particular focus on the IT and telecommunication sectors. It scrutinizes those practices which could harm standard setting and its goals, looking at misleading conducts by SSOs’ members which may lead to breach the EU and U.S. antitrust provisions on abuse of market power. Recent developments in EU and U.S. standard setting are analysed highlighting the differences in enforcement approaches. The book considers how the optimal balance between IPRs and industry standards can be struck, suggesting a policy model which takes into account both innovators’ interests and SSOs’ goals.

Setting standards of performance is a ubiquitous task in education licensure, certification, and credentialling. It is found in elementary schooling, the professions, commercial applications, and governmental and private organizations. It is one of the most complex, controversial, and vexing issues facing specialists and policy makers today. This second edition solidifies Setting Performance Standards as the only book providing a comprehensive profile of both the issues and the "how-to" methods that define this thorny field. Four chapters have been removed; 11 chapters have been added; 2 chapters have major revisions; and all chapters have been updated. Comprehensive – Part I provides a conceptual overview of standard setting and its overarching issues; Part II provides practical (how-to) information on the newest standard setting methods; Part III provides information and advice on persistent and potential challenges in standard setting. Practical – Part II (the heart of the book) reviews 16 of the newest standard setting methods, far more than any other book. Expertise – Most of the well-known authors from the 1st edition return, with authors of equal stature contributing new chapters.