Meeting The Challenges To Measurement In An Era Of Accountability

Under pressure and support from the federal government, states have increasingly turned to indicators based on student test scores to evaluate teachers and schools, as well as students themselves. The focus thus far has been on test scores in those subject areas where there is a sequence of consecutive tests, such as in mathematics or English/language arts with a focus on grades 4-8. Teachers in these subject areas, however, constitute less than thirty percent of the teacher workforce in a district. Comparatively little has been written about the measurement of achievement in the other grades and subjects. This volume seeks to remedy this imbalance by focusing on the assessment of student achievement in a broad range of grade levels and subject areas, with particular attention to their use in the evaluation of teachers and schools in all. It addresses traditional end-of-course tests, as well as alternative measures such as portfolios, exhibitions, and student learning objectives. In each case, issues related to design and development, psychometric considerations, and validity challenges are covered from both a generic and a content-specific perspective. The NCME Applications of Educational Measurement and Assessment series includes edited volumes designed to inform research-based applications of educational measurement and assessment. Edited by leading experts, these books are comprehensive and practical resources on the latest developments in the field. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license

Under pressure and support from the federal government, states have increasingly turned to indicators based on student test scores to evaluate teachers and schools, as well as students themselves. The focus thus far has been on test scores in those subject areas where there is a sequence of consecutive tests, such as in mathematics or English/language arts with a focus on grades 4-8. Teachers in these subject areas, however, constitute less than thirty percent of the teacher workforce in a district. Comparatively little has been written about the measurement of achievement in the other grades and subjects. This volume seeks to remedy this imbalance by focusing on the assessment of student achievement in a broad range of grade levels and subject areas, with particular attention to their use in the evaluation of teachers and schools in all. It addresses traditional end-of-course tests, as well as alternative measures such as portfolios, exhibitions, and student learning objectives. In each case, issues related to design and development, psychometric considerations, and validity challenges are covered from both a generic and a content-specific perspective. The NCME Applications of Educational Measurement and Assessment series includes edited volumes designed to inform research-based applications of educational measurement and assessment. Edited by leading experts, these books are comprehensive and practical resources on the latest developments in the field. The NCME series editorial board is comprised of Michael J. Kolen, Chair; Robert L. Brennan; Wayne Camara; Edward H. Haertel; Suzanne Lane; and Rebecca Zwick.

In the music classroom, instructors who hope to receive aid are required to provide data on their classroom programs. Due to the lack of reliable, valid large-scale assessments of student achievement in music, however, music educators in schools that accept funds face a considerable challenge in finding a way to measure student learning in their classrooms. From Australia to Taiwan to the Netherlands, music teachers experience similar struggles in the quest for a definitive assessment resource that can be used by both music educators and researchers. In this two-volume Handbook, contributors from across the globe come together to provide an authority on the assessment, measurement, and evaluation of student learning in music. The Handbook's first volume emphasizes international and theoretical perspectives on music education assessment in the major world regions. This volume also looks at technical aspects of measurement in music, and outlines situations where theoretical foundations can be applied to the development of tests in music. The Handbook's second volume offers a series of practical and US-focused approaches to music education assessment. Chapters address assessment in different types of US classrooms; how to assess specific skills or requirements; and how assessment can be used in tertiary and music teacher education classrooms. Together, both volumes of The Oxford Handbook of Assessment in Music Education pave the way forward for music educators and researchers in the field.

This book provides a significant contribution to conversations about teacher quality and graduate readiness for teaching. It presents empirical insights into how a multidisciplinary team of researchers, teacher educators, and policy personnel mobilized for collective change in a standards-driven reform initiative. The insights are research-informed and critically relevant for anyone interested in teacher preparation and credentialing. It gives an account of a bold move to install a collaborative culture of evidence-informed inquiry to professionalize teacher education. The centerpiece of the book is the use of standards and evidence to show the quality of graduates entering the teaching workforce. The book presents, for the first time, a model of online cross-institutional moderation as benchmarking to generate large-scale evidence of the quality of teacher education. The book also introduces a new conceptualization of a feedback loop using summative data for accountability and formative data to inform curriculum review and program renewal. This book offers the insider story of the conceptualization, design, and implementation of the Graduate Teacher Performance Assessment (GTPA). It involves going to scale with a large group of Australian universities, government agencies, and schools, and using participatory approaches to advance new thinking about evidence-informed inquiry, cross-institutional moderation, and innovative digital infrastructure. The discussion of competence assessment, standards, and change processes presented in the book has relevance beyond teacher education to other professions.

In the music classroom, instructors who hope to receive aid are required to provide data on their classroom programs. Due to the lack of reliable, valid large-scale assessments of student achievement in music, however, music educators in schools that accept funds face a considerable challenge in finding a way to measure student learning in their classrooms. From Australia to Taiwan to the Netherlands, music teachers experience similar struggles in the quest for a definitive assessment resource that can be used by both music educators and researchers. In this two-volume Handbook, contributors from across the globe come together to provide an authority on the assessment, measurement, and evaluation of student learning in music. The Handbook's first volume emphasizes international and theoretical perspectives on music education assessment in the major world regions. This volume also looks at technical aspects of measurement in music, and outlines situations where theoretical foundations can be applied to the development of tests in music. The Handbook's second volume offers a series of practical and US-focused approaches to music education assessment. Chapters address assessment in different types of US classrooms; how to assess specific skills or requirements; and how assessment can be used in tertiary and music teacher education classrooms. Together, both volumes of The Oxford Handbook of Assessment in Music Education pave the way forward for music educators and researchers in the field.

The second edition of the Handbook of Test Development provides graduate students and professionals with an up-to-date, research-oriented guide to the latest developments in the field. Including thirty-two chapters by well-known scholars and practitioners, it is divided into five sections, covering the foundations of test development, content definition, item development, test design and form assembly, and the processes of test administration, documentation, and evaluation. Keenly aware of developments in the field since the publication of the first edition, including changes in technology, the evolution of psychometric theory, and the increased demands for effective tests via educational policy, the editors of this edition include new chapters on assessing noncognitive skills, measuring growth and learning progressions, automated item generation and test assembly, and computerized scoring of constructed responses. The volume also includes expanded coverage of performance testing, validity, fairness, and numerous other topics. Edited by Suzanne Lane, Mark R. Raymond, and Thomas M. Haladyna, The Handbook of Test Development, 2nd edition, is based on the revised Standards for Educational and Psychological Testing, and is appropriate for graduate courses and seminars that deal with test development and usage, professional testing services and credentialing agencies, state and local boards of education, and academic libraries serving these groups.

Understanding Instructionally Useful Assessment offers new insights into how various types of assessments, from the state to the classroom, will differ in their usefulness for supporting instructional decision-making and student learning. In order to most effectively serve students, it is essential that educators avoid conflating the assessment information that teachers use for instructional purposes and the data that leaders and administrators use for evaluative or monitoring purposes. This book provides classroom teachers as well as school and district leaders with a clear conception of what makes assessments—their purpose, design, reporting, and resulting information—useful or not for informing instruction and how they can select assessment tools suited to specific purposes. Each chapter addresses the knowledge and skills that K-12 staff need in order to challenge claims made by policymakers, test vendors, or even other educators that any assessment can be used to inform instruction. Educators will come away better prepared to remove unnecessary or redundant assessments from their systems and to create structures, policies, and processes that best support the instructional usefulness of assessments for student learning.

Meeting the Challenges of Data Quality Management outlines the foundational concepts of data quality management and its challenges. The book enables data management professionals to help their organizations get more value from data by addressing the five challenges of data quality management: the meaning challenge (recognizing how data represents reality), the process/quality challenge (creating high-quality data by design), the people challenge (building data literacy), the technical challenge (enabling organizational data to be accessed and used, as well as protected), and the accountability challenge (ensuring organizational leadership treats data as an asset). Organizations that fail to meet these challenges get less value from their data than organizations that address them directly. The book describes core data quality management capabilities and introduces new and experienced DQ practitioners to practical techniques for getting value from activities such as data profiling, DQ monitoring and DQ reporting. It extends these ideas to the management of data quality within big data environments. This book will appeal to data quality and data management professionals, especially those involved with data governance, across a wide range of industries, as well as academic and government organizations. Readership extends to people higher up the organizational ladder (chief data officers, data strategists, analytics leaders) and in different parts of the organization (finance professionals, operations managers, IT leaders) who want to leverage their data and their organizational capabilities (people, processes, technology) to drive value and gain competitive advantage. This will be a key reference for graduate students in computer science programs which normally have a limited focus on the data itself and where data quality management is an often-overlooked aspect of data management courses. Describes the importance of high-quality data to organizations wanting to leverage their data and, more generally, to people living in today’s digitally interconnected world Explores the five challenges in relation to organizational data, including "Big Data," and proposes approaches to meeting them Clarifies how to apply the core capabilities required for an effective data quality management program (data standards definition, data quality assessment, monitoring and reporting, issue management, and improvement) as both stand-alone processes and as integral components of projects and operations Provides Data Quality practitioners with ways to communicate consistently with stakeholders