Invariant Measurement With Raters And Rating Scales

The purpose of this book is to present methods for developing, evaluating and maintaining rater-mediated assessment systems. Rater-mediated assessments involve ratings that are assigned by raters to persons responding to constructed-response items (e.g., written essays and teacher portfolios) and other types of performance assessments. This book addresses the following topics: (1) introduction to the principles of invariant measurement, (2) application of the principles of invariant measurement to rater-mediated assessments, (3) description of the lens model for rater judgments, (4) integration of principles of invariant measurement with the lens model of cognitive processes of raters, (5) illustration of substantive and psychometric issues related to rater-mediated assessments in terms of validity, reliability, and fairness, and (6) discussion of theoretical and practical issues related to rater-mediated assessment systems. Invariant measurement is fast becoming the dominant paradigm for assessment systems around the world, and this book provides an invaluable resource for graduate students, measurement practitioners, substantive theorists in the human sciences, and other individuals interested in invariant measurement when judgments are obtained with rating scales.

This introductory text describes the principles of invariant measurement, how invariant measurement can be achieved with Rasch models, and how to use invariant measurement to solve measurement problems in the social, behavioral, and health sciences. Rasch models are used throughout but a comparison of Rasch models to other item response theory (IRT) models is also provided. Written with students in mind, the manuscript was class tested to help maximize accessibility. Chapters open with an introduction and close with a summary and discussion. Numerous examples and exercises demonstrate the main issues addressed in each chapter. Key terms are defined when first introduced and in an end-of-text glossary. All of the book’s analyses were conducted with the Facets program. The data sets used in the book, sample syntax files for running the Facets program, Excel files for creating item and person response functions, links to related websites, and other material are available at www.GeorgeEngelhard.com. Highlights include: A strong philosophical and methodological approach to measurement in the human sciences Demonstrations of how measurement problems can be addressed using invariant measurement Practical illustrations of how to create and evaluate scales using invariant measurement A history of measurement based on test-score and scaling traditions Previously unpublished work in analyzing rating data, the detection and measurement of rater errors, and the evaluation of rater accuracy A review of estimation methods, model-data fit, indices used to evaluate the quality of rater-mediated assessments, rater error and bias, and rater accuracy. Intended as a supplementary text for graduate or advanced undergraduate courses on measurement or test theory, item response theory, scaling theory, psychometrics, advanced measurement techniques, research methods, or evaluation research taught in education, psychology, and the social and health sciences, the book also appeals to practitioners and researchers in these fields who develop or use scales and instruments. Only a basic mathematical level is required including a basic course in statistic.

This book introduces current perspectives on Rasch measurement theory with an emphasis on developing Rasch-based scales. Rasch measurement theory represents a paradigm shift in measurement theory away from classical test theory and creates a framework for scaling that can yield invariant measurement. Rasch Models for Solving Measurement Problems: Invariant Measurement in the Social Sciences is a broadly accessible text. Authors George Engelhard Jr and Jue Wang introduce Rasch measurement theory step by step, with chapters on scale construction, evaluation, maintenance, and use. Points are illustrated and techniques are demonstrated through an extended example: The Food Insecurity Experience (FIE) Scale. The Rasch analyses in the book are run using the Facets computer program. Facets syntax, and R code for the ERMA program created by the authors to obtain parameter estimates and to examine model-data fit, together with sample data sets are all available on a website for the book.

This book collects and organizes the original studies presented at PROMS 2015 conference on theories and applications of Rasch model. It provides useful examples of the Rasch model used to address practical measurement problems across a range of different disciplines including Item Response Theory (IRT), philosophy of measurement, dimensionality, the role of fit statistics and residuals, application, educational application, language testing, health-related research, business and industrial application and Rasch-based computer software. PROMS 2015 (Pacific Rim Objective Measurement Symposium) was held from August 20-24th 2015, in Fukuoka, Japan. The goal of this conference is to bring together the researchers from academia, universities, hospitals, industry, management sector as well as practitioners to share ideas, problems and solutions relating to the multifaceted aspects of Rasch Model.

This book introduces current perspectives on Rasch measurement theory with an emphasis on developing Rasch-based scales. Rasch measurement theory represents a paradigm shift in measurement theory away from classical test theory and creates a framework for scaling that can yield invariant measurement. Rasch Models for Solving Measurement Problems: Invariant Measurement in the Social Sciences is a broadly accessible text. Authors George Engelhard Jr and Jue Wang introduce Rasch measurement theory step by step, with chapters on scale construction, evaluation, maintenance, and use. Points are illustrated and techniques are demonstrated through an extended example: The Food Insecurity Experience (FIE) Scale. The Rasch analyses in the book are run using the Facets computer program. Facets syntax, and R code for the ERMA program created by the authors to obtain parameter estimates and to examine model-data fit, together with sample data sets are all available on a website for the book.

Items with ordered response categories are common in survey research, such as when respondents are asked how much they agree with certain statements. But how large are the differences between categories of response, and how well do they distinguish between respondents? This volume is the first to introduce the evaluation of rating scales to an audience of survey researchers. Evaluating Rating Scale Functioning for Survey Research provides researchers with an overview of rating scale analysis along with practical guidance on how to conduct such analyses with their own survey data. Author Stefanie A. Wind presents three categories of methods: Rasch models; non-Rasch Item Response Theory (IRT) models; and non-parametric models, together with practical examples. Tutorials, datasets, and software code (R and Facets) to accompany the book are available on the book’s website.

Quantitative Data Analysis for Language Assessment Volume I: Fundamental Techniques is a resource book that presents the most fundamental techniques of quantitative data analysis in the field of language assessment. Each chapter provides an accessible explanation of the selected technique, a review of language assessment studies that have used the technique, and finally, an example of an authentic study that uses the technique. Readers also get a taste of how to apply each technique through the help of supplementary online resources that include sample data sets and guided instructions. Language assessment students, test designers, and researchers should find this a unique reference as it consolidates theory and application of quantitative data analysis in language assessment.

This book gathers papers presented at the 8th International Conference on Movement, Health and Exercise (MoHE 2022) with the conference theme "Enhancing Health and Sports Performance by Design". The topics covered include exercise science; human performance; physical activity and health; sports medicine; sports nutrition; management and sports studies; and sports engineering and technology. Its content is of interest to sports scientists, researchers and practitioners from various sports and exercise sub-disciplines.