ABSTRACT
The purpose of this book is to present methods for developing, evaluating and maintaining rater-mediated assessment systems. Rater-mediated assessments involve ratings that are assigned by raters to persons responding to constructed-response items (e.g., written essays and teacher portfolios) and other types of performance assessments.
This book addresses the following topics: (1) introduction to the principles of invariant measurement, (2) application of the principles of invariant measurement to rater-mediated assessments, (3) description of the lens model for rater judgments, (4) integration of principles of invariant measurement with the lens model of cognitive processes of raters, (5) illustration of substantive and psychometric issues related to rater-mediated assessments in terms of validity, reliability, and fairness, and (6) discussion of theoretical and practical issues related to rater-mediated assessment systems.
Invariant measurement is fast becoming the dominant paradigm for assessment systems around the world, and this book provides an invaluable resource for graduate students, measurement practitioners, substantive theorists in the human sciences, and other individuals interested in invariant measurement when judgments are obtained with rating scales.
TABLE OF CONTENTS
part I|45 pages
Introduction
part II|47 pages
Theories of Measurement and Judgment for Rating Scales
chapter 3|31 pages
Measurement Models for Rater-Mediated Assessments
part III|114 pages
Foundational Areas for Rating Scales
chapter 7|20 pages
Fairness in Rater-Mediated Assessment
chapter 8|42 pages
Case Study
part IV|46 pages
Technical Issues and IRT Models for Ratings
part V|69 pages
Practical Issues
part VI|12 pages
Final Word