ABSTRACT

This introduction presents an overview of the key concepts discussed in the subsequent chapters of this book. The book discusses conceptual and methodological issues in generating and using response process data to support validity arguments. It also discusses the framing of validity as an evidence-based argument for the interpretation of the meaning of test scores. The book describes the specifics of different methods of data collection and analysis. It also describes how verbal reports and protocol analysis used in such data collection efforts can contribute to validating score meaning. The book explains the creation of response process data through response time, eye tracking, and computer log files and discusses how they can be used for validating score meaning, including the types of evidence and arguments they support. It explores many of the concerns associated with the design of assessments of complex thinking as well as issues in the scoring, analysis, and interpretation of student performance data.