ABSTRACT

Chapter 9 focuses on the logic and content of validity arguments to support the inferences that are made from standards set on the reporting score scale for a test. The evidence to support the validity argument is organized into four general types: (1) conceptual coherence, (2) procedural, (3) internal, and (4) external. Each evidence type is defined and their uses in a validity argument are described. The need for complete documentation of the standard setting process is discussed. The chapter also includes information about measures of decision consistency and measures of consistency among panelists. An example of the claims and evidence for a validity argument is provided.