ABSTRACT

A Survey Development Framework is presented that includes development of both the survey and the interpretive-use argument. The survey design component is a systematic process of conceptualization, development, and administration of surveys with (1) the development of a Survey Blueprint, which describes both the survey development and administration process, and (2) the development of validity arguments that focus on different kinds of claims or assumptions deriving from the proposed interpretation and use of scores obtained from survey administration. This validation approach includes preparing and testing claims in the form of hypotheses embedded in the argument, and it is the core of the theory-driven approach to validation. Recognizing that for each hypothesis, actions must be taken to gather evidence in order to test it, it is useful to develop a layout showing the guiding hypotheses, strategies for collecting evidence, and the nature of the evidence. The Table of Specifications in the Survey Blueprint lays out what should be included in a survey. Hypotheses are presumptions or inferences about the characteristics and functioning of the focal construct or consequences of interpretation and score use.