ABSTRACT

This chapter begins with a reprise of traditional assessment approaches to assessment. The remainder of the chapter is organized into principles intended to guide the developer or user of assessment simulations and games. These principles involve design of the assessments, uses during different development phases, transparency, and the use of tools to speed up the assessment development process. The importance of formative evaluation using qualitative measures as well as empirical trials is discussed. The important concern of technical quality is described including new requirements for concepts like reliability. In addition, the concept of validity is treated including its link to the assessment purpose(s) and how it relates to standard setting, fairness, and instructional sensitivity. Validity means how good the test is in supporting the decisions to be made from its results. These decisions may be about describing, classifying, or certifying an individual's performance or team performance, or refer to the quality of the training simulation or game.