ABSTRACT
Computer-based testing is revolutionizing how tests are assembled and delivered. One of the most exciting and promising aspects is the inclusion of new item formats, often called innovative item formats. These new formats are promising because they may help to address a long-standing criticism of standardized tests-namely, that the testing process is too artificial and does not measure knowledge, skills, and abilities (KSAs) in a realistic way. Furthermore, innovative item formats available in computer-based testing have the potential to measure important attributes that are not measurable using traditional item formats. In this chapter, we review the potential advantages and disadvantages of innovative item formats within the framework of test score validity. We begin with a discussion of the limitations of traditional item formats. Next, we describe innovative computer-based item formats currently in use or proposed for use. We also review the research on the advantages and limitations of these new formats. Finally, we conclude that, if implemented properly, the newer item formats made possible by computerized testing can greatly enhance the validity of interpretations made on the basis of test scores.
