ABSTRACT

Designing a score report for a large-scale testing program requires input from clients, program managers, several kinds of technical experts, and, ideally, the intended users of the report. A good way to begin is to assemble a team of experts in assessment development, psychometrics, user experience, cognitive science, information technology, and accessibility. The score report design process consists of several steps: gathering information about the test and the scores to be reported; creating a schedule; creating report design prototypes or “mockups”; getting the client’s reactions to the mockups and revising them accordingly; conducting usability testing or focus groups to get reactions to the mockups from potential users of the report; revising the mockups on the basis of the users’ reactions; making a final choice and getting approval from the client. Often, several iterations of design and review are necessary. Frequent communication between the client and the design team is essential, to avoid wasted effort and missed deadlines. Designing interactive score reports adds another layer of complexity. This chapter guides the reader through our process for score report design and outlines important lessons learned through the authors’ experience.