ABSTRACT

The authors report a cognitive task analysis method called expert policy capture (EPC). EPC is offered as an approach that yields affordable scoring rules for assessing trainee performance in complex immersive environments, such as games and training simulations. The chapter reports five applications of the approach across a broad range of domains. Each of the applications is tailored to the available resources and the practical needs of a specific project. The approach requires that a domain expert review work sample tests of trainees performing in an immersive environment. The expert rates the quality of each performance, critiquing its strengths and weaknesses. The analyst collects together similar critiques and uses them to create a scoring worksheet. The scoring worksheet/program is tested for reliability and validity. The utility of EPC is supported by its ability to guide the scoring of recorded performances that yield results that are similar to human expert assessments.