ABSTRACT

This chapter describes a range of criteria that can be used to conduct a human-centered system evaluation. It also describes how the indicators were derived and then give examples of how they have been used to evaluate systems. The number of cognitive performance indicators and their role in system evaluation has evolved since their inception. Cognitive performance indicators assist system developers in prioritizing which design features to focus resources on in subsequent development efforts. Cognitive Systems Engineering experts have developed an informal set of criteria to identify and describe how systems support and hinder cognitive performance in naturalistic settings. Two types of documents were developed to enhance Humans System Integration practitioners' abilities to identify and describe how systems support and hinder cognitive performance. The first document was a simplified job aid. The second document was an expanded version of the job aid that provided more detailed information, including assessment questions, and examples that showcased each cognitive performance indicator.