ABSTRACT
This chapter describes the Decision Centered Testing (DCT) methodology and the initial application of the methodology in a competitive game micro-world domain. This application enabled the definition of appropriate test metrics and the construction of unique test scenarios to exercise the decision-making effectiveness. From this application, insights were gained regarding the construction of an evaluation framework for assessing the net decision-making effectiveness of a Joint Cognitive System (JCS). DCT involves explicit design and analysis of tests based on the key decision-making demands within the naturalistic work domain. DCT stresses the JCS through the application of cognitive pressure on the humans, technology and work domain, and these three basic relationships in the cognitive triad in an attempt to cause differences in decision-making effectiveness. Defining cognitive performance within the DCT methodology focuses on measuring the cognitive work under investigation. These metrics must be indicative of JCS decision-making effectiveness.
