ABSTRACT

System design is an area where Naturalistic Decision Making (NDM) research is beginning to have an impact. In order to design good systems, NDM research must address all the steps involved in transitioning the cognitive requirements of a decision maker into a support system that aids the decision making. After the system is built, the final step is to test the effectiveness of the design, which is commonly conducted in a usability laboratory. This chapter summarizes the design and usability testing issues raised during a panel discussion at the 1994 NDM conference. The participants on the panel were all experienced system designers who use an NDM perspective in designing and evaluating systems. The panel members were: Joseph Dumas (American Institutes for Research), Thomas Miller (Klein Associates Inc.), Gunilla Sundstrom (GTE Laboratory), Kim Vicente (University of Toronto) and David Woods (The Ohio State University).