ABSTRACT
Computer-based technology can rapidly generate detailed plans for complex situations. However, these plans may be rejected by planning experts, who judge dimensions such as the "robustness" of the plan using operational rather than computational criteria. Klein Associates' goal in this research was to first capture the tactical and strategic concerns of air campaign planners, then incorporate this understanding into planning technology to assist with filtering out the unacceptable options as a plan is being developed. Specifically, we focused on identifying characteristics of quality plans and how these characteristics are judged in operational settings. We relied on Cognitive Task Analysis (CTA) knowledge elicitation techniques to identify the process of plan evaluation and the factors underlying judgments of plan robustness. The research team drew on observations and interviews in a variety of settings. The primary data sources were from joint military exercises, in-depth interviews, and from a simulation exercise with Pentagon planning staff. The insights from the CTA formed the foundation of a software tool, the Bed-Down Critic, which highlights potential problem areas, vulnerable assumptions, and summarizes aspects of quality as the plan is being developed.
