ABSTRACT

This chapter describes a competence-based assessment system, called CBAS, for air traffic control (ATC) simulator and on-the-job training (OJT), developed at Air Traffic Control The Netherlands (LVNL). In contrast with simulator training, learning processes in OJT are difficult to assess, because the learning tasks cannot be planned in advance due to the ongoing air traffic. The assessment system in OJT was designed in such a way that the trainees’ progression can nonetheless be monitored. The reliability and validity of CBAS have been evaluated in previous research (Oprins, Burggraaff, and Van Weerdenburg, 2006, 2008; Oprins, 2008). Here we present an evaluation with regard to the analysis of learning curves derived from assessment results. An adequate assessment of learning processes showing differences in individual learning patterns (e.g., slow starters, learning plateaus) and in performance (strengths and weaknesses) is of crucial importance as a basis for feedback on the learning process and for passfail decisions. CBAS compares the trainees’ actual performance to the required performance at successive moments of time. Under the assumption that performance is a reflection of the learning process (Oprins, 2008), it extracts learning curves from a sequence of performance measures over time. If trainees are learning, then their performance will increase (Oprins, 2008).