ABSTRACT
This chapter examines a number of key factors that may lead to poor reliability and validity of instructor/rater evaluations of trainee knowledge, skills, and attitudes. It discusses ways to mitigate some of these factors and highlights future research directions based upon the literature about this important topic. Cognitive biases are pervasive psychological tendencies that can cause evaluators to draw inaccurate conclusions about trainee performance. The concept of cognitive bias was first introduced by Kahneman & Tversky, whose research demonstrated a number of ways in which human judgments differ from what might be considered purely rational choices. The variety of factors capable of undermining the accuracy of instructor evaluations is of significant concern to training researchers and practitioners. Enhancing the reliability and validity of trainee performance evaluation by optimizing the rater instruments has been the focus of research.
