ABSTRACT
The identification and choice of criteria for evaluating the quality of performance ratings (i.e., rating effectiveness) has been recognized as a central problem for researchers and practitioners since the early work of Weitz (1961), Wallace (1965), and Smith (1976). A large number of criteria have been suggested (e.g., several rating error indices and rating accuracy indices) with no rationale for choosing among them. Recent research has been highly critical of these available criteria, but has not yet proposed a solution to the criterion problem (Guion & Gibson, 1987; Murphy & Balzer, 1989; Sulsky & Balzer, 1988; Wexley, 1987). As we prepared this chapter, it became quite clear that, despite admonitions by Weitz (1961), Wallace (1965), and Smith (1976), we still have not come to grips with problems in evaluating and choosing performance appraisal criteria.
