ABSTRACT
In the situation described earlier, one could use a correlation coefficient to examine the level of agreement among all possible pairs of expert judges in their ratings across work activities, competencies, or whatever. However, using correlations as a measure of reliability with this kind of rating judgment works best when the people performing the rating task have a clear understanding of the work to be performed.
