ABSTRACT
In this chapter we identify important issues in human scoring that should be considered by automated scoring teams. Specifically, we provide an overview of the terminology relevant to human scoring, the process used in large-scale scoring projects, provide a conceptual framework for depicting research regarding human scoring, and present some illustrative examples of research that represent aspects of that framework. Our presentation emphasizes the issues and ideas that automated scoring teams should consider and investigate in their efforts to obtain the highest-quality ratings for a reasonable cost.
