ABSTRACT

This chapter describes the traditional way of developing Situational Judgment Testing (SJTs), followed by a literature review concerning how design considerations impact the quality of the SJT. It also design considerations affect six important selection test criteria. After developing the SJT items, the response instructions have to be determined. There are two types of response instructions that can be used: knowledge-based and behavioral tendency instructions. Almost all construct-related validity evidence until now has been restricted to paper-and-pencil SJTs. The meta-analysis of McDaniel shows that response instructions had little moderating effect on criterion-related validity. Although empirical-based scoring methods often have high validity, the method is criticized for being atheoretical. A construct-based approach offers several theoretical and practical advantages, such as the ability to generalize findings across time and jobs. The chapter also reviews the traditional way of developing and scoring SJTs and how different development and scoring procedures affect the SJT's reliability, validity, ethnic score differences, fakability, and acceptability.