ABSTRACT

Similar to our discussion of qualitative item review methods in Chapter 10, here quantitative item review methods are described and how the data from each review method can contribute to item improvement and address our hypothesis regarding whether respondents interpret the item in the manner intended. This chapter provides a complement to the previous chapter with a focus on item review methods that yield quantitative indices. Ex ante, individual- (behavior coding, paradata, response latency) and group-based (item analysis) item review methods are described as well as approaches to review of poorly functioning responses from persons (via classical test theory and item response theory analysis). Further, the use of latent class analysis is briefly described. A comparison of the pros and cons and costs of item review methods is provided. Finally, a suggested plan of attack for research projects with respect to item review is provided.