Validation of Attributes, a Q Matrix Coded by the Involvement of Attributes to Items, and a Test
The selection and identification of attributes in a test for RSM analyses are extremely important, and we have spent a great deal of time on the development of the procedure. The procedure starts with studying students’ protocols, documenting interviews on how students solve given problems, creating self-protocols by several experts and researchers with various backgrounds, and finally studying the information in detail. We usually team up with domain experts, cognitive psychologists and scientists, and experienced educators, because it is necessary to develop a list of attributes that reflects educational and cognitive perspectives, and represents a majority of students’ thinking skills and knowledge, which underlie the performance on a given problem. Interestingly, RSM analyses can be effectively used for the selection, identification, refinement, and validation of attributes. This chapter introduces the RSM validation procedure from different angles by using various examples, and summarizes it in a list.