ABSTRACT

Chapter 6 emphasizes what happens after judgment data have been collected: in other words, the analysis. We present basic information about ways in which this analysis has taken place in previous research. The chapter begins with a discussion of cleaning the data, including examining the stimuli and participant data and checking for reliability. This is followed by a discussion of ways to score both binary as well as scalar judgments and how to score corrections when corrections are requested. The chapter also provides information about common practices relevant to descriptive and inferential statistics in using judgment data. Included is information regarding group comparisons, regressions, and mixed-effects models. Other topics (reporting individual results, Rasch analysis, analyzing Likert scale data, analyzing magnitude estimation scores, analyzing response time data) are also covered. The chapter concludes with ways in which judgment data have been used in conjunction with other measures (e.g., production tasks, interviews). Throughout the chapter, numerous examples are provided and recommendations are made.