ABSTRACT

This chapter presents an summary and outlook of Analyzing Rater Agreement. The model typically contains the intercept and the main effects of the variables that span the cross-classification under study. represented by the parameter, represents the agreement cells, that is, the cells in the main diagonal. Without this term, the models needed to explain the joint frequency distribution of ordinal variables can become unnecessarily complex. Itallows researchers to take continuous covariates into account. The effects of covariates can be assessed by comparing models with covariates and models without covariates. The analysis of rater agreement presented here is exploratory in nature. Using Configural Frequency Analysis (CFA), it was shown how cross-classifications of two or more raters judgements can be explored. One problem with latent class models for rater agreement is that the number of estimated parameters is large.