Assessing the inter-analyst reliability of the RIAAT process

This study used three reliability coefficients, namely, the %-agreement, Scott’s π and Krippendorff’s α, following the suggestion of using more than one coefficient (Lombard et al 2002, Taylor & Watkinson 2007). Unlike π and α, the %-agreement is not chance-corrected but it was included because it is easy to calculate.