Interface IRaterSpecificAgreement


public interface IRaterSpecificAgreement
A diagnostic device for analyzing the agreement separately for each human rater. This is useful, for instance, to identify a certain rater who potentially had problems with the interpretation of the annotation guidelines and thus created unreliable annotations with a low agreement to all other raters.

References:
  • Krippendorff, K.: Content Analysis: An Introduction to Its Methodology. Beverly Hills, CA: Sage Publications, 1980.
Author:
Christian M. Meyer
  • Method Summary

    Modifier and Type Method Description
    double calculateRaterAgreement​(int raterIdx)
    Calculates the inter-rater agreement for the rater with the given index.