Package org.dkpro.statistics.agreement

Interface IItemSpecificAgreement<T extends IAnnotationItem>

All Known Subinterfaces:
ICodingItemSpecificAgreement
All Known Implementing Classes:
DiceAgreement, KrippendorffAlphaAgreement, MaxPercentageAgreement, PercentageAgreement
public interface IItemSpecificAgreement<T extends IAnnotationItem>
A diagnostic device for analyzing the agreement separately for each annotation item. This is useful, for instance, to identify a certain type of item that has been very easy or very difficult to annotate. Note that the definition of an annotation item depends on the actual annotation task (i.e., the type of IAnnotationStudy): Coding tasks use fixed items which are provided for each rater to annotate. In unitizing tasks, the notion of an annotation item corresponds to a certain segment within the given continuum. This segment may contain none, one, or multiple annotation units by no, one, or multiple raters.

References:
  • Krippendorff, K.: Content Analysis: An Introduction to Its Methodology. Beverly Hills, CA: Sage Publications, 1980.
Author:
Christian M. Meyer
See Also:
ICodingAnnotationStudy, ICodingItemSpecificAgreement, IUnitizingAnnotationStudy

  • Method Summary

    Modifier and Type Method Description
    double calculateItemAgreement​(T item)
    Calculates the inter-rater agreement for the given annotation item.