Package org.dkpro.statistics.agreement.coding

Class MaxPercentageAgreement

java.lang.Object

org.dkpro.statistics.agreement.AgreementMeasure

org.dkpro.statistics.agreement.coding.CodingAgreementMeasure

org.dkpro.statistics.agreement.coding.MaxPercentageAgreement

All Implemented Interfaces:

ICodingAgreementMeasure, ICodingItemSpecificAgreement, IAgreementMeasure, IItemSpecificAgreement<ICodingAnnotationItem>

public class MaxPercentageAgreement
extends CodingAgreementMeasure
implements ICodingItemSpecificAgreement

Implementation of a simple "max" percentage agreement measure for calculating the inter-rater agreement for two or more raters applying set-valued annotations. The measure is neither chance-corrected nor weighted.

References:

• Jean Véronis. A study of polysemy judgements and inter-annotator agreement. In Proceedings of SENSEVAL-1, 1998.

Author:

Tristan Miller

Field Summary

Fields inherited from class org.dkpro.statistics.agreement.coding.CodingAgreementMeasure

study

Constructor Summary

Constructors

Constructor	Description
MaxPercentageAgreement(ICodingAnnotationStudy study)	Initializes the instance for the given annotation study.

Method Summary

Modifier and Type	Method	Description
double	calculateItemAgreement(ICodingAnnotationItem item)	Calculates the inter-rater agreement for the given annotation item.
double	doCalculateItemAgreement(ICodingAnnotationItem item)	Calculates the inter-rater agreement for the given annotation item.

Methods inherited from class org.dkpro.statistics.agreement.coding.CodingAgreementMeasure

calculateObservedAgreement, ensureTwoRaters, warnIfMissingValues

Methods inherited from class org.dkpro.statistics.agreement.AgreementMeasure

calculateAgreement, calculateExpectedAgreement

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dkpro.statistics.agreement.IAgreementMeasure

calculateAgreement

Constructor Details

MaxPercentageAgreement

public MaxPercentageAgreement(ICodingAnnotationStudy study)

Initializes the instance for the given annotation study. The study should never be null.

Method Details

doCalculateItemAgreement

public double doCalculateItemAgreement(ICodingAnnotationItem item)

Calculates the inter-rater agreement for the given annotation item. This is the basic step that is performed for each item of an annotation study, when calling AgreementMeasure.calculateAgreement().

Overrides:

doCalculateItemAgreement in class CodingAgreementMeasure

Throws:

java.lang.NullPointerException - if the given item is null.

calculateItemAgreement

public double calculateItemAgreement(ICodingAnnotationItem item)

Calculates the inter-rater agreement for the given annotation item. This is the basic step that is performed for each item of an annotation study, when calling AgreementMeasure.calculateAgreement().

Specified by:

calculateItemAgreement in interface IItemSpecificAgreement<ICodingAnnotationItem>

Throws:

java.lang.NullPointerException - if the given item is null.

See Also:

IItemSpecificAgreement