All Classes
| Class | Description |
|---|---|
| AgreementMeasure |
Default implementation of the
IAgreementMeasure interface providing computational hooks
for calculating the observed and the expected agreement. |
| AnnotationStudy |
Default implementation of the
IAnnotationStudy interface. |
| AnnotationUnit |
Default implementation of
IAnnotationUnit holding the rater's index and the category that
the rater assigned to this unit. |
| BennettSAgreement |
Implementation of Bennett et al.'s S (1954) for calculating a chance-corrected inter-rater
agreement for two raters.
|
| CachedDistanceFunction |
Wrapper class for arbitrary distance functions that caches the distance scores between two
categories in a hash table.
|
| CodingAgreementMeasure |
Abstract base class of agreement measures for
ICodingAnnotationStudys. |
| CodingAnnotationItem |
Default implementation of
ICodingAnnotationItem holding the set of annotation units for
this item (i.e., the categories assigned to this item by all raters). |
| CodingAnnotationStudy |
Default implementation of the
ICodingAnnotationStudy interface. |
| CohenKappaAgreement |
Implementation of Cohen's kappa (1960) for calculating a chance-corrected inter-rater agreement
for two raters.
|
| CoincidenceMatrixPrinter |
Plain-text visualization for a coincidence matrix as defined by
Krippendorff (1980: p.
|
| ContingencyMatrixPrinter |
Plain-text visualization for a contingency matrix as defined by
Krippendorff (1980: p.
|
| DiceAgreement |
Implementation of a mean Dice agreement measure for calculating the inter-rater agreement for two
or more raters applying set-valued annotations.
|
| DisagreementMeasure |
Default implementation of the
IAgreementMeasure interface providing computational hooks
for calculating the observed and the expected disagreement. |
| DistanceMatrixPrinter |
Plain-text visualization for distance functions showing the distance scores between each pair of
categories.
|
| FleissKappaAgreement |
Generalization of Scott's (1955) pi-measure for calculating a chance-corrected inter-rater
agreement for multiple raters, which is known as Fleiss' (1971) kappa and Carletta's (1996) K.
|
| HubertKappaAgreement |
Conger, A.J.: Integration and generalization of kappas for multiple raters.
|
| IAgreementMeasure |
Generic interface that is to be implemented by all inter-rater agreement measures.
|
| IAnnotationItem |
Represents a single annotation item of an
IAnnotationStudy. |
| IAnnotationStudy |
Basic interface representing the essential data model of any annotation study.
|
| IAnnotationUnit |
Represents a single annotation unit of an
IAnnotationStudy identified and coded by a
certain rater. |
| ICategorySpecificAgreement |
A diagnostic device for analyzing the agreement separately for each category.
|
| IChanceCorrectedAgreement |
Generic interface to be implemented by all inter-rater agreement measures that perform a chance
correction and thus distinguish between observed agreement and expected agreement.
|
| IChanceCorrectedDisagreement |
Generic interface to be implemented by all inter-rater agreement measures that perform a chance
correction and thus distinguish between observed disagreement and expected disagreement.
|
| ICodingAgreementMeasure |
Super interface for all
IAgreementMeasures for coding tasks. |
| ICodingAnnotationItem |
Represents a single annotation item of an
ICodingAnnotationStudy. |
| ICodingAnnotationStudy |
Data model for coding studies.
|
| ICodingItemSpecificAgreement |
A diagnostic device for analyzing the agreement separately for each annotation item.
|
| IDistanceFunction |
Interface for a distance function to be used in any
IWeightedAgreement measure, such as
WeightedKappaAgreement or KrippendorffAlphaAgreement. |
| IItemSpecificAgreement<T extends IAnnotationItem> |
A diagnostic device for analyzing the agreement separately for each annotation item.
|
| InsufficientDataException |
Exception type for indicating missing data.
|
| IntervalDistanceFunction |
Implementation of the
IDistanceFunction interface for scoring the distance between
interval-scaled categories. |
| IRaterSpecificAgreement |
A diagnostic device for analyzing the agreement separately for each human rater.
|
| IUnitizingAgreementMeasure |
Super interface for all
IAgreementMeasures for unitizing tasks. |
| IUnitizingAnnotationStudy |
Data model for unitizing studies.
|
| IUnitizingAnnotationUnit |
Extension of the
IAnnotationUnit interface for representing the annotation units of
IUnitizingAnnotationStudys. |
| IWeightedAgreement |
Interface for all weighted inter-rater agreement measures.
|
| KrippendorffAlphaAgreement |
Implementation of Krippendorff's (1980) alpha-measure for calculating a chance-corrected
inter-rater agreement for multiple raters with arbitrary distance/weighting functions.
|
| KrippendorffAlphaUnitizingAgreement |
Implementation of Krippendorff's (1995) alpha_U-measure for calculating a chance-corrected
inter-rater agreement for unitizing studies with multiple raters.
|
| MASISetAnnotationDistanceFunction |
Distance function for set-valued annotation studies based on the definition of Passonneau's
(2006) MASI (Measuring Agreement on Set-valued Items).
|
| MaxPercentageAgreement |
Implementation of a simple "max" percentage agreement measure for calculating the inter-rater
agreement for two or more raters applying set-valued annotations.
|
| NominalDistanceFunction |
Implementation of the
IDistanceFunction interface for scoring the distance between
nominal-scaled categories. |
| OrdinalDistanceFunction |
Implementation of the
IDistanceFunction interface for scoring the distance between
ordinal-scaled categories. |
| PercentageAgreement |
Implementation of a simple percentage of agreement measure for calculating the inter-rater
agreement for two or more raters.
|
| RandolphKappaAgreement |
Generalization of Bennett et al.'s (1954) S-measure for calculating a chance-corrected
inter-rater agreement for multiple raters, which is known as Randolph's (2005) kappa.
|
| RatioDistanceFunction |
Implementation of the
IDistanceFunction interface for scoring the distance between
ratio-scaled categories. |
| ReliabilityMatrixPrinter |
Plain-text visualization for a reliability matrix as defined by
Krippendorff (1980: p.
|
| ScottPiAgreement |
Implementation of Scott's pi (1955) for calculating a chance-corrected inter-rater agreement for
two raters.
|
| SetAnnotation |
Represents a set of categories that can be used as annotation type in a multi-labeling setting.
|
| SetAnnotationDistanceFunction |
Distance function for set-valued annotation studies based on the definition of partial matching
(Passonneau, 2004).
|
| SquareDistanceFunction | Deprecated. |
| UnitizingAgreementMeasure |
Abstract base class of agreement measures for
IUnitizingAnnotationStudys. |
| UnitizingAnnotationStudy |
Default implementation of the
IUnitizingAnnotationStudy interface. |
| UnitizingAnnotationUnit |
Default implementation of
IUnitizingAnnotationUnit holding the rater's index and the
category that the rater assigned to this unit as well as the position of the annotation unit
within the continuum of an annotation study. |
| UnitizingMatrixPrinter |
Plain-text visualization for unitizing studies.
|
| UnitizingStudyPrinter |
Plain-text visualization for unitizing studies.
|
| WeightedAgreement |
Abstract base class for weighted measures.
|
| WeightedKappaAgreement |
Generalization of Cohen's (1960) kappa-measure for calculating a chance-corrected inter-rater
agreement for multiple raters with arbitrary distance/weighting functions.
|