Class EvalUpdateResponse.TestingCriterion
-
- All Implemented Interfaces:
public final class EvalUpdateResponse.TestingCriterionA LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public interfaceEvalUpdateResponse.TestingCriterion.VisitorAn interface that defines how to map each variant of TestingCriterion to a value of type T.
public final classEvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarityA TextSimilarityGrader object which grades text based on similarity metrics.
public final classEvalUpdateResponse.TestingCriterion.EvalGraderPythonA PythonGrader object that runs a python script on the input.
public final classEvalUpdateResponse.TestingCriterion.EvalGraderScoreModelA ScoreModelGrader object that uses a model to assign a score to the input.
-
Method Summary
Modifier and Type Method Description final Optional<LabelModelGrader>labelModelGrader()A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final Optional<StringCheckGrader>stringCheckGrader()A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity>evalGraderTextSimilarity()A TextSimilarityGrader object which grades text based on similarity metrics. final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderPython>evalGraderPython()A PythonGrader object that runs a python script on the input. final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel>evalGraderScoreModel()A ScoreModelGrader object that uses a model to assign a score to the input. final BooleanisLabelModelGrader()final BooleanisStringCheckGrader()final BooleanisEvalGraderTextSimilarity()final BooleanisEvalGraderPython()final BooleanisEvalGraderScoreModel()final LabelModelGraderasLabelModelGrader()A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final StringCheckGraderasStringCheckGrader()A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarityasEvalGraderTextSimilarity()A TextSimilarityGrader object which grades text based on similarity metrics. final EvalUpdateResponse.TestingCriterion.EvalGraderPythonasEvalGraderPython()A PythonGrader object that runs a python script on the input. final EvalUpdateResponse.TestingCriterion.EvalGraderScoreModelasEvalGraderScoreModel()A ScoreModelGrader object that uses a model to assign a score to the input. final Optional<JsonValue>_json()final <T extends Any> Taccept(EvalUpdateResponse.TestingCriterion.Visitor<T> visitor)Maps this instance's current variant to a value of type T using the given visitor. final EvalUpdateResponse.TestingCriterionvalidate()Validates that the types of all values in this object match their expected types recursively. final BooleanisValid()Booleanequals(Object other)IntegerhashCode()StringtoString()final static EvalUpdateResponse.TestingCriterionofLabelModelGrader(LabelModelGrader labelModelGrader)A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final static EvalUpdateResponse.TestingCriterionofStringCheckGrader(StringCheckGrader stringCheckGrader)A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final static EvalUpdateResponse.TestingCriterionofEvalGraderTextSimilarity(EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity evalGraderTextSimilarity)A TextSimilarityGrader object which grades text based on similarity metrics. final static EvalUpdateResponse.TestingCriterionofEvalGraderPython(EvalUpdateResponse.TestingCriterion.EvalGraderPython evalGraderPython)A PythonGrader object that runs a python script on the input. final static EvalUpdateResponse.TestingCriterionofEvalGraderScoreModel(EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel evalGraderScoreModel)A ScoreModelGrader object that uses a model to assign a score to the input. -
-
Method Detail
-
labelModelGrader
final Optional<LabelModelGrader> labelModelGrader()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
stringCheckGrader
final Optional<StringCheckGrader> stringCheckGrader()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
evalGraderTextSimilarity
final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity> evalGraderTextSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics.
-
evalGraderPython
final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderPython> evalGraderPython()
A PythonGrader object that runs a python script on the input.
-
evalGraderScoreModel
final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel> evalGraderScoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input.
-
isLabelModelGrader
final Boolean isLabelModelGrader()
-
isStringCheckGrader
final Boolean isStringCheckGrader()
-
isEvalGraderTextSimilarity
final Boolean isEvalGraderTextSimilarity()
-
isEvalGraderPython
final Boolean isEvalGraderPython()
-
isEvalGraderScoreModel
final Boolean isEvalGraderScoreModel()
-
asLabelModelGrader
final LabelModelGrader asLabelModelGrader()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
asStringCheckGrader
final StringCheckGrader asStringCheckGrader()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
asEvalGraderTextSimilarity
final EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity asEvalGraderTextSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics.
-
asEvalGraderPython
final EvalUpdateResponse.TestingCriterion.EvalGraderPython asEvalGraderPython()
A PythonGrader object that runs a python script on the input.
-
asEvalGraderScoreModel
final EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel asEvalGraderScoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input.
-
accept
final <T extends Any> T accept(EvalUpdateResponse.TestingCriterion.Visitor<T> visitor)
Maps this instance's current variant to a value of type T using the given visitor.
Note that this method is not forwards compatible with new variants from the API, unless visitor overrides Visitor.unknown. To handle variants not known to this version of the SDK gracefully, consider overriding Visitor.unknown:
import com.openai.core.JsonValue; import java.util.Optional; Optional<String> result = testingCriterion.accept(new TestingCriterion.Visitor<Optional<String>>() { @Override public Optional<String> visitLabelModelGrader(LabelModelGrader labelModelGrader) { return Optional.of(labelModelGrader.toString()); } // ... @Override public Optional<String> unknown(JsonValue json) { // Or inspect the `json`. return Optional.empty(); } });
-
validate
final EvalUpdateResponse.TestingCriterion validate()
Validates that the types of all values in this object match their expected types recursively.
This method is not forwards compatible with new types from the API for existing fields.
-
ofLabelModelGrader
final static EvalUpdateResponse.TestingCriterion ofLabelModelGrader(LabelModelGrader labelModelGrader)
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
ofStringCheckGrader
final static EvalUpdateResponse.TestingCriterion ofStringCheckGrader(StringCheckGrader stringCheckGrader)
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
ofEvalGraderTextSimilarity
final static EvalUpdateResponse.TestingCriterion ofEvalGraderTextSimilarity(EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity evalGraderTextSimilarity)
A TextSimilarityGrader object which grades text based on similarity metrics.
-
ofEvalGraderPython
final static EvalUpdateResponse.TestingCriterion ofEvalGraderPython(EvalUpdateResponse.TestingCriterion.EvalGraderPython evalGraderPython)
A PythonGrader object that runs a python script on the input.
-
ofEvalGraderScoreModel
final static EvalUpdateResponse.TestingCriterion ofEvalGraderScoreModel(EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel evalGraderScoreModel)
A ScoreModelGrader object that uses a model to assign a score to the input.
-
-
-
-