Class AutomatedReasoningPolicyGeneratedTestCase

    • Method Detail

      • queryContent

        public final String queryContent()

        The input query or prompt that generated the content. This provides context for the validation.

        Returns:
        The input query or prompt that generated the content. This provides context for the validation.
      • guardContent

        public final String guardContent()

        The output content that's validated by the Automated Reasoning policy. This represents the foundation model response that will be checked for accuracy.

        Returns:
        The output content that's validated by the Automated Reasoning policy. This represents the foundation model response that will be checked for accuracy.
      • expectedAggregatedFindingsResult

        public final AutomatedReasoningCheckResult expectedAggregatedFindingsResult()

        The expected results of the generated test case. Possible values include:

        • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

        • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

        • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

        • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

        If the service returns an enum value that is not available in the current SDK version, expectedAggregatedFindingsResult will return AutomatedReasoningCheckResult.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from expectedAggregatedFindingsResultAsString().

        Returns:
        The expected results of the generated test case. Possible values include:

        • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

        • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

        • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

        • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

        See Also:
        AutomatedReasoningCheckResult
      • expectedAggregatedFindingsResultAsString

        public final String expectedAggregatedFindingsResultAsString()

        The expected results of the generated test case. Possible values include:

        • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

        • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

        • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

        • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

        If the service returns an enum value that is not available in the current SDK version, expectedAggregatedFindingsResult will return AutomatedReasoningCheckResult.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from expectedAggregatedFindingsResultAsString().

        Returns:
        The expected results of the generated test case. Possible values include:

        • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

        • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

        • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

        • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

        See Also:
        AutomatedReasoningCheckResult
      • hashCode

        public final int hashCode()
        Overrides:
        hashCode in class Object
      • equals

        public final boolean equals​(Object obj)
        Overrides:
        equals in class Object
      • toString

        public final String toString()
        Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value.
        Overrides:
        toString in class Object
      • getValueForField

        public final <T> Optional<T> getValueForField​(String fieldName,
                                                      Class<T> clazz)