Interface CreateAutomatedReasoningPolicyTestCaseRequest.Builder

    • Method Detail

      • policyArn

        CreateAutomatedReasoningPolicyTestCaseRequest.Builder policyArn​(String policyArn)

        The Amazon Resource Name (ARN) of the Automated Reasoning policy for which to create the test.

        Parameters:
        policyArn - The Amazon Resource Name (ARN) of the Automated Reasoning policy for which to create the test.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • guardContent

        CreateAutomatedReasoningPolicyTestCaseRequest.Builder guardContent​(String guardContent)

        The output content that's validated by the Automated Reasoning policy. This represents the foundation model response that will be checked for accuracy.

        Parameters:
        guardContent - The output content that's validated by the Automated Reasoning policy. This represents the foundation model response that will be checked for accuracy.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • queryContent

        CreateAutomatedReasoningPolicyTestCaseRequest.Builder queryContent​(String queryContent)

        The input query or prompt that generated the content. This provides context for the validation.

        Parameters:
        queryContent - The input query or prompt that generated the content. This provides context for the validation.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • expectedAggregatedFindingsResult

        CreateAutomatedReasoningPolicyTestCaseRequest.Builder expectedAggregatedFindingsResult​(String expectedAggregatedFindingsResult)

        The expected result of the Automated Reasoning check. Valid values include: , TOO_COMPLEX, and NO_TRANSLATIONS.

        • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

        • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

        • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

        • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

        • TRANSLATION_AMBIGUOUS - Detected an ambiguity in the translation meant it would be unsound to continue with validity checking. Additional context or follow-up questions might be needed to get translation to succeed.

        • TOO_COMPLEX - The input contains too much information for Automated Reasoning to process within its latency limits.

        • NO_TRANSLATIONS - Identifies that some or all of the input prompt wasn't translated into logic. This can happen if the input isn't relevant to the Automated Reasoning policy, or if the policy doesn't have variables to model relevant input. If Automated Reasoning can't translate anything, you get a single NO_TRANSLATIONS finding. You might also see a NO_TRANSLATIONS (along with other findings) if some part of the validation isn't translated.

        Parameters:
        expectedAggregatedFindingsResult - The expected result of the Automated Reasoning check. Valid values include: , TOO_COMPLEX, and NO_TRANSLATIONS.

        • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

        • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

        • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

        • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

        • TRANSLATION_AMBIGUOUS - Detected an ambiguity in the translation meant it would be unsound to continue with validity checking. Additional context or follow-up questions might be needed to get translation to succeed.

        • TOO_COMPLEX - The input contains too much information for Automated Reasoning to process within its latency limits.

        • NO_TRANSLATIONS - Identifies that some or all of the input prompt wasn't translated into logic. This can happen if the input isn't relevant to the Automated Reasoning policy, or if the policy doesn't have variables to model relevant input. If Automated Reasoning can't translate anything, you get a single NO_TRANSLATIONS finding. You might also see a NO_TRANSLATIONS (along with other findings) if some part of the validation isn't translated.

        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        AutomatedReasoningCheckResult, AutomatedReasoningCheckResult
      • expectedAggregatedFindingsResult

        CreateAutomatedReasoningPolicyTestCaseRequest.Builder expectedAggregatedFindingsResult​(AutomatedReasoningCheckResult expectedAggregatedFindingsResult)

        The expected result of the Automated Reasoning check. Valid values include: , TOO_COMPLEX, and NO_TRANSLATIONS.

        • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

        • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

        • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

        • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

        • TRANSLATION_AMBIGUOUS - Detected an ambiguity in the translation meant it would be unsound to continue with validity checking. Additional context or follow-up questions might be needed to get translation to succeed.

        • TOO_COMPLEX - The input contains too much information for Automated Reasoning to process within its latency limits.

        • NO_TRANSLATIONS - Identifies that some or all of the input prompt wasn't translated into logic. This can happen if the input isn't relevant to the Automated Reasoning policy, or if the policy doesn't have variables to model relevant input. If Automated Reasoning can't translate anything, you get a single NO_TRANSLATIONS finding. You might also see a NO_TRANSLATIONS (along with other findings) if some part of the validation isn't translated.

        Parameters:
        expectedAggregatedFindingsResult - The expected result of the Automated Reasoning check. Valid values include: , TOO_COMPLEX, and NO_TRANSLATIONS.

        • VALID - The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims.

        • INVALID - The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy.

        • SATISFIABLE - The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true.

        • IMPOSSIBLE - Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself.

        • TRANSLATION_AMBIGUOUS - Detected an ambiguity in the translation meant it would be unsound to continue with validity checking. Additional context or follow-up questions might be needed to get translation to succeed.

        • TOO_COMPLEX - The input contains too much information for Automated Reasoning to process within its latency limits.

        • NO_TRANSLATIONS - Identifies that some or all of the input prompt wasn't translated into logic. This can happen if the input isn't relevant to the Automated Reasoning policy, or if the policy doesn't have variables to model relevant input. If Automated Reasoning can't translate anything, you get a single NO_TRANSLATIONS finding. You might also see a NO_TRANSLATIONS (along with other findings) if some part of the validation isn't translated.

        Returns:
        Returns a reference to this object so that method calls can be chained together.
        See Also:
        AutomatedReasoningCheckResult, AutomatedReasoningCheckResult
      • clientRequestToken

        CreateAutomatedReasoningPolicyTestCaseRequest.Builder clientRequestToken​(String clientRequestToken)

        A unique, case-sensitive identifier to ensure that the operation completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error.

        Parameters:
        clientRequestToken - A unique, case-sensitive identifier to ensure that the operation completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • confidenceThreshold

        CreateAutomatedReasoningPolicyTestCaseRequest.Builder confidenceThreshold​(Double confidenceThreshold)

        The minimum confidence level for logic validation. Content that meets the threshold is considered a high-confidence finding that can be validated.

        Parameters:
        confidenceThreshold - The minimum confidence level for logic validation. Content that meets the threshold is considered a high-confidence finding that can be validated.
        Returns:
        Returns a reference to this object so that method calls can be chained together.