Interface LlmCall.TokenCountOrBuilder

All Superinterfaces:
com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder
All Known Implementing Classes:
LlmCall.TokenCount, LlmCall.TokenCount.Builder
Enclosing class:
LlmCall

public static interface LlmCall.TokenCountOrBuilder extends com.google.protobuf.MessageOrBuilder
  • Method Summary

    Modifier and Type
    Method
    Description
    long
    The number of tokens used for the conversation history in the prompt.
    long
    The number of tokens used for the retrieved examples in the prompt.
    long
    The total number of tokens used for the input to the LLM call.
    long
    The total number of tokens used for the output of the LLM call.

    Methods inherited from interface com.google.protobuf.MessageLiteOrBuilder

    isInitialized

    Methods inherited from interface com.google.protobuf.MessageOrBuilder

    findInitializationErrors, getAllFields, getDefaultInstanceForType, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof
  • Method Details

    • getTotalInputTokenCount

      long getTotalInputTokenCount()
       The total number of tokens used for the input to the LLM call.
       
      int64 total_input_token_count = 1;
      Returns:
      The totalInputTokenCount.
    • getConversationContextTokenCount

      long getConversationContextTokenCount()
       The number of tokens used for the conversation history in the prompt.
       
      int64 conversation_context_token_count = 3;
      Returns:
      The conversationContextTokenCount.
    • getExampleTokenCount

      long getExampleTokenCount()
       The number of tokens used for the retrieved examples in the prompt.
       
      int64 example_token_count = 4;
      Returns:
      The exampleTokenCount.
    • getTotalOutputTokenCount

      long getTotalOutputTokenCount()
       The total number of tokens used for the output of the LLM call.
       
      int64 total_output_token_count = 5;
      Returns:
      The totalOutputTokenCount.