Interface LlmCall.TokenCountOrBuilder
- All Superinterfaces:
com.google.protobuf.MessageLiteOrBuilder,com.google.protobuf.MessageOrBuilder
- All Known Implementing Classes:
LlmCall.TokenCount,LlmCall.TokenCount.Builder
- Enclosing class:
- LlmCall
public static interface LlmCall.TokenCountOrBuilder
extends com.google.protobuf.MessageOrBuilder
-
Method Summary
Modifier and TypeMethodDescriptionlongThe number of tokens used for the conversation history in the prompt.longThe number of tokens used for the retrieved examples in the prompt.longThe total number of tokens used for the input to the LLM call.longThe total number of tokens used for the output of the LLM call.Methods inherited from interface com.google.protobuf.MessageLiteOrBuilder
isInitializedMethods inherited from interface com.google.protobuf.MessageOrBuilder
findInitializationErrors, getAllFields, getDefaultInstanceForType, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof
-
Method Details
-
getTotalInputTokenCount
long getTotalInputTokenCount()The total number of tokens used for the input to the LLM call.
int64 total_input_token_count = 1;- Returns:
- The totalInputTokenCount.
-
getConversationContextTokenCount
long getConversationContextTokenCount()The number of tokens used for the conversation history in the prompt.
int64 conversation_context_token_count = 3;- Returns:
- The conversationContextTokenCount.
-
getExampleTokenCount
long getExampleTokenCount()The number of tokens used for the retrieved examples in the prompt.
int64 example_token_count = 4;- Returns:
- The exampleTokenCount.
-
getTotalOutputTokenCount
long getTotalOutputTokenCount()The total number of tokens used for the output of the LLM call.
int64 total_output_token_count = 5;- Returns:
- The totalOutputTokenCount.
-