Class TokenUsage
- All Implemented Interfaces:
Serializable,SdkPojo,ToCopyableBuilder<TokenUsage.Builder,TokenUsage>
The tokens used in a message API inference call.
- See Also:
-
Nested Class Summary
Nested Classes -
Method Summary
Modifier and TypeMethodDescriptionstatic TokenUsage.Builderbuilder()final List<CacheDetail>Detailed breakdown of cache writes by TTL.final IntegerThe number of input tokens read from the cache for the request.final IntegerThe number of input tokens written to the cache for the request.final booleanfinal booleanequalsBySdkFields(Object obj) final <T> Optional<T>getValueForField(String fieldName, Class<T> clazz) final booleanFor responses, this returns true if the service returned a value for the CacheDetails property.final inthashCode()final IntegerThe number of tokens sent in the request to the model.final IntegerThe number of tokens that the model generated for the request.static Class<? extends TokenUsage.Builder>final StringtoString()Returns a string representation of this object.final IntegerThe total of input tokens and tokens generated by the model.Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, waitMethods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder
copy
-
Method Details
-
inputTokens
The number of tokens sent in the request to the model.
- Returns:
- The number of tokens sent in the request to the model.
-
outputTokens
The number of tokens that the model generated for the request.
- Returns:
- The number of tokens that the model generated for the request.
-
totalTokens
The total of input tokens and tokens generated by the model.
- Returns:
- The total of input tokens and tokens generated by the model.
-
cacheReadInputTokens
The number of input tokens read from the cache for the request.
- Returns:
- The number of input tokens read from the cache for the request.
-
cacheWriteInputTokens
The number of input tokens written to the cache for the request.
- Returns:
- The number of input tokens written to the cache for the request.
-
hasCacheDetails
public final boolean hasCacheDetails()For responses, this returns true if the service returned a value for the CacheDetails property. This DOES NOT check that the value is non-empty (for which, you should check theisEmpty()method on the property). This is useful because the SDK will never return a null collection or map, but you may need to differentiate between the service returning nothing (or null) and the service returning an empty collection or map. For requests, this returns true if a value for the property was specified in the request builder, and false if a value was not specified. -
cacheDetails
Detailed breakdown of cache writes by TTL. Empty if no cache creation occurred. Sorted by TTL duration (1h before 5m).
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
This method will never return null. If you would like to know whether the service returned this field (so that you can differentiate between null and empty), you can use the
hasCacheDetails()method.- Returns:
- Detailed breakdown of cache writes by TTL. Empty if no cache creation occurred. Sorted by TTL duration (1h before 5m).
-
toBuilder
- Specified by:
toBuilderin interfaceToCopyableBuilder<TokenUsage.Builder,TokenUsage>
-
builder
-
serializableBuilderClass
-
hashCode
public final int hashCode() -
equals
-
equalsBySdkFields
- Specified by:
equalsBySdkFieldsin interfaceSdkPojo
-
toString
Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value. -
getValueForField
-
sdkFields
-
sdkFieldNameToField
- Specified by:
sdkFieldNameToFieldin interfaceSdkPojo
-