com.coze.loop.prompt

Class PromptCache

java.lang.Object

com.coze.loop.prompt.PromptCache

public class PromptCache
extends Object

Cache for prompts using Caffeine. Supports LRU eviction and automatic refresh.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	PromptCache.PromptCacheConfig Configuration for prompt cache.

Constructor Summary

Constructors

Constructor and Description
PromptCache(PromptCache.PromptCacheConfig config, Function<String,Prompt> loader) Create a PromptCache with custom configuration.

Method Summary

Modifier and Type	Method and Description
CompletableFuture<Prompt>	get(String key) Get prompt from cache, loading if necessary.
Prompt	getSync(String key) Get prompt from cache synchronously.
void	invalidate(String key) Invalidate a cache entry.
void	invalidateAll() Invalidate all cache entries.
void	put(String key, Prompt prompt) Put prompt into cache.
com.github.benmanes.caffeine.cache.stats.CacheStats	stats() Get cache statistics.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PromptCache

public PromptCache(PromptCache.PromptCacheConfig config,
                   Function<String,Prompt> loader)

Create a PromptCache with custom configuration.

Parameters:

config - cache configuration

loader - function to load prompt when not in cache

Method Detail

get

public CompletableFuture<Prompt> get(String key)

Get prompt from cache, loading if necessary.

Parameters:

key - the cache key

Returns:

CompletableFuture of prompt

getSync

public Prompt getSync(String key)

Get prompt from cache synchronously.

Parameters:

key - the cache key

Returns:

prompt or null if not found

put

public void put(String key,
                Prompt prompt)

Put prompt into cache.

Parameters:

key - the cache key

prompt - the prompt

invalidate

public void invalidate(String key)

Invalidate a cache entry.

Parameters:

key - the cache key

invalidateAll

public void invalidateAll()

Invalidate all cache entries.

stats

public com.github.benmanes.caffeine.cache.stats.CacheStats stats()

Get cache statistics.

Returns:

cache stats