-
public interface APIGatewayServiceGrpc.AsyncServiceThe API Gateway service definition.
-
-
Method Summary
Modifier and Type Method Description voidrequestPrompt(PromptRequest request, StreamObserver<PromptResponse> responseObserver)Request a regular LLM promptvoidrequestStreamingPrompt(PromptRequest request, StreamObserver<StreamingPromptResponse> responseObserver)Request a streaming LLM prompt-
-
Method Detail
-
requestPrompt
void requestPrompt(PromptRequest request, StreamObserver<PromptResponse> responseObserver)
Request a regular LLM prompt
-
requestStreamingPrompt
void requestStreamingPrompt(PromptRequest request, StreamObserver<StreamingPromptResponse> responseObserver)
Request a streaming LLM prompt
-
-
-
-