Package co.elastic.clients.elasticsearch.inference

Class GroqServiceSettings

java.lang.Object

co.elastic.clients.elasticsearch.inference.GroqServiceSettings

All Implemented Interfaces:

JsonpSerializable

@JsonpDeserializable
public class GroqServiceSettings
extends Object
implements JsonpSerializable

See Also:

• API specification

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	GroqServiceSettings.Builder	Builder for GroqServiceSettings.

Field Summary

Fields

Modifier and Type	Field	Description
static final JsonpDeserializer<GroqServiceSettings>	_DESERIALIZER	Json deserializer for GroqServiceSettings

Method Summary

Modifier and Type	Method	Description
final String	apiKey()	A valid API key for accessing Groq API.
final String	modelId()	Required - The name of the model to use for the inference task.
static GroqServiceSettings	of(Function<GroqServiceSettings.Builder,ObjectBuilder<GroqServiceSettings>> fn)
final RateLimitSetting	rateLimit()	This setting helps to minimize the number of rate limit errors returned from the Groq API.
GroqServiceSettings.Builder	rebuild()
void	serialize(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)	Serialize this object to JSON.
protected void	serializeInternal(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)
protected static void	setupGroqServiceSettingsDeserializer(ObjectDeserializer<GroqServiceSettings.Builder> op)
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

_DESERIALIZER

public static final JsonpDeserializer<GroqServiceSettings> _DESERIALIZER

Json deserializer for GroqServiceSettings

Method Details

of

public static GroqServiceSettings of(Function<GroqServiceSettings.Builder,ObjectBuilder<GroqServiceSettings>> fn)

modelId

public final String modelId()

Required - The name of the model to use for the inference task. Refer to the Groq model documentation for the list of supported models and versions. Service has been tested and confirmed to be working for completion and chat_completion tasks with the following models:

• llama-3.3-70b-versatile

API name: model_id

apiKey

@Nullable
public final String apiKey()

A valid API key for accessing Groq API.

IMPORTANT: You need to provide the API key only once, during the inference model creation. The get inference endpoint API does not retrieve your API key.

API name: api_key

rateLimit

@Nullable
public final RateLimitSetting rateLimit()

This setting helps to minimize the number of rate limit errors returned from the Groq API. By default, the groq service sets the number of requests allowed per minute to 1000. Refer to Groq documentation for more details.

API name: rate_limit

serialize

public void serialize(jakarta.json.stream.JsonGenerator generator,
 JsonpMapper mapper)

Serialize this object to JSON.

Specified by:

serialize in interface JsonpSerializable

serializeInternal

protected void serializeInternal(jakarta.json.stream.JsonGenerator generator,
 JsonpMapper mapper)

toString

public String toString()

Overrides:

toString in class Object

rebuild

public GroqServiceSettings.Builder rebuild()

Returns:

New GroqServiceSettings.Builder initialized with field values of this instance

setupGroqServiceSettingsDeserializer

protected static void setupGroqServiceSettingsDeserializer(ObjectDeserializer<GroqServiceSettings.Builder> op)