zio.kafka.producer

Members list

Type members

Classlikes

trait Producer

Attributes

Companion
object
Supertypes
class Object
trait Matchable
class Any
object Producer

Attributes

Companion
trait
Supertypes
class Object
trait Matchable
class Any
Self type
Producer.type
sealed abstract class ProducerCompression(name: String, extra: Option[(String, AnyRef)])

Attributes

Companion
object
Supertypes
class Object
trait Matchable
class Any
Known subtypes
class Gzip
class Lz4
object NoCompression
class Snappy
class Zstd

The compression codecs that Kafka supports while producing records.

The compression codecs that Kafka supports while producing records.

Attributes

Companion
class
Supertypes
trait Sum
trait Mirror
class Object
trait Matchable
class Any
Self type
sealed trait ProducerEvent

Attributes

Companion
object
Supertypes
class Object
trait Matchable
class Any
Known subtypes
object ProducerEvent

Diagnostics events for the Producer.

Diagnostics events for the Producer.

The producer always handles records in batches. Even single records results in batches of 1. The diagnostic events are therefore always about batches.

For each batch the RecordsOffered event is emitted first, followed by the RecordsSent event. Since batches are queued in the producer and sending one batch might go faster than the previous, the two event types can come in any order. However, the RecordsOffered events are always in the order the batches were offered.

To associate events to a batch you can use the batchId field. This is an ever-increasing number that is unique per producer and starts at 0. When a RecordsOffered and a RecordsSent event are for the same batch, the batchId and records fields have the same value.

Batches of 0 records do not result in events.

Attributes

Companion
trait
Supertypes
trait Sum
trait Mirror
class Object
trait Matchable
class Any
Self type
final case class ProducerSettings(closeTimeout: Duration, sendBufferSize: Int, authErrorRetrySchedule: Schedule[Any, Throwable, Any], properties: Map[String, AnyRef], diagnostics: ProducerDiagnostics, metricLabels: Set[MetricLabel])

Settings for the Producer.

Settings for the Producer.

To stay source compatible with future releases, you are recommended to construct the settings as follows:

 ProducerSettings(bootstrapServers)
   .withLinger(500.millis)
   .withCompression(ProducerCompression.Zstd(3))
   .... etc.

Attributes

Companion
object
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Attributes

Companion
class
Supertypes
trait Product
trait Mirror
class Object
trait Matchable
class Any
Self type
trait Transaction

Attributes

Supertypes
class Object
trait Matchable
class Any

A producer that produces records transactionally.

A producer that produces records transactionally.

Attributes

Companion
object
Supertypes
class Object
trait Matchable
class Any

Attributes

Companion
trait
Supertypes
class Object
trait Matchable
class Any
Self type

Settings for a transactional producer.

Settings for a transactional producer.

To stay source compatible with future releases, you are recommended to construct the settings as follows:

 val producerSettings = ProducerSettings(bootstrapServers)
   .withLinger(500.millis)
   .withCompression(ProducerCompression.Zstd(3))
   .... etc.
 TransactionalProducerSettings(producerSettings, transactionalId)

Attributes

Companion
object
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Show all

Attributes

Companion
class
Supertypes
trait Product
trait Mirror
class Object
trait Matchable
class Any
Self type