All Classes and Interfaces

Class
Description
Deprecated.
Deprecated.
Thrown if this discoverer was used to discover partitions after it was closed.
Signaling exception to indicate that an actual Kafka call was interrupted.
status of partition assignment.
End modes for the Kafka Consumer.
Deprecated.
ClusterMetadata provides readers information about a cluster on what topics to read and how to connect to a cluster.
Default implementation of KafkaDatasetFacet.
Default implementation of KafkaDatasetIdentifier.
Context providing information to assist constructing a ProducerRecord.
Default implementation of KafkaDatasetFacet.
Factory class for the DynamicKafkaSource components.
A builder class to make it easier for users to construct a DynamicKafkaSource.
This enumerator manages multiple KafkaSourceEnumerator's, which does not have any synchronization since it assumes single threaded execution.
The enumerator state keeps track of the state of the sub enumerators assigned splits and metadata.
(De)serializer for DynamicKafkaSourceEnumState.
The connector options for DynamicKafkaSource that can be passed through the source properties e.g.
Manages state about underlying KafkaSourceReader to collect records and commit offsets from multiple Kafka clusters.
Split that wraps KafkaPartitionSplit with Kafka cluster information.
(De)serializes the DynamicKafkaSourceSplit.
Deprecated.
Deprecated.
Will be turned into internal class when FlinkKafkaProducer is removed.
Deprecated.
Deprecated.
Deprecated.
Will be removed with FlinkKafkaProducer and FlinkKafkaShuffle.
Deprecated.
Will be removed with FlinkKafkaProducer and FlinkKafkaShuffle.
Deprecated.
Deprecated.
Use KafkaPartitioner instead for KafkaSink.
Deprecated.
Please use KafkaSink.
Serializer configuration snapshot for compatibility and format evolution.
Context associated to this instance of the FlinkKafkaProducer.
State for handling transactions.
Keep information required to deduce next safe to use transactional id.
Serializer configuration snapshot for compatibility and format evolution.
Semantics that can be chosen.
Serializer configuration snapshot for compatibility and format evolution.
Deprecated.
This experimental feature never graduated to a stable feature and will be removed in future releases.
Deprecated.
Deprecated.
Flink Kafka Shuffle Serializer.
Event to signal to enumerator that a reader needs to know the current metadata.
Deprecated.
An exception thrown by the Handover in the Handover.pollNext() or Handover.produce(ConsumerRecords) method, after the Handover was closed via Handover.close().
A special exception thrown bv the Handover in the Handover.produce(ConsumerRecords) method when the producer is woken up from a blocking call via Handover.wakeupProducer().
Creates an Iterable of Headers from the input element.
Factory for Jackson mappers.
Deprecated.
A custom proxy metric group in order to group KafkaSourceReaderMetrics by Kafka cluster.
Manages metric groups for each cluster.
Deprecated.
Options for the Kafka connector.
Bounded mode for the Kafka consumer, see KafkaConnectorOptions.SCAN_BOUNDED_MODE.
Startup mode for the Kafka consumer, see KafkaConnectorOptions.SCAN_STARTUP_MODE.
Strategies to derive the data type of a value format by considering a key format.
Deprecated.
Deprecated.
Deprecated.
Will be turned into internal API when FlinkKafkaProducer is removed.
Facet definition to contain all Kafka specific information on Kafka sources and sinks.
Contains method to extract KafkaDatasetFacet.
Kafka dataset identifier which can contain either a list of topics or a topic pattern.
Contains method which allows extracting topic identifier.
Deprecated.
Will be turned into internal API when FlinkKafkaConsumer is removed.
Deprecated.
A version-agnostic Kafka DynamicTableSink.
A version-agnostic Kafka ScanTableSource.
Factory for creating configured instances of KafkaDynamicSource and KafkaDynamicSink.
Deprecated.
Metadata service that returns Kafka details.
Gauge for getting the current value of a Kafka metric.
Deprecated.
Deprecated.
A KafkaPartitioner wraps logic on how to partition records across partitions of multiple Kafka topics.
A SourceSplit for a Kafka partition.
A SplitReader implementation that reads records from Kafka partitions.
This extends to Kafka Partition Split Reader to wrap split ids with the cluster name.
The serializer for KafkaPartitionSplit.
This class extends KafkaPartitionSplit to track a mutable current offset.
Utility class for modify Kafka properties.
An interface for the deserialization of Kafka records.
The RecordEmitter implementation for KafkaSourceReader.
A serialization schema which defines how to convert a value of type T to ProducerRecord.
Context providing information of the kafka record target location.
Builder to construct KafkaRecordSerializationSchema.
Deprecated.
Will be turned into internal API when FlinkKafkaProducer is removed.
Deprecated.
Deprecated.
An element in a KafkaShuffle.
Deserializer for KafkaShuffleElement.
One value with Type T in a KafkaShuffle.
A watermark element in a KafkaShuffle.
Flink Sink to produce data into a Kafka topic.
Builder to construct KafkaSink.
The Source implementation of Kafka.
The builder class for KafkaSource to make it easier for the users to construct a KafkaSource.
The enumerator class for Kafka source.
The implementation for offsets retriever with a consumer and an admin client.
The state of Kafka source enumerator.
The Serializer for the enumerator state of Kafka source.
The SplitFetcherManager for Kafka source.
Configurations for KafkaSource.
The source reader for Kafka partitions.
A collection class for handling metrics in KafkaSourceReader.
Kafka stream represents multiple topics over multiple Kafka clusters and this class encapsulates all the necessary information to initiate Kafka consumers to read a stream.
Subscribe to streams based on the set of ids.
The subscriber interacts with KafkaMetadataService to find which Kafka streams the source will subscribe to.
Kafka consumer allows a few different ways to consume from the topics, including: Subscribe from a collection of topics.
Deprecated.
Will be turned into internal class when FlinkKafkaProducer is removed.
Deprecated.
Deprecated.
Deprecated.
Magic values used to represent special offset states before partitions are actually read.
Deprecated.
Deprecated.
Deprecated.
Deprecated.
Deprecated.
Utility class with useful methods for managing lineage objects.
Signals DynamicKafkaSourceReader to stop their underlying readers.
Collection of methods to interact with Kafka's client metric system.
An implementation of OffsetsInitializer which does not initialize anything.
Deprecated.
Deprecated.
An interface for users to specify the starting / stopping offset of a KafkaPartitionSplit.
An interface that provides necessary information to the OffsetsInitializer to get the initial offsets of the Kafka partitions.
Interface for validating OffsetsInitializer with properties from KafkaSource.
A KafkaMetadataService that delegates metadata fetching to a single AdminClient, which is scoped to a single cluster.
Sink buffer flush configuration.
Deprecated.
Startup modes for the Kafka Consumer.
A proxy enumerator context that supports life cycle management of underlying threads related to a sub KafkaSourceEnumerator.
General exception to signal to internal exception handling mechanisms that a benign error occurred.
This factory exposes a way to override the StoppableKafkaEnumContextProxy used in the enumerator.
To subscribe to streams based on a pattern.
Kafka partition with assign status.
Selects a topic for the incoming record.
Deprecated.
A combination of TwoPhaseCommittingSink and StatefulSink.
A combination of TwoPhaseCommittingSink.PrecommittingSinkWriter and StatefulSink.StatefulSinkWriter.
Facet definition to contain type information of source and sink.
Contains method to extract TypeDatasetFacet.
Deprecated.
Upsert-Kafka factory.
It is used to wrap the decoding format and expose the desired changelog mode.
It is used to wrap the encoding format and expose the desired changelog mode.