All Classes and Interfaces
Class
Description
Deprecated.
Deprecated.
Thrown if this discoverer was used to discover partitions after it was closed.
Signaling exception to indicate that an actual Kafka call was interrupted.
status of partition assignment.
End modes for the Kafka Consumer.
Deprecated.
ClusterMetadata provides readers information about a cluster on what topics to read and
how to connect to a cluster.Default implementation of
KafkaDatasetFacet.Default implementation of
KafkaDatasetIdentifier.Context providing information to assist constructing a
ProducerRecord.Default implementation of
KafkaDatasetFacet.Factory class for the DynamicKafkaSource components.
A builder class to make it easier for users to construct a
DynamicKafkaSource.This enumerator manages multiple
KafkaSourceEnumerator's, which does not have any
synchronization since it assumes single threaded execution.The enumerator state keeps track of the state of the sub enumerators assigned splits and
metadata.
(De)serializer for
DynamicKafkaSourceEnumState.The connector options for
DynamicKafkaSource that can be passed through the source
properties e.g.Manages state about underlying
KafkaSourceReader to collect records and commit offsets
from multiple Kafka clusters.Split that wraps
KafkaPartitionSplit with Kafka cluster information.(De)serializes the
DynamicKafkaSourceSplit.Deprecated.
Deprecated.
Deprecated.
Deprecated.
Deprecated.
Will be removed with
FlinkKafkaProducer and FlinkKafkaShuffle.Deprecated.
Will be removed with
FlinkKafkaProducer and FlinkKafkaShuffle.Deprecated.
Deprecated.
Use
KafkaPartitioner instead for KafkaSink.Deprecated.
Please use
KafkaSink.TypeSerializer for FlinkKafkaProducer.KafkaTransactionContext.Serializer configuration snapshot for compatibility and format evolution.
Context associated to this instance of the
FlinkKafkaProducer.State for handling transactions.
Keep information required to deduce next safe to use transactional id.
TypeSerializer for FlinkKafkaProducer.NextTransactionalIdHint.Serializer configuration snapshot for compatibility and format evolution.
Semantics that can be chosen.
TypeSerializer for FlinkKafkaProducer.KafkaTransactionState.Serializer configuration snapshot for compatibility and format evolution.
Deprecated.
This experimental feature never graduated to a stable feature and will be removed in
future releases.
Deprecated.
Deprecated.
Flink Kafka Shuffle Serializer.
Event to signal to enumerator that a reader needs to know the current metadata.
Deprecated.
An exception thrown by the Handover in the
Handover.pollNext() or Handover.produce(ConsumerRecords) method, after the Handover was closed via Handover.close().A special exception thrown bv the Handover in the
Handover.produce(ConsumerRecords) method
when the producer is woken up from a blocking call via Handover.wakeupProducer().Creates an
Iterable of Headers from the input element.Factory for Jackson mappers.
Deprecated.
A custom proxy metric group in order to group
KafkaSourceReaderMetrics by Kafka cluster.Manages metric groups for each cluster.
Deprecated.
Options for the Kafka connector.
Bounded mode for the Kafka consumer, see
KafkaConnectorOptions.SCAN_BOUNDED_MODE.Startup mode for the Kafka consumer, see
KafkaConnectorOptions.SCAN_STARTUP_MODE.Strategies to derive the data type of a value format by considering a key format.
Deprecated.
Deprecated.
Deprecated.
Will be turned into internal API when
FlinkKafkaProducer is removed.Facet definition to contain all Kafka specific information on Kafka sources and sinks.
Contains method to extract
KafkaDatasetFacet.Kafka dataset identifier which can contain either a list of topics or a topic pattern.
Contains method which allows extracting topic identifier.
Deprecated.
Will be turned into internal API when
FlinkKafkaConsumer is removed.Deprecated.
A version-agnostic Kafka
DynamicTableSink.A version-agnostic Kafka
ScanTableSource.Factory for creating configured instances of
KafkaDynamicSource and KafkaDynamicSink.Deprecated.
Metadata service that returns Kafka details.
Gauge for getting the current value of a Kafka metric.
Deprecated.
Deprecated.
A
KafkaPartitioner wraps logic on how to partition records across partitions of multiple
Kafka topics.A
SourceSplit for a Kafka partition.A
SplitReader implementation that reads records from Kafka partitions.This extends to Kafka Partition Split Reader to wrap split ids with the cluster name.
The
serializer for KafkaPartitionSplit.This class extends KafkaPartitionSplit to track a mutable current offset.
Utility class for modify Kafka properties.
An interface for the deserialization of Kafka records.
The
RecordEmitter implementation for KafkaSourceReader.A serialization schema which defines how to convert a value of type
T to ProducerRecord.Context providing information of the kafka record target location.
Builder to construct
KafkaRecordSerializationSchema.Deprecated.
Will be turned into internal API when
FlinkKafkaProducer is removed.Deprecated.
Deprecated.
An element in a KafkaShuffle.
Deserializer for KafkaShuffleElement.
One value with Type T in a KafkaShuffle.
A watermark element in a KafkaShuffle.
Flink Sink to produce data into a Kafka topic.
Builder to construct
KafkaSink.The Source implementation of Kafka.
The builder class for
KafkaSource to make it easier for the users to construct a KafkaSource.The enumerator class for Kafka source.
The implementation for offsets retriever with a consumer and an admin client.
The state of Kafka source enumerator.
The
Serializer for the enumerator
state of Kafka source.The SplitFetcherManager for Kafka source.
Configurations for KafkaSource.
The source reader for Kafka partitions.
A collection class for handling metrics in
KafkaSourceReader.Kafka stream represents multiple topics over multiple Kafka clusters and this class encapsulates
all the necessary information to initiate Kafka consumers to read a stream.
Subscribe to streams based on the set of ids.
The subscriber interacts with
KafkaMetadataService to find which Kafka streams the source
will subscribe to.Kafka consumer allows a few different ways to consume from the topics, including:
Subscribe from a collection of topics.
Deprecated.
Will be turned into internal class when
FlinkKafkaProducer is removed.A
Comparator for KafkaTopicPartitions.Deprecated.
Deprecated.
Deprecated.
Magic values used to represent special offset states before partitions are actually read.
Deprecated.
Deprecated.
Deprecated.
Deprecated.
Deprecated.
Utility class with useful methods for managing lineage objects.
Signals
DynamicKafkaSourceReader to stop their underlying readers.Collection of methods to interact with Kafka's client metric system.
An implementation of
OffsetsInitializer which does not initialize anything.Deprecated.
Deprecated.
An interface for users to specify the starting / stopping offset of a
KafkaPartitionSplit.An interface that provides necessary information to the
OffsetsInitializer to get the
initial offsets of the Kafka partitions.Interface for validating
OffsetsInitializer with properties from KafkaSource.A
KafkaMetadataService that delegates metadata fetching to a single AdminClient,
which is scoped to a single cluster.Sink buffer flush configuration.
Deprecated.
Startup modes for the Kafka Consumer.
A proxy enumerator context that supports life cycle management of underlying threads related to a
sub
KafkaSourceEnumerator.General exception to signal to internal exception handling mechanisms that a benign error
occurred.
This factory exposes a way to override the
StoppableKafkaEnumContextProxy used in the
enumerator.To subscribe to streams based on a pattern.
Kafka partition with assign status.
Selects a topic for the incoming record.
Deprecated.
A combination of
TwoPhaseCommittingSink and StatefulSink.A combination of
TwoPhaseCommittingSink.PrecommittingSinkWriter and StatefulSink.StatefulSinkWriter.Facet definition to contain type information of source and sink.
Contains method to extract
TypeDatasetFacet.Deprecated.
Upsert-Kafka factory.
It is used to wrap the decoding format and expose the desired changelog mode.
It is used to wrap the encoding format and expose the desired changelog mode.
FlinkKafkaProduceris removed.