Index

A B C D E F G H I J K L M N O P R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

abort(FlinkKafkaProducer.KafkaTransactionState) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

abortTransaction() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

AbstractFetcher<T,KPH> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

AbstractFetcher(SourceFunction.SourceContext<T>, Map<KafkaTopicPartition, Long>, SerializedValue<WatermarkStrategy<T>>, ProcessingTimeService, long, ClassLoader, MetricGroup, boolean) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

AbstractPartitionDiscoverer - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

AbstractPartitionDiscoverer(KafkaTopicsDescriptor, int, int) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

AbstractPartitionDiscoverer.ClosedException - Exception Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

Thrown if this discoverer was used to discover partitions after it was closed.

AbstractPartitionDiscoverer.WakeupException - Exception Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

Signaling exception to indicate that an actual Kafka call was interrupted.

acknowledgeMessage() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

ATTENTION to subclass implementors: When overriding this method, please always call super.acknowledgeMessage() to keep the invariants of the internal bookkeeping of the producer.

add(E) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Adds the element to the queue, or fails with an exception, if the queue is closed.

addDiscoveredPartitions(List<KafkaTopicPartition>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

Adds a list of newly discovered partitions to the fetcher for consuming.

addGroup(String) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

addGroup(String, String) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

addIfOpen(E) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Tries to add an element to the queue, if the queue is still open.

addReader(int) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumerator

NOTE: this happens at startup and failover.

addReader(int) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator

addSplits(List<DynamicKafkaSourceSplit>) - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

addSplitsBack(List<DynamicKafkaSourceSplit>, int) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumerator

addSplitsBack(List<KafkaPartitionSplit>, int) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator

adjustAutoCommitConfig(Properties, OffsetCommitMode) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Make sure that auto commit is disabled when our offset commit mode is ON_CHECKPOINTS.

ALL - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ValueFieldsStrategy

applyReadableMetadata(List<String>, DataType) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

applyWatermark(WatermarkStrategy<RowData>) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

applyWritableMetadata(List<String>, DataType) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

asRecord() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleElement

Deprecated.

assign(String, int, int) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionAssigner

Deprecated.

assign(KafkaTopicPartition, int) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionAssigner

Deprecated.

Returns the index of the target subtask that a specific Kafka partition should be assigned to.

ASSIGNED - Enum constant in enum class org.apache.flink.connector.kafka.source.enumerator.AssignmentStatus

Partitions that have been assigned to readers.

assignedPartitions() - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumState

assignmentStatus() - Method in class org.apache.flink.connector.kafka.source.enumerator.TopicPartitionAndAssignmentStatus

AssignmentStatus - Enum Class in org.apache.flink.connector.kafka.source.enumerator

status of partition assignment.

assignSplits(SplitsAssignment<KafkaPartitionSplit>) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

Wrap splits with cluster metadata.

assignTimestampsAndWatermarks(WatermarkStrategy<T>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Sets the given WatermarkStrategy on this consumer.

assignTimestampsAndWatermarks(AssignerWithPeriodicWatermarks<T>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Please use FlinkKafkaConsumerBase.assignTimestampsAndWatermarks(WatermarkStrategy) instead.

assignTimestampsAndWatermarks(AssignerWithPunctuatedWatermarks<T>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Please use FlinkKafkaConsumerBase.assignTimestampsAndWatermarks(WatermarkStrategy) instead.

asSummaryString() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

asSummaryString() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

asWatermark() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleElement

Deprecated.

asyncException - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Errors encountered in the async producer are stored here.

AT_LEAST_ONCE - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.Semantic

Deprecated.

Semantic.AT_LEAST_ONCE the Flink producer will wait for all outstanding messages in the Kafka buffers to be acknowledged by the Kafka producer on a checkpoint.

B

beginningOffsets(Collection<TopicPartition>) - Method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer.PartitionOffsetsRetriever

List beginning offsets for the specified partitions.

beginningOffsets(Collection<TopicPartition>) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl

beginTransaction() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

beginTransaction() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

boundedMode - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

The bounded mode for the contained consumer (default is an unbounded data stream).

BoundedMode - Enum Class in org.apache.flink.streaming.connectors.kafka.config

End modes for the Kafka Consumer.

boundedTimestampMillis - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

The bounded timestamp to locate partition offsets; only relevant when bounded mode is BoundedMode.TIMESTAMP.

build() - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Construct the source with the configuration that was set.

build() - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Constructs the KafkaRecordSerializationSchemaBuilder with the configured properties.

build() - Method in class org.apache.flink.connector.kafka.sink.KafkaSinkBuilder

Constructs the KafkaSink with the configured properties.

build() - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Build the KafkaSource.

builder() - Static method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSource

Get a builder for this source.

builder() - Static method in interface org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchema

Creates a default schema builder to provide common building blocks i.e.

builder() - Static method in class org.apache.flink.connector.kafka.sink.KafkaSink

Create a KafkaSinkBuilder to construct a new KafkaSink.

builder() - Static method in class org.apache.flink.connector.kafka.source.KafkaSource

Get a kafkaSourceBuilder to build a KafkaSource.

BYTES_CONSUMED_TOTAL - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

C

callAsync(Callable<T>, BiConsumer<T, Throwable>) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

Execute the one time callables in the coordinator.

callAsync(Callable<T>, BiConsumer<T, Throwable>, long, long) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

Schedule task via internal thread pool to proxy task so that the task handler callback can execute in the single threaded source coordinator thread pool to avoid synchronization needs.

callback - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

The callback than handles error propagation or logging callbacks.

cancel() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

cancel() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

cancel() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher

Deprecated.

checkAndThrowException() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ExceptionProxy

Deprecated.

Checks whether an exception has been set via ExceptionProxy.reportError(Throwable).

checkErroneous() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

checkpointLock - Variable in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

The lock that guarantees that record emission and state updates are atomic, from the view of taking a checkpoint.

CLIENT_ID_PREFIX - Static variable in class org.apache.flink.connector.kafka.source.KafkaSourceOptions

ClosableBlockingQueue<E> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

ClosableBlockingQueue() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Creates a new empty queue.

ClosableBlockingQueue(int) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Creates a new empty queue, reserving space for at least the specified number of elements.

ClosableBlockingQueue(Collection<? extends E>) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Creates a new queue that contains the given elements.

close() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.SingleClusterTopicMetadataService

close() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumerator

close() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

Note that we can't close the source coordinator here, because these contexts can be closed during metadata change when the coordinator still needs to continue to run.

close() - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroupManager

close() - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

close() - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator

close() - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl

close() - Method in class org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader

close() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

close() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Closes the partition discoverer, cleaning up all Kafka connections.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Tries to close the queue.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.Handover

Deprecated.

Closes the handover.

close(String) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroupManager

close(Duration) - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

closeConnections() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Close all established connections.

closeConnections() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaPartitionDiscoverer

Deprecated.

ClosedException() - Constructor for exception class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer.ClosedException

Deprecated.

ClosedException() - Constructor for exception class org.apache.flink.streaming.connectors.kafka.internals.Handover.ClosedException

Deprecated.

ClusterMetadata - Class in org.apache.flink.connector.kafka.dynamic.metadata

ClusterMetadata provides readers information about a cluster on what topics to read and how to connect to a cluster.

ClusterMetadata(Set<String>, Properties) - Constructor for class org.apache.flink.connector.kafka.dynamic.metadata.ClusterMetadata

Constructs the ClusterMetadata with the required properties.

commit(FlinkKafkaProducer.KafkaTransactionState) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

COMMIT_OFFSETS_ON_CHECKPOINT - Static variable in class org.apache.flink.connector.kafka.source.KafkaSourceOptions

commitInternalOffsetsToKafka(Map<KafkaTopicPartition, Long>, KafkaCommitCallback) - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

Commits the given partition offsets to the Kafka brokers (or to ZooKeeper for older Kafka versions).

commitOffsets(Map<TopicPartition, OffsetAndMetadata>, OffsetCommitCallback) - Method in class org.apache.flink.connector.kafka.source.reader.fetcher.KafkaSourceFetcherManager

COMMITS_FAILED_METRIC_COUNTER - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

COMMITS_FAILED_METRICS_COUNTER - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

COMMITS_SUCCEEDED_METRIC_COUNTER - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

COMMITS_SUCCEEDED_METRICS_COUNTER - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

COMMITTED_OFFSET - Static variable in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

COMMITTED_OFFSET_METRIC_GAUGE - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

COMMITTED_OFFSETS_METRICS_GAUGE - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

committedOffsets() - Static method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer

Get an OffsetsInitializer which initializes the offsets to the committed offsets.

committedOffsets(Collection<TopicPartition>) - Method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer.PartitionOffsetsRetriever

The group id should be the set for KafkaSource before invoking this method.

committedOffsets(Collection<TopicPartition>) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl

committedOffsets(OffsetResetStrategy) - Static method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer

Get an OffsetsInitializer which initializes the offsets to the committed offsets.

commitTransaction() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

Comparator() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition.Comparator

Deprecated.

compare(KafkaTopicPartition, KafkaTopicPartition) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition.Comparator

Deprecated.

consumedDataType - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Data type of consumed data type.

CONSUMER_FETCH_MANAGER_GROUP - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

ContextStateSerializer() - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

ContextStateSerializerSnapshot() - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer.ContextStateSerializerSnapshot

Deprecated.

copy() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

copy() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

copy(DataInputView, DataOutputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

copy(DataInputView, DataOutputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

copy(DataInputView, DataOutputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

copy(FlinkKafkaProducer.KafkaTransactionContext) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

copy(FlinkKafkaProducer.KafkaTransactionContext, FlinkKafkaProducer.KafkaTransactionContext) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

copy(FlinkKafkaProducer.KafkaTransactionState) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

copy(FlinkKafkaProducer.KafkaTransactionState, FlinkKafkaProducer.KafkaTransactionState) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

copy(FlinkKafkaProducer.NextTransactionalIdHint) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

copy(FlinkKafkaProducer.NextTransactionalIdHint, FlinkKafkaProducer.NextTransactionalIdHint) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

copyProperties(Properties, Properties) - Static method in class org.apache.flink.connector.kafka.source.KafkaPropertiesUtil

counter(String) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

counter(String, C) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

create(SplitEnumeratorContext<DynamicKafkaSourceSplit>, String, KafkaMetadataService, Runnable) - Method in interface org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy.StoppableKafkaEnumContextProxyFactory

createCommitter() - Method in class org.apache.flink.connector.kafka.sink.KafkaSink

createDynamicTableSink(DynamicTableFactory.Context) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

createDynamicTableSink(DynamicTableFactory.Context) - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory

createDynamicTableSource(DynamicTableFactory.Context) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

createDynamicTableSource(DynamicTableFactory.Context) - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory

createEnumerator(SplitEnumeratorContext<DynamicKafkaSourceSplit>) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSource

Create the DynamicKafkaSourceEnumerator.

createEnumerator(SplitEnumeratorContext<KafkaPartitionSplit>) - Method in class org.apache.flink.connector.kafka.source.KafkaSource

createFetcher(SourceFunction.SourceContext<T>, Map<KafkaTopicPartition, Long>, SerializedValue<WatermarkStrategy<T>>, StreamingRuntimeContext, OffsetCommitMode, MetricGroup, boolean) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

createFetcher(SourceFunction.SourceContext<T>, Map<KafkaTopicPartition, Long>, SerializedValue<WatermarkStrategy<T>>, StreamingRuntimeContext, OffsetCommitMode, MetricGroup, boolean) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Creates the fetcher that connect to the Kafka brokers, pulls data, deserialized the data, and emits it into the data streams.

createFetcher(SourceFunction.SourceContext<T>, Map<KafkaTopicPartition, Long>, SerializedValue<WatermarkStrategy<T>>, StreamingRuntimeContext, OffsetCommitMode, MetricGroup, boolean) - Method in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffleConsumer

Deprecated.

createInstance() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

createInstance() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

createInstance() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

createKafkaPartitionHandle(KafkaTopicPartition) - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

Creates the Kafka version specific representation of the given topic partition.

createKafkaPartitionHandle(KafkaTopicPartition) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher

Deprecated.

createKafkaSource(DeserializationSchema<RowData>, DeserializationSchema<RowData>, TypeInformation<RowData>) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

createKafkaTableSink(DataType, EncodingFormat<SerializationSchema<RowData>>, EncodingFormat<SerializationSchema<RowData>>, int[], int[], String, List<String>, Pattern, Properties, KafkaPartitioner<RowData>, DeliveryGuarantee, Integer, String) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

createKafkaTableSource(DataType, DecodingFormat<DeserializationSchema<RowData>>, DecodingFormat<DeserializationSchema<RowData>>, int[], int[], String, List<String>, Pattern, Properties, StartupMode, Map<KafkaTopicPartition, Long>, long, BoundedMode, Map<KafkaTopicPartition, Long>, long, String) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

createObjectMapper() - Static method in class org.apache.flink.connector.kafka.util.JacksonMapperFactory

createObjectMapper(JsonFactory) - Static method in class org.apache.flink.connector.kafka.util.JacksonMapperFactory

createPartitionDiscoverer(KafkaTopicsDescriptor, int, int) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

createPartitionDiscoverer(KafkaTopicsDescriptor, int, int) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Creates the partition discoverer that is used to find new partitions for this subtask.

createProducer() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

createReader(SourceReaderContext) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSource

Create the DynamicKafkaSourceReader.

createReader(SourceReaderContext) - Method in class org.apache.flink.connector.kafka.source.KafkaSource

createRuntimeDecoder(DynamicTableSource.Context, DataType) - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.DecodingFormatWrapper

createRuntimeEncoder(DynamicTableSink.Context, DataType) - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.EncodingFormatWrapper

createWriter(Sink.InitContext) - Method in class org.apache.flink.connector.kafka.sink.KafkaSink

createWriter(Sink.InitContext) - Method in interface org.apache.flink.connector.kafka.sink.TwoPhaseCommittingStatefulSink

CURRENT_OFFSET_METRIC_GAUGE - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

CURRENT_OFFSETS_METRICS_GAUGE - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

currentParallelism() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

D

datasetOf(String, KafkaDatasetFacet) - Static method in class org.apache.flink.connector.kafka.lineage.LineageUtil

datasetOf(String, KafkaDatasetFacet, TypeDatasetFacet) - Static method in class org.apache.flink.connector.kafka.lineage.LineageUtil

DecodingFormatWrapper(DecodingFormat<DeserializationSchema<RowData>>) - Constructor for class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.DecodingFormatWrapper

DEFAULT_KAFKA_PRODUCERS_POOL_SIZE - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Default number of KafkaProducers in the pool.

DEFAULT_KAFKA_TRANSACTION_TIMEOUT - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Default value for kafka transaction timeout.

DEFAULT_POLL_TIMEOUT - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

From Kafka's Javadoc: The time, in milliseconds, spent waiting in poll if data is not available.

DefaultKafkaDatasetFacet - Class in org.apache.flink.connector.kafka.lineage

Default implementation of KafkaDatasetFacet.

DefaultKafkaDatasetFacet(KafkaDatasetIdentifier) - Constructor for class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetFacet

DefaultKafkaDatasetFacet(KafkaDatasetIdentifier, Properties) - Constructor for class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetFacet

DefaultKafkaDatasetIdentifier - Class in org.apache.flink.connector.kafka.lineage

Default implementation of KafkaDatasetIdentifier.

DefaultKafkaSinkContext - Class in org.apache.flink.connector.kafka.sink

Context providing information to assist constructing a ProducerRecord.

DefaultKafkaSinkContext(int, int, Properties) - Constructor for class org.apache.flink.connector.kafka.sink.DefaultKafkaSinkContext

defaultTopicId - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

The name of the default topic this producer is writing data to.

DefaultTypeDatasetFacet - Class in org.apache.flink.connector.kafka.lineage

Default implementation of KafkaDatasetFacet.

DefaultTypeDatasetFacet(TypeInformation) - Constructor for class org.apache.flink.connector.kafka.lineage.DefaultTypeDatasetFacet

DELIVERY_GUARANTEE - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

describeStreams(Collection<String>) - Method in interface org.apache.flink.connector.kafka.dynamic.metadata.KafkaMetadataService

Get current metadata for queried streams.

describeStreams(Collection<String>) - Method in class org.apache.flink.connector.kafka.dynamic.metadata.SingleClusterTopicMetadataService

Get current metadata for queried streams.

deserialize(byte[], byte[], String, int, long) - Method in interface org.apache.flink.streaming.util.serialization.KeyedDeserializationSchema

Deprecated.

Deserializes the byte message.

deserialize(int, byte[]) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumStateSerializer

deserialize(int, byte[]) - Method in class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplitSerializer

deserialize(int, byte[]) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumStateSerializer

deserialize(int, byte[]) - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplitSerializer

deserialize(DataInputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

deserialize(DataInputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

deserialize(DataInputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

deserialize(FlinkKafkaProducer.KafkaTransactionContext, DataInputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

deserialize(FlinkKafkaProducer.KafkaTransactionState, DataInputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

deserialize(FlinkKafkaProducer.NextTransactionalIdHint, DataInputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

deserialize(ConsumerRecord<byte[], byte[]>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaDeserializationSchemaWrapper

Deprecated.

deserialize(ConsumerRecord<byte[], byte[]>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleElementDeserializer

Deprecated.

deserialize(ConsumerRecord<byte[], byte[]>) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema

Deprecated.

Deserializes the Kafka record.

deserialize(ConsumerRecord<byte[], byte[]>) - Method in class org.apache.flink.streaming.util.serialization.JSONKeyValueDeserializationSchema

Deprecated.

deserialize(ConsumerRecord<byte[], byte[]>) - Method in interface org.apache.flink.streaming.util.serialization.KeyedDeserializationSchema

Deprecated.

deserialize(ConsumerRecord<byte[], byte[]>) - Method in class org.apache.flink.streaming.util.serialization.TypeInformationKeyValueSerializationSchema

Deprecated.

deserialize(ConsumerRecord<byte[], byte[]>, Collector<T>) - Method in interface org.apache.flink.connector.kafka.source.reader.deserializer.KafkaRecordDeserializationSchema

Deserializes the byte message.

deserialize(ConsumerRecord<byte[], byte[]>, Collector<T>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaDeserializationSchemaWrapper

Deprecated.

deserialize(ConsumerRecord<byte[], byte[]>, Collector<T>) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema

Deprecated.

Deserializes the Kafka record.

deserializer - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

The schema to convert between Kafka's byte messages, and Flink's objects.

DISABLED - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.OffsetCommitMode

Deprecated.

Completely disable offset committing.

DISABLED - Static variable in class org.apache.flink.streaming.connectors.kafka.table.SinkBufferFlushMode

disableFilterRestoredPartitionsWithSubscribedTopics() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

By default, when restoring from a checkpoint / savepoint, the consumer always ignores restored partitions that are no longer associated with the current specified topics or topic pattern to subscribe to.

discoverPartitions() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Execute a partition discovery attempt for this subtask.

doCommitInternalOffsetsToKafka(Map<KafkaTopicPartition, Long>, KafkaCommitCallback) - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

doCommitInternalOffsetsToKafka(Map<KafkaTopicPartition, Long>, KafkaCommitCallback) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher

Deprecated.

dropLeaderData(List<KafkaTopicPartitionLeader>) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition

Deprecated.

DYNAMIC_KAFKA_SOURCE_METRIC_GROUP - Static variable in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

DynamicKafkaSource<T> - Class in org.apache.flink.connector.kafka.dynamic.source

Factory class for the DynamicKafkaSource components.

DynamicKafkaSourceBuilder<T> - Class in org.apache.flink.connector.kafka.dynamic.source

A builder class to make it easier for users to construct a DynamicKafkaSource.

DynamicKafkaSourceEnumerator - Class in org.apache.flink.connector.kafka.dynamic.source.enumerator

This enumerator manages multiple KafkaSourceEnumerator's, which does not have any synchronization since it assumes single threaded execution.

DynamicKafkaSourceEnumerator(KafkaStreamSubscriber, KafkaMetadataService, SplitEnumeratorContext<DynamicKafkaSourceSplit>, OffsetsInitializer, OffsetsInitializer, Properties, Boundedness, DynamicKafkaSourceEnumState) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumerator

DynamicKafkaSourceEnumState - Class in org.apache.flink.connector.kafka.dynamic.source.enumerator

The enumerator state keeps track of the state of the sub enumerators assigned splits and metadata.

DynamicKafkaSourceEnumState() - Constructor for class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumState

DynamicKafkaSourceEnumState(Set<KafkaStream>, Map<String, KafkaSourceEnumState>) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumState

DynamicKafkaSourceEnumStateSerializer - Class in org.apache.flink.connector.kafka.dynamic.source.enumerator

(De)serializer for DynamicKafkaSourceEnumState.

DynamicKafkaSourceEnumStateSerializer() - Constructor for class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumStateSerializer

DynamicKafkaSourceOptions - Class in org.apache.flink.connector.kafka.dynamic.source

The connector options for DynamicKafkaSource that can be passed through the source properties e.g.

DynamicKafkaSourceReader<T> - Class in org.apache.flink.connector.kafka.dynamic.source.reader

Manages state about underlying KafkaSourceReader to collect records and commit offsets from multiple Kafka clusters.

DynamicKafkaSourceReader(SourceReaderContext, KafkaRecordDeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

DynamicKafkaSourceSplit - Class in org.apache.flink.connector.kafka.dynamic.source.split

Split that wraps KafkaPartitionSplit with Kafka cluster information.

DynamicKafkaSourceSplit(String, KafkaPartitionSplit) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplit

DynamicKafkaSourceSplitSerializer - Class in org.apache.flink.connector.kafka.dynamic.source.split

(De)serializes the DynamicKafkaSourceSplit.

DynamicKafkaSourceSplitSerializer() - Constructor for class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplitSerializer

E

earliest() - Static method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer

Get an OffsetsInitializer which initializes the offsets to the earliest available offsets of each partition.

EARLIEST - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.StartupMode

Start from the earliest offset possible.

EARLIEST_OFFSET - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanStartupMode

EARLIEST_OFFSET - Static variable in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

EARLIEST_OFFSET - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateSentinel

Magic number that defines the partition should start from the earliest offset.

emitRecord(ConsumerRecord<byte[], byte[]>, SourceOutput<T>, KafkaPartitionSplitState) - Method in class org.apache.flink.connector.kafka.source.reader.KafkaRecordEmitter

emitRecordsWithTimestamps(Queue<T>, KafkaTopicPartitionState<T, KPH>, long, long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

Emits a record attaching a timestamp to it.

emitWatermark(Watermark) - Method in class org.apache.flink.streaming.connectors.kafka.internals.SourceContextWatermarkOutputAdapter

Deprecated.

EncodingFormatWrapper(EncodingFormat<SerializationSchema<RowData>>) - Constructor for class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.EncodingFormatWrapper

endOffsets(Collection<TopicPartition>) - Method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer.PartitionOffsetsRetriever

List end offsets for the specified partitions.

endOffsets(Collection<TopicPartition>) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl

equals(Object) - Method in class org.apache.flink.connector.kafka.dynamic.metadata.ClusterMetadata

equals(Object) - Method in class org.apache.flink.connector.kafka.dynamic.metadata.KafkaStream

equals(Object) - Method in class org.apache.flink.connector.kafka.dynamic.source.MetadataUpdateEvent

equals(Object) - Method in class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplit

equals(Object) - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetFacet

equals(Object) - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetIdentifier

equals(Object) - Method in class org.apache.flink.connector.kafka.lineage.DefaultTypeDatasetFacet

equals(Object) - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionContext

Deprecated.

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionState

Deprecated.

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHint

Deprecated.

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition

Deprecated.

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionLeader

Deprecated.

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.partitioner.FlinkFixedPartitioner

Deprecated.

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.table.SinkBufferFlushMode

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.DecodingFormatWrapper

equals(Object) - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.EncodingFormatWrapper

EXACTLY_ONCE - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.Semantic

Deprecated.

Semantic.EXACTLY_ONCE the Flink producer will write all messages in a Kafka transaction that will be committed to Kafka on a checkpoint.

EXCEPT_KEY - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ValueFieldsStrategy

ExceptionProxy - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

ExceptionProxy(Thread) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ExceptionProxy

Deprecated.

Creates an exception proxy that interrupts the given thread upon report of an exception.

EXTERNAL_ERROR - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.FlinkKafkaErrorCode

Deprecated.

extractTimestamp(T, long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

extractTimestamp(T, long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateWithWatermarkGenerator

Deprecated.

F

factoryIdentifier() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

factoryIdentifier() - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory

fetch() - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.KafkaPartitionSplitReaderWrapper

fetch() - Method in class org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader

fetchOffsetsWithTimestamp(Collection<KafkaTopicPartition>, long) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

fetchOffsetsWithTimestamp(Collection<KafkaTopicPartition>, long) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Fewer Flink partitions than Kafka - Search tag in class org.apache.flink.streaming.connectors.kafka.partitioner.FlinkFixedPartitioner

Section

finishProcessing(FlinkKafkaProducer.KafkaTransactionState) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

finishRecoveringContext(Collection<FlinkKafkaProducer.KafkaTransactionState>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

FlinkFixedPartitioner<T> - Class in org.apache.flink.streaming.connectors.kafka.partitioner

Deprecated.

Will be turned into internal class when FlinkKafkaProducer is removed.

FlinkFixedPartitioner() - Constructor for class org.apache.flink.streaming.connectors.kafka.partitioner.FlinkFixedPartitioner

Deprecated.

FlinkKafkaConsumer<T> - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

FlinkKafkaConsumer(String, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

Creates a new Kafka streaming source consumer.

FlinkKafkaConsumer(String, KafkaDeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

Creates a new Kafka streaming source consumer.

FlinkKafkaConsumer(List<String>, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

Creates a new Kafka streaming source consumer.

FlinkKafkaConsumer(List<String>, KafkaDeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

Creates a new Kafka streaming source consumer.

FlinkKafkaConsumer(Pattern, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

Creates a new Kafka streaming source consumer.

FlinkKafkaConsumer(Pattern, KafkaDeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

Creates a new Kafka streaming source consumer.

FlinkKafkaConsumerBase<T> - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

FlinkKafkaConsumerBase(List<String>, Pattern, KafkaDeserializationSchema<T>, long, boolean) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Base constructor.

FlinkKafkaErrorCode - Enum Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

Will be removed with FlinkKafkaProducer and FlinkKafkaShuffle.

FlinkKafkaException - Exception Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

Will be removed with FlinkKafkaProducer and FlinkKafkaShuffle.

FlinkKafkaException(FlinkKafkaErrorCode, String) - Constructor for exception class org.apache.flink.streaming.connectors.kafka.FlinkKafkaException

Deprecated.

FlinkKafkaException(FlinkKafkaErrorCode, String, Throwable) - Constructor for exception class org.apache.flink.streaming.connectors.kafka.FlinkKafkaException

Deprecated.

FlinkKafkaInternalProducer<K,V> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

FlinkKafkaInternalProducer(Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

FlinkKafkaPartitioner<T> - Class in org.apache.flink.streaming.connectors.kafka.partitioner

Deprecated.

Use KafkaPartitioner instead for KafkaSink.

FlinkKafkaPartitioner() - Constructor for class org.apache.flink.streaming.connectors.kafka.partitioner.FlinkKafkaPartitioner

Deprecated.

FlinkKafkaProducer<IN> - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

Please use KafkaSink.

FlinkKafkaProducer(String, String, SerializationSchema<IN>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer(String, String, KeyedSerializationSchema<IN>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

use FlinkKafkaProducer(String, KafkaSerializationSchema, Properties, Semantic)

FlinkKafkaProducer(String, SerializationSchema<IN>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer(String, SerializationSchema<IN>, Properties, Optional<FlinkKafkaPartitioner<IN>>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer(String, SerializationSchema<IN>, Properties, FlinkKafkaPartitioner<IN>, FlinkKafkaProducer.Semantic, int) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer(String, KafkaSerializationSchema<IN>, Properties, FlinkKafkaProducer.Semantic) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer(String, KafkaSerializationSchema<IN>, Properties, FlinkKafkaProducer.Semantic, int) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer(String, KeyedSerializationSchema<IN>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

use FlinkKafkaProducer(String, KafkaSerializationSchema, Properties, Semantic)

FlinkKafkaProducer(String, KeyedSerializationSchema<IN>, Properties, Optional<FlinkKafkaPartitioner<IN>>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

use FlinkKafkaProducer(String, KafkaSerializationSchema, Properties, Semantic)

FlinkKafkaProducer(String, KeyedSerializationSchema<IN>, Properties, Optional<FlinkKafkaPartitioner<IN>>, FlinkKafkaProducer.Semantic, int) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

use FlinkKafkaProducer(String, KafkaSerializationSchema, Properties, Semantic)

FlinkKafkaProducer(String, KeyedSerializationSchema<IN>, Properties, FlinkKafkaProducer.Semantic) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

use FlinkKafkaProducer(String, KafkaSerializationSchema, Properties, Semantic)

FlinkKafkaProducer.ContextStateSerializer - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

TypeSerializer for FlinkKafkaProducer.KafkaTransactionContext.

FlinkKafkaProducer.ContextStateSerializer.ContextStateSerializerSnapshot - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

Serializer configuration snapshot for compatibility and format evolution.

FlinkKafkaProducer.KafkaTransactionContext - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

Context associated to this instance of the FlinkKafkaProducer.

FlinkKafkaProducer.KafkaTransactionState - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

State for handling transactions.

FlinkKafkaProducer.NextTransactionalIdHint - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

Keep information required to deduce next safe to use transactional id.

FlinkKafkaProducer.NextTransactionalIdHintSerializer - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

TypeSerializer for FlinkKafkaProducer.NextTransactionalIdHint.

FlinkKafkaProducer.NextTransactionalIdHintSerializer.NextTransactionalIdHintSerializerSnapshot - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

Serializer configuration snapshot for compatibility and format evolution.

FlinkKafkaProducer.Semantic - Enum Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

Semantics that can be chosen.

FlinkKafkaProducer.TransactionStateSerializer - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

TypeSerializer for FlinkKafkaProducer.KafkaTransactionState.

FlinkKafkaProducer.TransactionStateSerializer.TransactionStateSerializerSnapshot - Class in org.apache.flink.streaming.connectors.kafka

Deprecated.

Serializer configuration snapshot for compatibility and format evolution.

FlinkKafkaShuffle - Class in org.apache.flink.streaming.connectors.kafka.shuffle

Deprecated.

This experimental feature never graduated to a stable feature and will be removed in future releases. In case of interest to port it to the Source/Sink API, please reach out to the Flink community.

FlinkKafkaShuffle() - Constructor for class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffle

Deprecated.

FlinkKafkaShuffleConsumer<T> - Class in org.apache.flink.streaming.connectors.kafka.shuffle

Deprecated.

FlinkKafkaShuffleProducer<IN,KEY> - Class in org.apache.flink.streaming.connectors.kafka.shuffle

Deprecated.

FlinkKafkaShuffleProducer.KafkaSerializer<IN> - Class in org.apache.flink.streaming.connectors.kafka.shuffle

Deprecated.

Flink Kafka Shuffle Serializer.

flush() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

flushMode - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Sink buffer flush config which only supported in upsert mode now.

forwardOptions() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

forwardOptions() - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory

fromConfiguration(boolean, boolean, boolean) - Static method in class org.apache.flink.streaming.connectors.kafka.config.OffsetCommitModes

Deprecated.

Determine the offset commit mode using several configuration values.

G

gauge(String, G) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

generateIdsToAbort() - Method in class org.apache.flink.streaming.connectors.kafka.internals.TransactionalIdsGenerator

Deprecated.

If we have to abort previous transactional id in case of restart after a failure BEFORE first checkpoint completed, we don't know what was the parallelism used in previous attempt.

generateIdsToUse(long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.TransactionalIdsGenerator

Deprecated.

Range of available transactional ids to use is: [nextFreeTransactionalId, nextFreeTransactionalId + parallelism * kafkaProducersPoolSize) loop below picks in a deterministic way a subrange of those available transactional ids based on index of this subtask.

getAllPartitionsForTopics(List<String>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Fetch the list of all partitions for a specific topics list from Kafka.

getAllPartitionsForTopics(List<String>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaPartitionDiscoverer

Deprecated.

getAllStreams() - Method in interface org.apache.flink.connector.kafka.dynamic.metadata.KafkaMetadataService

Get current metadata for all streams.

getAllStreams() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.SingleClusterTopicMetadataService

Get current metadata for all streams.

getAllTopics() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Fetch the list of all topics from Kafka.

getAllTopics() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaPartitionDiscoverer

Deprecated.

getAllVariables() - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

getAutoOffsetResetStrategy() - Method in class org.apache.flink.connector.kafka.source.enumerator.initializer.NoStoppingOffsetsInitializer

getAutoOffsetResetStrategy() - Method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer

Get the auto offset reset strategy in case the initialized offsets falls out of the range.

getAvailabilityHelper() - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

getBatchBlocking() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Gets all the elements found in the list, or blocks until at least one element was added.

getBatchBlocking(long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Gets all the elements found in the list, or blocks until at least one element was added.

getBatchIntervalMs() - Method in class org.apache.flink.streaming.connectors.kafka.table.SinkBufferFlushMode

getBatchSize() - Method in class org.apache.flink.streaming.connectors.kafka.table.SinkBufferFlushMode

getBoundedness() - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSource

Get the Boundedness.

getBoundedness() - Method in class org.apache.flink.connector.kafka.source.KafkaSource

getChangelogMode() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

getChangelogMode() - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.DecodingFormatWrapper

getChangelogMode() - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.EncodingFormatWrapper

getChangelogMode(ChangelogMode) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

getClusterEnumeratorStates() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumState

getClusterMetadataMap() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.KafkaStream

Get the metadata to connect to the various cluster(s).

getCommittableSerializer() - Method in class org.apache.flink.connector.kafka.sink.KafkaSink

getCommittedOffset() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

getCurrentOffset() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplitState

getDatasetIdentifier() - Method in interface org.apache.flink.connector.kafka.lineage.KafkaDatasetIdentifierProvider

Gets Kafka dataset identifier or empty in case a class implementing is not able to extract dataset identifier.

getDefaultFactory() - Static method in interface org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy.StoppableKafkaEnumContextProxyFactory

getDescription() - Method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanBoundedMode

getDescription() - Method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanStartupMode

getElementBlocking() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Returns the next element in the queue.

getElementBlocking(long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Returns the next element in the queue.

getEnableCommitOnCheckpoints() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

getEnum(String) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

getEnumeratorCheckpointSerializer() - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSource

Get the DynamicKafkaSourceEnumStateSerializer.

getEnumeratorCheckpointSerializer() - Method in class org.apache.flink.connector.kafka.source.KafkaSource

getEpoch() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

getErrorCode() - Method in exception class org.apache.flink.streaming.connectors.kafka.FlinkKafkaException

Deprecated.

getFetcherName() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher

Deprecated.

Gets the name of this fetcher, for thread naming and logging purposes.

getFetcherName() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher

Deprecated.

getField(Object, String) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

Gets and returns the field fieldName from the given Object object using reflection.

getFixedTopics() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicsDescriptor

Deprecated.

getHeaders(IN) - Method in interface org.apache.flink.connector.kafka.sink.HeaderProvider

getIOMetricGroup() - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

getIsAutoCommitEnabled() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

getIsAutoCommitEnabled() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

getKafkaClusterId() - Method in class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplit

getKafkaDatasetFacet() - Method in interface org.apache.flink.connector.kafka.lineage.KafkaDatasetFacetProvider

Returns a Kafka dataset facet or empty in case an implementing class is not able to identify a dataset.

getKafkaMetric(Map<MetricName, ? extends Metric>, String, String) - Static method in class org.apache.flink.connector.kafka.MetricUtil

Tries to find the Kafka Metric in the provided metrics.

getKafkaMetric(Map<MetricName, ? extends Metric>, Predicate<Map.Entry<MetricName, ? extends Metric>>) - Static method in class org.apache.flink.connector.kafka.MetricUtil

Tries to find the Kafka Metric in the provided metrics matching a given filter.

getKafkaPartitionHandle() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

Gets Kafka's descriptor for the Kafka Partition.

getKafkaPartitionSplit() - Method in class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplit

getKafkaProducerConfig() - Method in class org.apache.flink.connector.kafka.sink.KafkaSink

getKafkaStreams() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumState

getKafkaStreams() - Method in class org.apache.flink.connector.kafka.dynamic.source.MetadataUpdateEvent

getKafkaStreamSubscriber() - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSource

getKafkaTopicPartition() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

Gets Flink's descriptor for the Kafka Partition.

getLeader() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionLeader

Deprecated.

getLength() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

getLength() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

getLength() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

getLineageVertex() - Method in class org.apache.flink.connector.kafka.sink.KafkaSink

getLineageVertex() - Method in class org.apache.flink.connector.kafka.source.KafkaSource

getMessage() - Method in exception class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy.HandledFlinkKafkaException

GetMetadataUpdateEvent - Class in org.apache.flink.connector.kafka.dynamic.source

Event to signal to enumerator that a reader needs to know the current metadata.

GetMetadataUpdateEvent() - Constructor for class org.apache.flink.connector.kafka.dynamic.source.GetMetadataUpdateEvent

getMetricIdentifier(String) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

getMetricIdentifier(String, CharacterFilter) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

getNumberOfParallelInstances() - Method in class org.apache.flink.connector.kafka.sink.DefaultKafkaSinkContext

getNumberOfParallelInstances() - Method in interface org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchema.KafkaSinkContext

getNumRecordsInErrorsCounter() - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

getOffset() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

The current offset in the partition.

getOption(Properties, ConfigOption<?>, Function<String, T>) - Static method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceOptions

getOption(Properties, ConfigOption<?>, Function<String, T>) - Static method in class org.apache.flink.connector.kafka.source.KafkaSourceOptions

getParallelInstanceId() - Method in class org.apache.flink.connector.kafka.sink.DefaultKafkaSinkContext

getParallelInstanceId() - Method in interface org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchema.KafkaSinkContext

Get the ID of the subtask the KafkaSink is running on.

getPartition() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

getPartition() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition

Deprecated.

getPartition() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

getPartitionOffsets(Collection<TopicPartition>, OffsetsInitializer.PartitionOffsetsRetriever) - Method in class org.apache.flink.connector.kafka.source.enumerator.initializer.NoStoppingOffsetsInitializer

getPartitionOffsets(Collection<TopicPartition>, OffsetsInitializer.PartitionOffsetsRetriever) - Method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer

Get the initial offsets for the given Kafka partitions.

getPartitionsByTopic(String, Producer<byte[], byte[]>) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

getPartitionSetSubscriber(Set<TopicPartition>) - Static method in interface org.apache.flink.connector.kafka.source.enumerator.subscriber.KafkaSubscriber

getPartitionsForTopic(String) - Method in class org.apache.flink.connector.kafka.sink.DefaultKafkaSinkContext

getPartitionsForTopic(String) - Method in interface org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchema.KafkaSinkContext

For a given topic id retrieve the available partitions.

getProducedType() - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSource

Get the TypeInformation of the source.

getProducedType() - Method in class org.apache.flink.connector.kafka.source.KafkaSource

getProducedType() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

getProducedType() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaDeserializationSchemaWrapper

Deprecated.

getProducedType() - Method in class org.apache.flink.streaming.util.serialization.JSONKeyValueDeserializationSchema

Deprecated.

getProducedType() - Method in class org.apache.flink.streaming.util.serialization.TypeInformationKeyValueSerializationSchema

Deprecated.

getProducer() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionState

Deprecated.

getProducerId() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

getProperties() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.ClusterMetadata

Get the properties.

getProperties() - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetFacet

getProperties() - Method in interface org.apache.flink.connector.kafka.lineage.KafkaDatasetFacet

getScanRuntimeProvider(ScanTableSource.ScanContext) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

getScopeComponents() - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

getSerializationSchema() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KeyedSerializationSchemaWrapper

Deprecated.

getSinkRuntimeProvider(DynamicTableSink.Context) - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

getSplitSerializer() - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSource

Get the DynamicKafkaSourceSplitSerializer.

getSplitSerializer() - Method in class org.apache.flink.connector.kafka.source.KafkaSource

getStartingOffset() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

getStateSentinel() - Method in enum class org.apache.flink.streaming.connectors.kafka.config.StartupMode

getStatusCode() - Method in enum class org.apache.flink.connector.kafka.source.enumerator.AssignmentStatus

getStoppingOffset() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

getStreamId() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.KafkaStream

Get the stream id.

getSubscribedStreams(KafkaMetadataService) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber.KafkaStreamSetSubscriber

getSubscribedStreams(KafkaMetadataService) - Method in interface org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber.KafkaStreamSubscriber

Get the subscribed KafkaStreams.

getSubscribedStreams(KafkaMetadataService) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber.StreamPatternSubscriber

getSubscribedTopicPartitions(AdminClient) - Method in interface org.apache.flink.connector.kafka.source.enumerator.subscriber.KafkaSubscriber

Get a set of subscribed TopicPartitions.

getSubtask() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleWatermark

Deprecated.

getTargetTopic(Tuple2<K, V>) - Method in class org.apache.flink.streaming.util.serialization.TypeInformationKeyValueSerializationSchema

Deprecated.

getTargetTopic(T) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaSerializationSchemaWrapper

Deprecated.

getTargetTopic(T) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KeyedSerializationSchemaWrapper

Deprecated.

getTargetTopic(T) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaContextAware

Deprecated.

Returns the topic that the presented element should be sent to.

getTargetTopic(T) - Method in interface org.apache.flink.streaming.util.serialization.KeyedSerializationSchema

Deprecated.

Optional method to determine the target topic for the element.

getTimestamp() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleRecord

Deprecated.

getTopic() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

getTopic() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition

Deprecated.

getTopic() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

getTopicIdentifier() - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetFacet

getTopicIdentifier() - Method in interface org.apache.flink.connector.kafka.lineage.KafkaDatasetFacet

getTopicListSubscriber(List<String>) - Static method in interface org.apache.flink.connector.kafka.source.enumerator.subscriber.KafkaSubscriber

getTopicPartition() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

getTopicPartition() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionLeader

Deprecated.

getTopicPattern() - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetIdentifier

getTopicPattern() - Method in interface org.apache.flink.connector.kafka.lineage.KafkaDatasetIdentifier

getTopicPatternSubscriber(Pattern) - Static method in interface org.apache.flink.connector.kafka.source.enumerator.subscriber.KafkaSubscriber

getTopics() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.ClusterMetadata

Get the topics.

getTopics() - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetIdentifier

getTopics() - Method in interface org.apache.flink.connector.kafka.lineage.KafkaDatasetIdentifier

getTransactionalId() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

getTransactionCoordinatorId() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

getTransactionTimeout(Properties) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

getTypeDatasetFacet() - Method in interface org.apache.flink.connector.kafka.lineage.TypeDatasetFacetProvider

Returns a type dataset facet or `Optional.empty` in case an implementing class is not able to resolve type.

getTypeInformation() - Method in class org.apache.flink.connector.kafka.lineage.DefaultTypeDatasetFacet

getTypeInformation() - Method in interface org.apache.flink.connector.kafka.lineage.TypeDatasetFacet

getValue() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleRecord

Deprecated.

getValue() - Method in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaMetricMutableWrapper

getValue() - Method in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaMetricWrapper

Deprecated.

getVersion() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumStateSerializer

getVersion() - Method in class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplitSerializer

getVersion() - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumStateSerializer

getVersion() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplitSerializer

getWatermark() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleWatermark

Deprecated.

getWriterStateSerializer() - Method in class org.apache.flink.connector.kafka.sink.KafkaSink

GROUP_OFFSET - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateSentinel

Magic number that defines the partition should start from its committed group offset in Kafka.

GROUP_OFFSETS - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.BoundedMode

End from committed offsets in ZK / Kafka brokers of a specific consumer group.

GROUP_OFFSETS - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.StartupMode

Start from committed offsets in ZK / Kafka brokers of a specific consumer group (default).

GROUP_OFFSETS - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanBoundedMode

GROUP_OFFSETS - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanStartupMode

H

HandledFlinkKafkaException(Throwable, String) - Constructor for exception class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy.HandledFlinkKafkaException

handleSourceEvent(int, SourceEvent) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumerator

handleSourceEvents(SourceEvent) - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

Duplicate source events are handled with idempotency.

handleSplitRequest(int, String) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumerator

Multi cluster Kafka source readers will not request splits.

handleSplitRequest(int, String) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator

handleSplitsChanges(SplitsChange<KafkaPartitionSplit>) - Method in class org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader

Handover - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

Handover() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.Handover

Deprecated.

Handover.ClosedException - Exception Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

An exception thrown by the Handover in the Handover.pollNext() or Handover.produce(ConsumerRecords) method, after the Handover was closed via Handover.close().

Handover.WakeupException - Exception Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

A special exception thrown bv the Handover in the Handover.produce(ConsumerRecords) method when the producer is woken up from a blocking call via Handover.wakeupProducer().

hashCode() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.ClusterMetadata

hashCode() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.KafkaStream

hashCode() - Method in class org.apache.flink.connector.kafka.dynamic.source.MetadataUpdateEvent

hashCode() - Method in class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplit

hashCode() - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetFacet

hashCode() - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetIdentifier

hashCode() - Method in class org.apache.flink.connector.kafka.lineage.DefaultTypeDatasetFacet

hashCode() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionContext

Deprecated.

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionState

Deprecated.

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHint

Deprecated.

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition

Deprecated.

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionLeader

Deprecated.

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.partitioner.FlinkFixedPartitioner

Deprecated.

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.table.SinkBufferFlushMode

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.DecodingFormatWrapper

hashCode() - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.EncodingFormatWrapper

HeaderProvider<IN> - Interface in org.apache.flink.connector.kafka.sink

Creates an Iterable of Headers from the input element.

histogram(String, H) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

I

IDENTIFIER - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

IDENTIFIER - Static variable in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory

ignoreFailuresAfterTransactionTimeout() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Disables the propagation of exceptions thrown when committing presumably timed out Kafka transactions during recovery of the job.

INITIAL_OFFSET - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

initialDiscoveryFinished() - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumState

initializeConnections() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Establish the required connections in order to fetch topics and partitions metadata.

initializeConnections() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaPartitionDiscoverer

Deprecated.

initializedState(KafkaPartitionSplit) - Method in class org.apache.flink.connector.kafka.source.reader.KafkaSourceReader

initializeState(FunctionInitializationContext) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

initializeState(FunctionInitializationContext) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

initializeUserContext() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

initTransactions() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

invoke(Object, String, Object...) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

invoke(Watermark) - Method in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffleProducer

Deprecated.

This is the function invoked to handle each watermark.

invoke(FlinkKafkaProducer.KafkaTransactionState, IN, SinkFunction.Context) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

invoke(FlinkKafkaProducer.KafkaTransactionState, IN, SinkFunction.Context) - Method in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffleProducer

Deprecated.

This is the function invoked to handle each element.

isActivelyConsumingSplits() - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

isAvailable() - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

isClusterActive(String) - Method in interface org.apache.flink.connector.kafka.dynamic.metadata.KafkaMetadataService

Check if the cluster is active.

isClusterActive(String) - Method in class org.apache.flink.connector.kafka.dynamic.metadata.SingleClusterTopicMetadataService

Check if the cluster is active.

isEmpty() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Checks whether the queue is empty (has no elements).

isEnabled() - Method in class org.apache.flink.streaming.connectors.kafka.table.SinkBufferFlushMode

isEndOfStream(ObjectNode) - Method in class org.apache.flink.streaming.util.serialization.JSONKeyValueDeserializationSchema

Deprecated.

isEndOfStream(Tuple2<K, V>) - Method in class org.apache.flink.streaming.util.serialization.TypeInformationKeyValueSerializationSchema

Deprecated.

This schema never considers an element to signal end-of-stream, so this method returns always false.

isEndOfStream(T) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaDeserializationSchemaWrapper

Deprecated.

isEndOfStream(T) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema

Deprecated.

Method to decide whether the element signals the end of the stream.

isFixedTopics() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicsDescriptor

Deprecated.

isImmutableType() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

isImmutableType() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

isImmutableType() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

isMatchingTopic(String) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicsDescriptor

Deprecated.

Check if the input topic matches the topics described by this KafkaTopicDescriptor.

isNoMoreSplits() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

isOffsetDefined() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

isOpen() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Checks whether the queue is currently open, meaning elements can be added and polled.

isRecord() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleElement

Deprecated.

isSentinel(long) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateSentinel

isTopicPattern() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicsDescriptor

Deprecated.

isWatermark() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleElement

Deprecated.

J

JacksonMapperFactory - Class in org.apache.flink.connector.kafka.util

Factory for Jackson mappers.

JSONKeyValueDeserializationSchema - Class in org.apache.flink.streaming.util.serialization

Deprecated.

JSONKeyValueDeserializationSchema(boolean) - Constructor for class org.apache.flink.streaming.util.serialization.JSONKeyValueDeserializationSchema

Deprecated.

K

KAFKA_CLUSTER_GROUP_NAME - Static variable in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

KAFKA_CONSUMER_METRIC_GROUP - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

KAFKA_CONSUMER_METRICS_GROUP - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

KAFKA_FACET_NAME - Static variable in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetFacet

KAFKA_PERIODIC - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.OffsetCommitMode

Deprecated.

Commit offsets periodically back to Kafka, using the auto commit functionality of internal Kafka clients.

KAFKA_SOURCE_READER_METRIC_GROUP - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

KafkaClusterMetricGroup - Class in org.apache.flink.connector.kafka.dynamic.source.metrics

A custom proxy metric group in order to group KafkaSourceReaderMetrics by Kafka cluster.

KafkaClusterMetricGroup(MetricGroup, SourceReaderMetricGroup, String) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

KafkaClusterMetricGroupManager - Class in org.apache.flink.connector.kafka.dynamic.source.metrics

Manages metric groups for each cluster.

KafkaClusterMetricGroupManager() - Constructor for class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroupManager

KafkaCommitCallback - Interface in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaConnectorOptions - Class in org.apache.flink.streaming.connectors.kafka.table

Options for the Kafka connector.

KafkaConnectorOptions.ScanBoundedMode - Enum Class in org.apache.flink.streaming.connectors.kafka.table

Bounded mode for the Kafka consumer, see KafkaConnectorOptions.SCAN_BOUNDED_MODE.

KafkaConnectorOptions.ScanStartupMode - Enum Class in org.apache.flink.streaming.connectors.kafka.table

Startup mode for the Kafka consumer, see KafkaConnectorOptions.SCAN_STARTUP_MODE.

KafkaConnectorOptions.ValueFieldsStrategy - Enum Class in org.apache.flink.streaming.connectors.kafka.table

Strategies to derive the data type of a value format by considering a key format.

KafkaConsumerMetricConstants - Class in org.apache.flink.streaming.connectors.kafka.internals.metrics

Deprecated.

KafkaConsumerMetricConstants() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

KafkaConsumerThread<T> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaConsumerThread(Logger, Handover, Properties, ClosableBlockingQueue<KafkaTopicPartitionState<T, TopicPartition>>, String, long, boolean, MetricGroup, MetricGroup) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaConsumerThread

Deprecated.

KafkaContextAware<T> - Interface in org.apache.flink.streaming.connectors.kafka

Deprecated.

Will be turned into internal API when FlinkKafkaProducer is removed.

KafkaDatasetFacet - Interface in org.apache.flink.connector.kafka.lineage

Facet definition to contain all Kafka specific information on Kafka sources and sinks.

KafkaDatasetFacetProvider - Interface in org.apache.flink.connector.kafka.lineage

Contains method to extract KafkaDatasetFacet.

KafkaDatasetIdentifier - Interface in org.apache.flink.connector.kafka.lineage

Kafka dataset identifier which can contain either a list of topics or a topic pattern.

KafkaDatasetIdentifierProvider - Interface in org.apache.flink.connector.kafka.lineage

Contains method which allows extracting topic identifier.

KafkaDeserializationSchema<T> - Interface in org.apache.flink.streaming.connectors.kafka

Deprecated.

Will be turned into internal API when FlinkKafkaConsumer is removed.

KafkaDeserializationSchemaWrapper<T> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaDeserializationSchemaWrapper(DeserializationSchema<T>) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaDeserializationSchemaWrapper

Deprecated.

KafkaDynamicSink - Class in org.apache.flink.streaming.connectors.kafka.table

A version-agnostic Kafka DynamicTableSink.

KafkaDynamicSink(DataType, DataType, EncodingFormat<SerializationSchema<RowData>>, EncodingFormat<SerializationSchema<RowData>>, int[], int[], String, List<String>, Pattern, Properties, KafkaPartitioner<RowData>, DeliveryGuarantee, boolean, SinkBufferFlushMode, Integer, String) - Constructor for class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

KafkaDynamicSource - Class in org.apache.flink.streaming.connectors.kafka.table

A version-agnostic Kafka ScanTableSource.

KafkaDynamicSource(DataType, DecodingFormat<DeserializationSchema<RowData>>, DecodingFormat<DeserializationSchema<RowData>>, int[], int[], String, List<String>, Pattern, Properties, StartupMode, Map<KafkaTopicPartition, Long>, long, BoundedMode, Map<KafkaTopicPartition, Long>, long, boolean, String) - Constructor for class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

KafkaDynamicTableFactory - Class in org.apache.flink.streaming.connectors.kafka.table

Factory for creating configured instances of KafkaDynamicSource and KafkaDynamicSink.

KafkaDynamicTableFactory() - Constructor for class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

KafkaFetcher<T> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaFetcher(SourceFunction.SourceContext<T>, Map<KafkaTopicPartition, Long>, SerializedValue<WatermarkStrategy<T>>, ProcessingTimeService, long, ClassLoader, String, KafkaDeserializationSchema<T>, Properties, long, MetricGroup, MetricGroup, boolean) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher

Deprecated.

KafkaMetadataService - Interface in org.apache.flink.connector.kafka.dynamic.metadata

Metadata service that returns Kafka details.

KafkaMetricMutableWrapper - Class in org.apache.flink.streaming.connectors.kafka.internals.metrics

Gauge for getting the current value of a Kafka metric.

KafkaMetricMutableWrapper(Metric) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaMetricMutableWrapper

KafkaMetricWrapper - Class in org.apache.flink.streaming.connectors.kafka.internals.metrics

Deprecated.

KafkaMetricWrapper(Metric) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaMetricWrapper

Deprecated.

KafkaPartitionDiscoverer - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaPartitionDiscoverer(KafkaTopicsDescriptor, int, int, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaPartitionDiscoverer

Deprecated.

KafkaPartitioner<T> - Interface in org.apache.flink.connector.kafka.sink

A KafkaPartitioner wraps logic on how to partition records across partitions of multiple Kafka topics.

KafkaPartitionSplit - Class in org.apache.flink.connector.kafka.source.split

A SourceSplit for a Kafka partition.

KafkaPartitionSplit(TopicPartition, long) - Constructor for class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

KafkaPartitionSplit(TopicPartition, long, long) - Constructor for class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

KafkaPartitionSplitReader - Class in org.apache.flink.connector.kafka.source.reader

A SplitReader implementation that reads records from Kafka partitions.

KafkaPartitionSplitReader(Properties, SourceReaderContext, KafkaSourceReaderMetrics) - Constructor for class org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader

KafkaPartitionSplitReader(Properties, SourceReaderContext, KafkaSourceReaderMetrics, String) - Constructor for class org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader

KafkaPartitionSplitReaderWrapper - Class in org.apache.flink.connector.kafka.dynamic.source.reader

This extends to Kafka Partition Split Reader to wrap split ids with the cluster name.

KafkaPartitionSplitReaderWrapper(Properties, SourceReaderContext, KafkaSourceReaderMetrics, String) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.reader.KafkaPartitionSplitReaderWrapper

KafkaPartitionSplitSerializer - Class in org.apache.flink.connector.kafka.source.split

The serializer for KafkaPartitionSplit.

KafkaPartitionSplitSerializer() - Constructor for class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplitSerializer

KafkaPartitionSplitState - Class in org.apache.flink.connector.kafka.source.split

This class extends KafkaPartitionSplit to track a mutable current offset.

KafkaPartitionSplitState(KafkaPartitionSplit) - Constructor for class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplitState

kafkaProducer - Variable in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

KafkaPropertiesUtil - Class in org.apache.flink.connector.kafka.source

Utility class for modify Kafka properties.

KafkaRecordDeserializationSchema<T> - Interface in org.apache.flink.connector.kafka.source.reader.deserializer

An interface for the deserialization of Kafka records.

KafkaRecordEmitter<T> - Class in org.apache.flink.connector.kafka.source.reader

The RecordEmitter implementation for KafkaSourceReader.

KafkaRecordEmitter(KafkaRecordDeserializationSchema<T>) - Constructor for class org.apache.flink.connector.kafka.source.reader.KafkaRecordEmitter

KafkaRecordSerializationSchema<T> - Interface in org.apache.flink.connector.kafka.sink

A serialization schema which defines how to convert a value of type T to ProducerRecord.

KafkaRecordSerializationSchema.KafkaSinkContext - Interface in org.apache.flink.connector.kafka.sink

Context providing information of the kafka record target location.

KafkaRecordSerializationSchemaBuilder<IN> - Class in org.apache.flink.connector.kafka.sink

Builder to construct KafkaRecordSerializationSchema.

KafkaRecordSerializationSchemaBuilder() - Constructor for class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

KafkaSerializationSchema<T> - Interface in org.apache.flink.streaming.connectors.kafka

Deprecated.

Will be turned into internal API when FlinkKafkaProducer is removed.

KafkaSerializationSchemaWrapper<T> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaSerializationSchemaWrapper(String, FlinkKafkaPartitioner<T>, boolean, SerializationSchema<T>) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaSerializationSchemaWrapper

Deprecated.

KafkaShuffleElement() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleElement

Deprecated.

KafkaShuffleElementDeserializer(TypeSerializer<T>) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher.KafkaShuffleElementDeserializer

Deprecated.

KafkaShuffleFetcher<T> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaShuffleFetcher(SourceFunction.SourceContext<T>, Map<KafkaTopicPartition, Long>, SerializedValue<WatermarkStrategy<T>>, ProcessingTimeService, long, ClassLoader, String, KafkaDeserializationSchema<T>, Properties, long, MetricGroup, MetricGroup, boolean, TypeSerializer<T>, int) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher

Deprecated.

KafkaShuffleFetcher.KafkaShuffleElement - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

An element in a KafkaShuffle.

KafkaShuffleFetcher.KafkaShuffleElementDeserializer<T> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

Deserializer for KafkaShuffleElement.

KafkaShuffleFetcher.KafkaShuffleRecord<T> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

One value with Type T in a KafkaShuffle.

KafkaShuffleFetcher.KafkaShuffleWatermark - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

A watermark element in a KafkaShuffle.

KafkaSink<IN> - Class in org.apache.flink.connector.kafka.sink

Flink Sink to produce data into a Kafka topic.

KafkaSinkBuilder<IN> - Class in org.apache.flink.connector.kafka.sink

Builder to construct KafkaSink.

KafkaSource<OUT> - Class in org.apache.flink.connector.kafka.source

The Source implementation of Kafka.

KafkaSourceBuilder<OUT> - Class in org.apache.flink.connector.kafka.source

The builder class for KafkaSource to make it easier for the users to construct a KafkaSource.

KafkaSourceEnumerator - Class in org.apache.flink.connector.kafka.source.enumerator

The enumerator class for Kafka source.

KafkaSourceEnumerator(KafkaSubscriber, OffsetsInitializer, OffsetsInitializer, Properties, SplitEnumeratorContext<KafkaPartitionSplit>, Boundedness) - Constructor for class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator

KafkaSourceEnumerator(KafkaSubscriber, OffsetsInitializer, OffsetsInitializer, Properties, SplitEnumeratorContext<KafkaPartitionSplit>, Boundedness, KafkaSourceEnumState) - Constructor for class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator

KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl - Class in org.apache.flink.connector.kafka.source.enumerator

The implementation for offsets retriever with a consumer and an admin client.

KafkaSourceEnumState - Class in org.apache.flink.connector.kafka.source.enumerator

The state of Kafka source enumerator.

KafkaSourceEnumState(Set<TopicPartitionAndAssignmentStatus>, boolean) - Constructor for class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumState

KafkaSourceEnumState(Set<TopicPartition>, Set<TopicPartition>, boolean) - Constructor for class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumState

KafkaSourceEnumStateSerializer - Class in org.apache.flink.connector.kafka.source.enumerator

The Serializer for the enumerator state of Kafka source.

KafkaSourceEnumStateSerializer() - Constructor for class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumStateSerializer

KafkaSourceFetcherManager - Class in org.apache.flink.connector.kafka.source.reader.fetcher

The SplitFetcherManager for Kafka source.

KafkaSourceFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<ConsumerRecord<byte[], byte[]>>>, Supplier<SplitReader<ConsumerRecord<byte[], byte[]>, KafkaPartitionSplit>>, Consumer<Collection<String>>) - Constructor for class org.apache.flink.connector.kafka.source.reader.fetcher.KafkaSourceFetcherManager

Creates a new SplitFetcherManager with a single I/O threads.

KafkaSourceOptions - Class in org.apache.flink.connector.kafka.source

Configurations for KafkaSource.

KafkaSourceOptions() - Constructor for class org.apache.flink.connector.kafka.source.KafkaSourceOptions

KafkaSourceReader<T> - Class in org.apache.flink.connector.kafka.source.reader

The source reader for Kafka partitions.

KafkaSourceReader(FutureCompletingBlockingQueue<RecordsWithSplitIds<ConsumerRecord<byte[], byte[]>>>, KafkaSourceFetcherManager, RecordEmitter<ConsumerRecord<byte[], byte[]>, T, KafkaPartitionSplitState>, Configuration, SourceReaderContext, KafkaSourceReaderMetrics) - Constructor for class org.apache.flink.connector.kafka.source.reader.KafkaSourceReader

KafkaSourceReaderMetrics - Class in org.apache.flink.connector.kafka.source.metrics

A collection class for handling metrics in KafkaSourceReader.

KafkaSourceReaderMetrics(SourceReaderMetricGroup) - Constructor for class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

KafkaStream - Class in org.apache.flink.connector.kafka.dynamic.metadata

Kafka stream represents multiple topics over multiple Kafka clusters and this class encapsulates all the necessary information to initiate Kafka consumers to read a stream.

KafkaStream(String, Map<String, ClusterMetadata>) - Constructor for class org.apache.flink.connector.kafka.dynamic.metadata.KafkaStream

Construct a KafkaStream by passing Kafka information in order to connect to the stream.

KafkaStreamSetSubscriber - Class in org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber

Subscribe to streams based on the set of ids.

KafkaStreamSetSubscriber(Set<String>) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber.KafkaStreamSetSubscriber

KafkaStreamSubscriber - Interface in org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber

The subscriber interacts with KafkaMetadataService to find which Kafka streams the source will subscribe to.

KafkaSubscriber - Interface in org.apache.flink.connector.kafka.source.enumerator.subscriber

Kafka consumer allows a few different ways to consume from the topics, including: Subscribe from a collection of topics.

KafkaTopicPartition - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

Will be turned into internal class when FlinkKafkaProducer is removed. Replace with TopicPartition.

KafkaTopicPartition(String, int) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition

Deprecated.

KafkaTopicPartition.Comparator - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

A Comparator for KafkaTopicPartitions.

KafkaTopicPartitionAssigner - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaTopicPartitionAssigner() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionAssigner

Deprecated.

KafkaTopicPartitionLeader - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaTopicPartitionLeader(KafkaTopicPartition, Node) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionLeader

Deprecated.

KafkaTopicPartitionState<T,KPH> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaTopicPartitionState(KafkaTopicPartition, KPH) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

KafkaTopicPartitionStateSentinel - Class in org.apache.flink.streaming.connectors.kafka.internals

Magic values used to represent special offset states before partitions are actually read.

KafkaTopicPartitionStateSentinel() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateSentinel

KafkaTopicPartitionStateWithWatermarkGenerator<T,KPH> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaTopicPartitionStateWithWatermarkGenerator(KafkaTopicPartition, KPH, TimestampAssigner<T>, WatermarkGenerator<T>, WatermarkOutput, WatermarkOutput) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateWithWatermarkGenerator

Deprecated.

KafkaTopicsDescriptor - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KafkaTopicsDescriptor(List<String>, Pattern) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicsDescriptor

Deprecated.

KafkaTransactionContext(Set<String>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionContext

Deprecated.

KafkaTransactionState(String, long, short, FlinkKafkaInternalProducer<byte[], byte[]>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionState

Deprecated.

KafkaTransactionState(String, FlinkKafkaInternalProducer<byte[], byte[]>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionState

Deprecated.

KafkaTransactionState(FlinkKafkaInternalProducer<byte[], byte[]>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionState

Deprecated.

KEY_DISABLE_METRICS - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Boolean configuration key to disable metrics tracking.

KEY_DISABLE_METRICS - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Configuration key for disabling the metrics reporting.

KEY_FIELDS - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

KEY_FIELDS_PREFIX - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

KEY_FORMAT - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

KEY_PARTITION_DISCOVERY_INTERVAL_MILLIS - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Configuration key to define the consumer's partition discovery interval, in milliseconds.

KEY_POLL_TIMEOUT - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

Configuration key to change the polling timeout.

keyDecodingFormat - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Optional format for decoding keys from Kafka.

KeyedDeserializationSchema<T> - Interface in org.apache.flink.streaming.util.serialization

Deprecated.

Use KafkaDeserializationSchema.

KeyedSerializationSchema<T> - Interface in org.apache.flink.streaming.util.serialization

Deprecated.

Use KafkaSerializationSchema.

KeyedSerializationSchemaWrapper<T> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

KeyedSerializationSchemaWrapper(SerializationSchema<T>) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.KeyedSerializationSchemaWrapper

Deprecated.

keyEncodingFormat - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Optional format for encoding keys to Kafka.

keyPrefix - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Prefix that needs to be removed from fields when constructing the physical data type.

keyPrefix - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Prefix that needs to be removed from fields when constructing the physical data type.

keyProjection - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Indices that determine the key fields and the source position in the consumed row.

keyProjection - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Indices that determine the key fields and the target position in the produced row.

L

lastParallelism - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHint

Deprecated.

latest() - Static method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer

Get an OffsetsInitializer which initializes the offsets to the latest offsets of each partition.

LATEST - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.BoundedMode

End from the latest offset.

LATEST - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.StartupMode

Start from the latest offset.

LATEST_OFFSET - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanBoundedMode

LATEST_OFFSET - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanStartupMode

LATEST_OFFSET - Static variable in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

Deprecated.

LATEST_OFFSET - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateSentinel

Magic number that defines the partition should start from the latest offset.

LEGACY_COMMITTED_OFFSETS_METRICS_GROUP - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

LEGACY_CURRENT_OFFSETS_METRICS_GROUP - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

LineageUtil - Class in org.apache.flink.connector.kafka.lineage

Utility class with useful methods for managing lineage objects.

LineageUtil() - Constructor for class org.apache.flink.connector.kafka.lineage.LineageUtil

lineageVertexOf(Collection<LineageDataset>) - Static method in class org.apache.flink.connector.kafka.lineage.LineageUtil

listReadableMetadata() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

listWritableMetadata() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

LOG - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

M

markActive() - Method in class org.apache.flink.streaming.connectors.kafka.internals.SourceContextWatermarkOutputAdapter

Deprecated.

markIdle() - Method in class org.apache.flink.streaming.connectors.kafka.internals.SourceContextWatermarkOutputAdapter

Deprecated.

MAX_NUM_PENDING_CHECKPOINTS - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

The maximum number of pending non-committed checkpoints to track, to avoid memory leaks.

maybeAddRecordsLagMetric(KafkaConsumer<?, ?>, TopicPartition) - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Add a partition's records-lag metric to tracking list if this partition never appears before.

metadataKeys - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Metadata that is appended at the end of a physical sink row.

metadataKeys - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Metadata that is appended at the end of a physical source row.

MetadataUpdateEvent - Class in org.apache.flink.connector.kafka.dynamic.source

Signals DynamicKafkaSourceReader to stop their underlying readers.

MetadataUpdateEvent(Set<KafkaStream>) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.MetadataUpdateEvent

meter(String, M) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

metricGroup() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

metrics() - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

MetricUtil - Class in org.apache.flink.connector.kafka

Collection of methods to interact with Kafka's client metric system.

MetricUtil() - Constructor for class org.apache.flink.connector.kafka.MetricUtil

More Flink partitions than kafka partitions - Search tag in class org.apache.flink.streaming.connectors.kafka.partitioner.FlinkFixedPartitioner

Section

N

name() - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetFacet

name() - Method in class org.apache.flink.connector.kafka.lineage.DefaultTypeDatasetFacet

namespaceOf(Properties) - Static method in class org.apache.flink.connector.kafka.lineage.LineageUtil

nextFreeTransactionalId - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHint

Deprecated.

NextTransactionalIdHint() - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHint

Deprecated.

NextTransactionalIdHint(int, long) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHint

Deprecated.

NextTransactionalIdHintSerializer() - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

NextTransactionalIdHintSerializerSnapshot() - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer.NextTransactionalIdHintSerializerSnapshot

Deprecated.

NO_STOPPING_OFFSET - Static variable in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

NONE - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.Semantic

Deprecated.

Semantic.NONE means that nothing will be guaranteed.

NoStoppingOffsetsInitializer - Class in org.apache.flink.connector.kafka.source.enumerator.initializer

An implementation of OffsetsInitializer which does not initialize anything.

NoStoppingOffsetsInitializer() - Constructor for class org.apache.flink.connector.kafka.source.enumerator.initializer.NoStoppingOffsetsInitializer

notifyCheckpointAborted(long) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

notifyCheckpointComplete(long) - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

notifyCheckpointComplete(long) - Method in class org.apache.flink.connector.kafka.source.reader.KafkaSourceReader

notifyCheckpointComplete(long) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

notifyCheckpointComplete(Map<TopicPartition, OffsetAndMetadata>, OffsetCommitCallback) - Method in class org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader

notifyNoMoreSplits() - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

O

of(KafkaDeserializationSchema<V>) - Static method in interface org.apache.flink.connector.kafka.source.reader.deserializer.KafkaRecordDeserializationSchema

Deprecated.

Will be removed with KafkaDeserializationSchema.

OFFSET_NOT_SET - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateSentinel

Magic number that defines an unset offset.

OffsetCommitMode - Enum Class in org.apache.flink.streaming.connectors.kafka.config

Deprecated.

OffsetCommitModes - Class in org.apache.flink.streaming.connectors.kafka.config

Deprecated.

OffsetCommitModes() - Constructor for class org.apache.flink.streaming.connectors.kafka.config.OffsetCommitModes

Deprecated.

offsets(Map<TopicPartition, Long>) - Static method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer

Get an OffsetsInitializer which initializes the offsets to the specified offsets.

offsets(Map<TopicPartition, Long>, OffsetResetStrategy) - Static method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer

Get an OffsetsInitializer which initializes the offsets to the specified offsets.

OFFSETS_BY_PARTITION_METRICS_GROUP - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

OFFSETS_BY_TOPIC_METRICS_GROUP - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaConsumerMetricConstants

Deprecated.

offsetsForTimes(Map<TopicPartition, Long>) - Method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer.PartitionOffsetsRetriever

List offsets matching a timestamp for the specified partitions.

offsetsForTimes(Map<TopicPartition, Long>) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl

OffsetsInitializer - Interface in org.apache.flink.connector.kafka.source.enumerator.initializer

An interface for users to specify the starting / stopping offset of a KafkaPartitionSplit.

OffsetsInitializer.PartitionOffsetsRetriever - Interface in org.apache.flink.connector.kafka.source.enumerator.initializer

An interface that provides necessary information to the OffsetsInitializer to get the initial offsets of the Kafka partitions.

OffsetsInitializerValidator - Interface in org.apache.flink.connector.kafka.source.enumerator.initializer

Interface for validating OffsetsInitializer with properties from KafkaSource.

ofPattern(Pattern) - Static method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetIdentifier

ofStatusCode(int) - Static method in enum class org.apache.flink.connector.kafka.source.enumerator.AssignmentStatus

ofTopics(List<String>) - Static method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetIdentifier

ON_CHECKPOINTS - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.OffsetCommitMode

Deprecated.

Commit offsets back to Kafka only when checkpoints are completed.

onEvent(T, long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

onEvent(T, long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateWithWatermarkGenerator

Deprecated.

onException(Throwable) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.KafkaCommitCallback

Deprecated.

A callback method the user can implement to provide asynchronous handling of commit request failure.

onPeriodicEmit() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

onPeriodicEmit() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateWithWatermarkGenerator

Deprecated.

onSplitFinished(Map<String, KafkaPartitionSplitState>) - Method in class org.apache.flink.connector.kafka.source.reader.KafkaSourceReader

onSuccess() - Method in interface org.apache.flink.streaming.connectors.kafka.internals.KafkaCommitCallback

Deprecated.

A callback method the user can implement to provide asynchronous handling of commit request completion.

open() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Opens the partition discoverer, initializing all required Kafka connections.

open(int, int) - Method in interface org.apache.flink.connector.kafka.sink.KafkaPartitioner

Initializer for the partitioner.

open(int, int) - Method in class org.apache.flink.streaming.connectors.kafka.partitioner.FlinkFixedPartitioner

Deprecated.

open(DeserializationSchema.InitializationContext) - Method in interface org.apache.flink.connector.kafka.source.reader.deserializer.KafkaRecordDeserializationSchema

Initialization method for the schema.

open(DeserializationSchema.InitializationContext) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaDeserializationSchemaWrapper

Deprecated.

open(DeserializationSchema.InitializationContext) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema

Deprecated.

Initialization method for the schema.

open(DeserializationSchema.InitializationContext) - Method in class org.apache.flink.streaming.util.serialization.JSONKeyValueDeserializationSchema

Deprecated.

open(SerializationSchema.InitializationContext) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaSerializationSchemaWrapper

Deprecated.

open(SerializationSchema.InitializationContext) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaSerializationSchema

Deprecated.

Initialization method for the schema.

open(SerializationSchema.InitializationContext, KafkaRecordSerializationSchema.KafkaSinkContext) - Method in interface org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchema

Initialization method for the schema.

open(Configuration) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

open(Configuration) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Initializes the connection to Kafka.

optionalOptions() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

optionalOptions() - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory

org.apache.flink.connector.kafka - package org.apache.flink.connector.kafka

org.apache.flink.connector.kafka.dynamic.metadata - package org.apache.flink.connector.kafka.dynamic.metadata

org.apache.flink.connector.kafka.dynamic.source - package org.apache.flink.connector.kafka.dynamic.source

org.apache.flink.connector.kafka.dynamic.source.enumerator - package org.apache.flink.connector.kafka.dynamic.source.enumerator

org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber - package org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber

org.apache.flink.connector.kafka.dynamic.source.metrics - package org.apache.flink.connector.kafka.dynamic.source.metrics

org.apache.flink.connector.kafka.dynamic.source.reader - package org.apache.flink.connector.kafka.dynamic.source.reader

org.apache.flink.connector.kafka.dynamic.source.split - package org.apache.flink.connector.kafka.dynamic.source.split

org.apache.flink.connector.kafka.lineage - package org.apache.flink.connector.kafka.lineage

org.apache.flink.connector.kafka.sink - package org.apache.flink.connector.kafka.sink

org.apache.flink.connector.kafka.source - package org.apache.flink.connector.kafka.source

org.apache.flink.connector.kafka.source.enumerator - package org.apache.flink.connector.kafka.source.enumerator

org.apache.flink.connector.kafka.source.enumerator.initializer - package org.apache.flink.connector.kafka.source.enumerator.initializer

org.apache.flink.connector.kafka.source.enumerator.subscriber - package org.apache.flink.connector.kafka.source.enumerator.subscriber

org.apache.flink.connector.kafka.source.metrics - package org.apache.flink.connector.kafka.source.metrics

org.apache.flink.connector.kafka.source.reader - package org.apache.flink.connector.kafka.source.reader

org.apache.flink.connector.kafka.source.reader.deserializer - package org.apache.flink.connector.kafka.source.reader.deserializer

org.apache.flink.connector.kafka.source.reader.fetcher - package org.apache.flink.connector.kafka.source.reader.fetcher

org.apache.flink.connector.kafka.source.split - package org.apache.flink.connector.kafka.source.split

org.apache.flink.connector.kafka.util - package org.apache.flink.connector.kafka.util

org.apache.flink.streaming.connectors.kafka - package org.apache.flink.streaming.connectors.kafka

org.apache.flink.streaming.connectors.kafka.config - package org.apache.flink.streaming.connectors.kafka.config

org.apache.flink.streaming.connectors.kafka.internals - package org.apache.flink.streaming.connectors.kafka.internals

org.apache.flink.streaming.connectors.kafka.internals.metrics - package org.apache.flink.streaming.connectors.kafka.internals.metrics

org.apache.flink.streaming.connectors.kafka.partitioner - package org.apache.flink.streaming.connectors.kafka.partitioner

org.apache.flink.streaming.connectors.kafka.shuffle - package org.apache.flink.streaming.connectors.kafka.shuffle

org.apache.flink.streaming.connectors.kafka.table - package org.apache.flink.streaming.connectors.kafka.table

org.apache.flink.streaming.util.serialization - package org.apache.flink.streaming.util.serialization

P

parallelism - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Parallelism of the physical Kafka producer.

partition(T, byte[], byte[], String, int[]) - Method in interface org.apache.flink.connector.kafka.sink.KafkaPartitioner

Determine the id of the partition that the record should be written to.

partition(T, byte[], byte[], String, int[]) - Method in class org.apache.flink.streaming.connectors.kafka.partitioner.FlinkFixedPartitioner

Deprecated.

PARTITION_DISCOVERY_DISABLED - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

The default interval to execute partition discovery, in milliseconds (Long.MIN_VALUE, i.e.

PARTITION_DISCOVERY_INTERVAL_MS - Static variable in class org.apache.flink.connector.kafka.source.KafkaSourceOptions

PARTITION_GROUP - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

partitionConsumerRecordsHandler(List<ConsumerRecord<byte[], byte[]>>, KafkaTopicPartitionState<T, TopicPartition>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher

Deprecated.

partitionConsumerRecordsHandler(List<ConsumerRecord<byte[], byte[]>>, KafkaTopicPartitionState<T, TopicPartition>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaShuffleFetcher

Deprecated.

partitioner - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Partitioner to select Kafka partition for each item.

PartitionOffsetsRetrieverImpl(AdminClient, String) - Constructor for class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl

partitions() - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumState

partitionsFor(String) - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

pauseOrResumeSplits(Collection<KafkaPartitionSplit>, Collection<KafkaPartitionSplit>) - Method in class org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader

peek() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Returns the queue's next element without removing it, if the queue is non-empty.

pendingRecords - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Number of unacknowledged records.

persistentKeyBy(DataStream<T>, String, int, int, Properties, int...) - Static method in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffle

Deprecated.

Uses Kafka as a message bus to persist keyBy shuffle.

persistentKeyBy(DataStream<T>, String, int, int, Properties, KeySelector<T, K>) - Static method in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffle

Deprecated.

Uses Kafka as a message bus to persist keyBy shuffle.

physicalDataType - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Data type to configure the formats.

physicalDataType - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Data type to configure the formats.

poll() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Returns the queue's next element and removes it, the queue is non-empty.

pollBatch() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Returns all of the queue's current elements in a list, if the queue is non-empty.

pollNext() - Method in class org.apache.flink.streaming.connectors.kafka.internals.Handover

Deprecated.

Polls the next element from the Handover, possibly blocking until the next element is available.

pollNext(ReaderOutput<T>) - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

pollTimeout - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

From Kafka's Javadoc: The time, in milliseconds, spent waiting in poll if data is not available.

preCommit(FlinkKafkaProducer.KafkaTransactionState) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

produce(ConsumerRecords<byte[], byte[]>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.Handover

Deprecated.

Hands over an element from the producer.

producedDataType - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Data type that describes the final output of the source.

producerConfig - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

User defined properties for the Producer.

PRODUCERS_POOL_EMPTY - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.FlinkKafkaErrorCode

Deprecated.

properties - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Deprecated.

User-supplied properties for Kafka.

properties - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Properties for the Kafka producer.

properties - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Properties for the Kafka consumer.

props - Variable in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

PROPS_BOOTSTRAP_SERVERS - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

PROPS_GROUP_ID - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

R

readKeyBy(String, StreamExecutionEnvironment, TypeInformation<T>, Properties, KeySelector<T, K>) - Static method in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffle

Deprecated.

The read side of FlinkKafkaShuffle.persistentKeyBy(org.apache.flink.streaming.api.datastream.DataStream<T>, java.lang.String, int, int, java.util.Properties, org.apache.flink.api.java.functions.KeySelector<T, K>).

recordCommittedOffset(TopicPartition, long) - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Update the latest committed offset of the given TopicPartition.

recordCurrentOffset(TopicPartition, long) - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Update current consuming offset of the given TopicPartition.

recordFailedCommit() - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Mark a failure commit.

RECORDS_LAG - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

recordSucceededCommit() - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Mark a successful commit.

recoverAndAbort(FlinkKafkaProducer.KafkaTransactionState) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

recoverAndCommit(FlinkKafkaProducer.KafkaTransactionState) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

register(String, KafkaClusterMetricGroup) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroupManager

REGISTER_KAFKA_CONSUMER_METRICS - Static variable in class org.apache.flink.connector.kafka.source.KafkaSourceOptions

registeredReaders() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

registerKafkaConsumerMetrics(KafkaConsumer<?, ?>) - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Register metrics of KafkaConsumer in Kafka metric group.

registerNumBytesIn(KafkaConsumer<?, ?>) - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Register MetricNames.IO_NUM_BYTES_IN.

registerTopicPartition(TopicPartition) - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Register metric groups for the given TopicPartition.

removeRecordsLagMetric(TopicPartition) - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Remove a partition's records-lag metric from tracking list.

reportError(Throwable) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ExceptionProxy

Deprecated.

Sets the exception and interrupts the target thread, if no other exception has occurred so far.

reportError(Throwable) - Method in class org.apache.flink.streaming.connectors.kafka.internals.Handover

Deprecated.

Reports an exception.

requiredOptions() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicTableFactory

requiredOptions() - Method in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory

restoreEnumerator(SplitEnumeratorContext<DynamicKafkaSourceSplit>, DynamicKafkaSourceEnumState) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSource

Restore the DynamicKafkaSourceEnumerator.

restoreEnumerator(SplitEnumeratorContext<KafkaPartitionSplit>, KafkaSourceEnumState) - Method in class org.apache.flink.connector.kafka.source.KafkaSource

restoreWriter(Sink.InitContext, Collection<KafkaWriterState>) - Method in class org.apache.flink.connector.kafka.sink.KafkaSink

restoreWriter(Sink.InitContext, Collection<WriterStateT>) - Method in interface org.apache.flink.connector.kafka.sink.TwoPhaseCommittingStatefulSink

resumeTransaction(long, short) - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

Instead of obtaining producerId and epoch from the transaction coordinator, re-use previously obtained ones, so that we can resume transaction after a restart.

run() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaConsumerThread

Deprecated.

run(SourceFunction.SourceContext<T>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

runFetchLoop() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

runFetchLoop() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher

Deprecated.

runInCoordinatorThread(Runnable) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

S

SAFE_SCALE_DOWN_FACTOR - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

This coefficient determines what is the safe scale down factor.

SCAN_BOUNDED_MODE - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SCAN_BOUNDED_SPECIFIC_OFFSETS - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SCAN_BOUNDED_TIMESTAMP_MILLIS - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SCAN_STARTUP_MODE - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SCAN_STARTUP_SPECIFIC_OFFSETS - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SCAN_STARTUP_TIMESTAMP_MILLIS - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SCAN_TOPIC_PARTITION_DISCOVERY - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

semantic - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Semantic chosen for this instance.

send(ProducerRecord<K, V>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

send(ProducerRecord<K, V>, Callback) - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

sendEventToSourceReader(int, SourceEvent) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

sendOffsetsToTransaction(Map<TopicPartition, OffsetAndMetadata>, String) - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

sendOffsetsToTransaction(Map<TopicPartition, OffsetAndMetadata>, ConsumerGroupMetadata) - Method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

serialize(DynamicKafkaSourceEnumState) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumStateSerializer

serialize(DynamicKafkaSourceSplit) - Method in class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplitSerializer

serialize(KafkaSourceEnumState) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumStateSerializer

serialize(KafkaPartitionSplit) - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplitSerializer

serialize(FlinkKafkaProducer.KafkaTransactionContext, DataOutputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

serialize(FlinkKafkaProducer.KafkaTransactionState, DataOutputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

serialize(FlinkKafkaProducer.NextTransactionalIdHint, DataOutputView) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

serialize(T, Long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaSerializationSchemaWrapper

Deprecated.

serialize(T, Long) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaSerializationSchema

Deprecated.

Serializes given element and returns it as a ProducerRecord.

serialize(T, KafkaRecordSerializationSchema.KafkaSinkContext, Long) - Method in interface org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchema

Serializes given element and returns it as a ProducerRecord.

serializeKey(Tuple2<K, V>) - Method in class org.apache.flink.streaming.util.serialization.TypeInformationKeyValueSerializationSchema

Deprecated.

serializeKey(T) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KeyedSerializationSchemaWrapper

Deprecated.

serializeKey(T) - Method in interface org.apache.flink.streaming.util.serialization.KeyedSerializationSchema

Deprecated.

Serializes the key of the incoming element to a byte array This method might return null if no key is available.

serializeTopicPartitions(Collection<TopicPartition>) - Static method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumStateSerializer

serializeValue(Tuple2<K, V>) - Method in class org.apache.flink.streaming.util.serialization.TypeInformationKeyValueSerializationSchema

Deprecated.

serializeValue(T) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KeyedSerializationSchemaWrapper

Deprecated.

serializeValue(T) - Method in interface org.apache.flink.streaming.util.serialization.KeyedSerializationSchema

Deprecated.

Serializes the value of the incoming element to a byte array.

setAndCheckDiscoveredPartition(KafkaTopicPartition) - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Sets a partition as discovered.

setBootstrapServers(String) - Method in class org.apache.flink.connector.kafka.sink.KafkaSinkBuilder

Sets the Kafka bootstrap servers.

setBootstrapServers(String) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Sets the bootstrap servers for the KafkaConsumer of the KafkaSource.

setBounded(OffsetsInitializer) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set the source in bounded mode and specify what offsets to end at.

setBounded(OffsetsInitializer) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

By default the KafkaSource is set to run as Boundedness.CONTINUOUS_UNBOUNDED and thus never stops until the Flink job fails or is canceled.

setClientIdPrefix(String) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set the client id prefix.

setClientIdPrefix(String) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Sets the client id prefix of this KafkaSource.

setClientIdPrefix(Properties, String) - Static method in class org.apache.flink.connector.kafka.source.KafkaPropertiesUtil

client.id is used for Kafka server side logging, see https://docs.confluent.io/platform/current/installation/configuration/consumer-configs.html#consumerconfigs_client.id

setCommitOffsetsOnCheckpoints(boolean) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Specifies whether or not the consumer should commit offsets back to Kafka on checkpoints.

setCommittedOffset(long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

setCurrentOffset(long) - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplitState

setDeliverGuarantee(DeliveryGuarantee) - Method in class org.apache.flink.connector.kafka.sink.KafkaSinkBuilder

Deprecated.

Will be removed in future versions. Use KafkaSinkBuilder.setDeliveryGuarantee(org.apache.flink.connector.base.DeliveryGuarantee) instead.

setDeliveryGuarantee(DeliveryGuarantee) - Method in class org.apache.flink.connector.kafka.sink.KafkaSinkBuilder

Sets the wanted the DeliveryGuarantee.

setDeserializer(KafkaRecordDeserializationSchema<OUT>) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Sets the deserializer of the ConsumerRecord for KafkaSource.

setDeserializer(KafkaRecordDeserializationSchema<T>) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set the KafkaRecordDeserializationSchema.

setField(Object, String, Object) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

Sets the field fieldName on the given Object object to value using reflection.

setGroupId(String) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set the property for CommonClientConfigs.GROUP_ID_CONFIG.

setGroupId(String) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Sets the consumer group id of the KafkaSource.

setHeaderProvider(HeaderProvider<? super T>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets a HeaderProvider which is used to add headers to the ProducerRecord for the current element.

setKafkaKeySerializer(Class<? extends Serializer<? super T>>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets Kafka's Serializer to serialize incoming elements to the key of the ProducerRecord.

setKafkaKeySerializer(Class<S>, Map<String, String>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets a configurable Kafka Serializer and pass a configuration to serialize incoming elements to the key of the ProducerRecord.

setKafkaMetadataService(KafkaMetadataService) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set the KafkaMetadataService.

setKafkaMetric(Metric) - Method in class org.apache.flink.streaming.connectors.kafka.internals.metrics.KafkaMetricMutableWrapper

setKafkaProducerConfig(Properties) - Method in class org.apache.flink.connector.kafka.sink.KafkaSinkBuilder

Sets the configuration which used to instantiate all used KafkaProducer.

setKafkaStreamSubscriber(KafkaStreamSubscriber) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set a custom Kafka stream subscriber.

setKafkaSubscriber(KafkaSubscriber) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Set a custom Kafka subscriber to use to discover new splits.

setKafkaValueSerializer(Class<? extends Serializer<? super T>>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets Kafka's Serializer to serialize incoming elements to the value of the ProducerRecord.

setKafkaValueSerializer(Class<S>, Map<String, String>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets a configurable Kafka Serializer and pass a configuration to serialize incoming elements to the value of the ProducerRecord.

setKeySerializationSchema(SerializationSchema<? super T>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets a SerializationSchema which is used to serialize the incoming element to the key of the ProducerRecord.

setLogFailuresOnly(boolean) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Defines whether the producer should fail on errors, or only log them.

setNumParallelInstances(int) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaSerializationSchemaWrapper

Deprecated.

setNumParallelInstances(int) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaContextAware

Deprecated.

Sets the parallelism with which the parallel task of the Kafka Producer runs.

setOffset(long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

setParallelInstanceId(int) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaSerializationSchemaWrapper

Deprecated.

setParallelInstanceId(int) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaContextAware

Deprecated.

Sets the number of the parallel subtask that the Kafka Producer is running on.

setPartitioner(KafkaPartitioner<? super T>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets a custom partitioner determining the target partition of the target topic.

setPartitioner(FlinkKafkaPartitioner<? super T>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Deprecated.

use KafkaRecordSerializationSchemaBuilder.setPartitioner(KafkaPartitioner)

setPartitions(int[]) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaSerializationSchemaWrapper

Deprecated.

setPartitions(int[]) - Method in interface org.apache.flink.streaming.connectors.kafka.KafkaContextAware

Deprecated.

Sets the available partitions for the topic returned from KafkaContextAware.getTargetTopic(Object).

setPartitions(Set<TopicPartition>) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Set a set of partitions to consume from.

setPendingBytesGauge(Gauge<Long>) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

setPendingRecordsGauge(Gauge<Long>) - Method in class org.apache.flink.connector.kafka.dynamic.source.metrics.KafkaClusterMetricGroup

setProperties(Properties) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set the properties of the consumers.

setProperties(Properties) - Method in class org.apache.flink.connector.kafka.lineage.DefaultKafkaDatasetFacet

setProperties(Properties) - Method in interface org.apache.flink.connector.kafka.lineage.KafkaDatasetFacet

setProperties(Properties) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Set arbitrary properties for the KafkaSource and KafkaConsumer.

setProperty(String, String) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set a property for the consumers.

setProperty(String, String) - Method in class org.apache.flink.connector.kafka.sink.KafkaSinkBuilder

setProperty(String, String) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Set an arbitrary property for the KafkaSource and KafkaConsumer.

setRackIdSupplier(SerializableSupplier<String>) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Set the clientRackId supplier to be passed down to the KafkaPartitionSplitReader.

setRecordSerializer(KafkaRecordSerializationSchema<IN>) - Method in class org.apache.flink.connector.kafka.sink.KafkaSinkBuilder

Sets the KafkaRecordSerializationSchema that transforms incoming records to ProducerRecords.

setStartFromEarliest() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Specifies the consumer to start reading from the earliest offset for all partitions.

setStartFromGroupOffsets() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Specifies the consumer to start reading from any committed group offsets found in Zookeeper / Kafka brokers.

setStartFromLatest() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Specifies the consumer to start reading from the latest offset for all partitions.

setStartFromSpecificOffsets(Map<KafkaTopicPartition, Long>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Specifies the consumer to start reading partitions from specific offsets, set independently for each partition.

setStartFromTimestamp(long) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

Specifies the consumer to start reading partitions from a specified timestamp.

setStartingOffsets(OffsetsInitializer) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set the starting offsets of the stream.

setStartingOffsets(OffsetsInitializer) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Specify from which offsets the KafkaSource should start consuming from by providing an OffsetsInitializer.

setStreamIds(Set<String>) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set the stream ids belonging to the KafkaMetadataService.

setStreamPattern(Pattern) - Method in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceBuilder

Set the stream pattern to determine stream ids belonging to the KafkaMetadataService.

setTopic(String) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets a fixed topic which used as destination for all records.

setTopicPattern(Pattern) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Set a topic pattern to consume from use the java Pattern.

setTopics(String...) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Set a list of topics the KafkaSource should consume from.

setTopics(List<String>) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Set a list of topics the KafkaSource should consume from.

setTopicSelector(TopicSelector<? super T>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets a topic selector which computes the target topic for every incoming record.

setTransactionalIdPrefix(String) - Method in class org.apache.flink.connector.kafka.sink.KafkaSinkBuilder

Sets the prefix for all created transactionalIds if DeliveryGuarantee.EXACTLY_ONCE is configured.

setTransactionalIdPrefix(String) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Specifies the prefix of the transactional.id property to be used by the producers when communicating with Kafka.

setUnbounded(OffsetsInitializer) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

By default the KafkaSource is set to run as Boundedness.CONTINUOUS_UNBOUNDED and thus never stops until the Flink job fails or is canceled.

setValueOnlyDeserializer(DeserializationSchema<OUT>) - Method in class org.apache.flink.connector.kafka.source.KafkaSourceBuilder

Sets the deserializer of the ConsumerRecord for KafkaSource.

setValueSerializationSchema(SerializationSchema<T>) - Method in class org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder

Sets a SerializationSchema which is used to serialize the incoming element to the value of the ProducerRecord.

setWriteTimestamp(boolean) - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaSerializationSchemaWrapper

Deprecated.

setWriteTimestampToKafka(boolean) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

If set to true, Flink will write the (event time) timestamp attached to each record into Kafka.

shutdown() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaConsumerThread

Deprecated.

Shuts this thread down, waking up the thread gracefully if blocked (without Thread.interrupt() calls).

signalNoMoreSplits(int) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

SingleClusterTopicMetadataService - Class in org.apache.flink.connector.kafka.dynamic.metadata

A KafkaMetadataService that delegates metadata fetching to a single AdminClient, which is scoped to a single cluster.

SingleClusterTopicMetadataService(String, Properties) - Constructor for class org.apache.flink.connector.kafka.dynamic.metadata.SingleClusterTopicMetadataService

Create a SingleClusterTopicMetadataService.

SINK_BUFFER_FLUSH_INTERVAL - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SINK_BUFFER_FLUSH_MAX_ROWS - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SINK_CHANGELOG_MODE - Static variable in class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory.EncodingFormatWrapper

SINK_PARALLELISM - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SINK_PARTITIONER - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

SinkBufferFlushMode - Class in org.apache.flink.streaming.connectors.kafka.table

Sink buffer flush configuration.

SinkBufferFlushMode(int, long) - Constructor for class org.apache.flink.streaming.connectors.kafka.table.SinkBufferFlushMode

size() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

Gets the number of elements currently in the queue.

snapshotConfiguration() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.ContextStateSerializer

Deprecated.

snapshotConfiguration() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHintSerializer

Deprecated.

snapshotConfiguration() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

snapshotCurrentState() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

Takes a snapshot of the partition offsets.

snapshotState(long) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumerator

Besides for checkpointing, this method is used in the restart sequence to retain the relevant assigned splits so that there is no reader duplicate split assignment.

snapshotState(long) - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

snapshotState(long) - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator

snapshotState(long) - Method in class org.apache.flink.connector.kafka.source.reader.KafkaSourceReader

snapshotState(FunctionSnapshotContext) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

Deprecated.

snapshotState(FunctionSnapshotContext) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

sourceContext - Variable in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

The source context to emit records and watermarks to.

SourceContextWatermarkOutputAdapter<T> - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

SourceContextWatermarkOutputAdapter(SourceFunction.SourceContext<T>) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.SourceContextWatermarkOutputAdapter

Deprecated.

sourceLineageVertexOf(Collection<LineageDataset>) - Static method in class org.apache.flink.connector.kafka.lineage.LineageUtil

SPECIFIC_OFFSETS - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.BoundedMode

End from user-supplied specific offsets for each partition.

SPECIFIC_OFFSETS - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.StartupMode

Start from user-supplied specific offsets for each partition.

SPECIFIC_OFFSETS - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanBoundedMode

SPECIFIC_OFFSETS - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanStartupMode

specificBoundedOffsets - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Specific end offsets; only relevant when bounded mode is BoundedMode.SPECIFIC_OFFSETS.

specificStartupOffsets - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Specific startup offsets; only relevant when startup mode is StartupMode.SPECIFIC_OFFSETS.

splitId() - Method in class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplit

splitId() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

start() - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.DynamicKafkaSourceEnumerator

Discover Kafka clusters and initialize sub enumerators.

start() - Method in class org.apache.flink.connector.kafka.dynamic.source.reader.DynamicKafkaSourceReader

This is invoked first only in reader startup without state.

start() - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator

Start the enumerator.

startupMode - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

The startup mode for the contained consumer (default is StartupMode.GROUP_OFFSETS).

StartupMode - Enum Class in org.apache.flink.streaming.connectors.kafka.config

Startup modes for the Kafka Consumer.

startupTimestampMillis - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

The start timestamp to locate partition offsets; only relevant when startup mode is StartupMode.TIMESTAMP.

StoppableKafkaEnumContextProxy - Class in org.apache.flink.connector.kafka.dynamic.source.enumerator

A proxy enumerator context that supports life cycle management of underlying threads related to a sub KafkaSourceEnumerator.

StoppableKafkaEnumContextProxy(String, KafkaMetadataService, SplitEnumeratorContext<DynamicKafkaSourceSplit>, Runnable) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

Constructor for the enumerator context.

StoppableKafkaEnumContextProxy.HandledFlinkKafkaException - Exception Class in org.apache.flink.connector.kafka.dynamic.source.enumerator

General exception to signal to internal exception handling mechanisms that a benign error occurred.

StoppableKafkaEnumContextProxy.StoppableKafkaEnumContextProxyFactory - Interface in org.apache.flink.connector.kafka.dynamic.source.enumerator

This factory exposes a way to override the StoppableKafkaEnumContextProxy used in the enumerator.

STREAM_METADATA_DISCOVERY_FAILURE_THRESHOLD - Static variable in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceOptions

STREAM_METADATA_DISCOVERY_INTERVAL_MS - Static variable in class org.apache.flink.connector.kafka.dynamic.source.DynamicKafkaSourceOptions

StreamPatternSubscriber - Class in org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber

To subscribe to streams based on a pattern.

StreamPatternSubscriber(Pattern) - Constructor for class org.apache.flink.connector.kafka.dynamic.source.enumerator.subscriber.StreamPatternSubscriber

subscribedPartitionStates() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

Gets all partitions (with partition state) that this fetcher is subscribed to.

supportsMetadataProjection() - Method in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

sync(Metric, Counter) - Static method in class org.apache.flink.connector.kafka.MetricUtil

Ensures that the counter has the same value as the given Kafka metric.

T

tableIdentifier - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

TAG_REC_WITH_TIMESTAMP - Static variable in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffleProducer.KafkaSerializer

Deprecated.

TAG_REC_WITHOUT_TIMESTAMP - Static variable in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffleProducer.KafkaSerializer

Deprecated.

TAG_WATERMARK - Static variable in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffleProducer.KafkaSerializer

Deprecated.

timestamp(long) - Static method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializer

Get an OffsetsInitializer which initializes the offsets in each partition so that the initialized offset is the offset of the first record whose record timestamp is greater than or equals the given timestamp (milliseconds).

TIMESTAMP - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.BoundedMode

End from user-supplied timestamp for each partition.

TIMESTAMP - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.StartupMode

Start from user-supplied timestamp for each partition.

TIMESTAMP - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanBoundedMode

TIMESTAMP - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanStartupMode

toKafkaPartitionSplit() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplitState

Use the current offset as the starting offset to create a new KafkaPartitionSplit.

toLineageName() - Method in interface org.apache.flink.connector.kafka.lineage.KafkaDatasetIdentifier

Assigns lineage dataset's name which is topic pattern if it is present or comma separated list of topics.

TOPIC - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

TOPIC_GROUP - Static variable in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

TOPIC_PATTERN - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

topicPartition() - Method in class org.apache.flink.connector.kafka.source.enumerator.TopicPartitionAndAssignmentStatus

TopicPartitionAndAssignmentStatus - Class in org.apache.flink.connector.kafka.source.enumerator

Kafka partition with assign status.

TopicPartitionAndAssignmentStatus(TopicPartition, AssignmentStatus) - Constructor for class org.apache.flink.connector.kafka.source.enumerator.TopicPartitionAndAssignmentStatus

topicPartitionsMap - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Partitions of each topic.

topicPattern - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

The Kafka topic pattern of topics allowed to produce to.

topicPattern - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

The Kafka topic pattern to consume.

topics - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

The Kafka topics to allow for producing.

topics - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

The Kafka topics to consume.

TopicSelector<IN> - Interface in org.apache.flink.connector.kafka.sink

Selects a topic for the incoming record.

toSplitId(TopicPartition) - Static method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

toSplitType(String, KafkaPartitionSplitState) - Method in class org.apache.flink.connector.kafka.source.reader.KafkaSourceReader

toString() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.ClusterMetadata

toString() - Method in class org.apache.flink.connector.kafka.dynamic.metadata.KafkaStream

toString() - Method in class org.apache.flink.connector.kafka.dynamic.source.MetadataUpdateEvent

toString() - Method in class org.apache.flink.connector.kafka.dynamic.source.split.DynamicKafkaSourceSplit

toString() - Method in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

toString() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.KafkaTransactionState

Deprecated.

toString() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.NextTransactionalIdHint

Deprecated.

toString() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ClosableBlockingQueue

Deprecated.

toString() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition

Deprecated.

toString() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionLeader

Deprecated.

toString() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionState

Deprecated.

toString() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionStateWithWatermarkGenerator

Deprecated.

toString() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicsDescriptor

Deprecated.

toString() - Method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanBoundedMode

toString() - Method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanStartupMode

toString(List<KafkaTopicPartition>) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition

Deprecated.

toString(Map<KafkaTopicPartition, Long>) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition

Deprecated.

TRANSACTIONAL_ID_PREFIX - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

transactionalId - Variable in class org.apache.flink.streaming.connectors.kafka.internals.FlinkKafkaInternalProducer

Deprecated.

TransactionalIdsGenerator - Class in org.apache.flink.streaming.connectors.kafka.internals

Deprecated.

TransactionalIdsGenerator(String, int, int, int, int) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.TransactionalIdsGenerator

Deprecated.

TransactionStateSerializer() - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer

Deprecated.

TransactionStateSerializerSnapshot() - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.TransactionStateSerializer.TransactionStateSerializerSnapshot

Deprecated.

TwoPhaseCommittingStatefulSink<InputT,WriterStateT,CommT> - Interface in org.apache.flink.connector.kafka.sink

A combination of TwoPhaseCommittingSink and StatefulSink.

TwoPhaseCommittingStatefulSink.PrecommittingStatefulSinkWriter<InputT,WriterStateT,CommT> - Interface in org.apache.flink.connector.kafka.sink

A combination of TwoPhaseCommittingSink.PrecommittingSinkWriter and StatefulSink.StatefulSinkWriter.

TYPE_FACET_NAME - Static variable in class org.apache.flink.connector.kafka.lineage.DefaultTypeDatasetFacet

TypeDatasetFacet - Interface in org.apache.flink.connector.kafka.lineage

Facet definition to contain type information of source and sink.

TypeDatasetFacetProvider - Interface in org.apache.flink.connector.kafka.lineage

Contains method to extract TypeDatasetFacet.

TypeInformationKeyValueSerializationSchema<K,V> - Class in org.apache.flink.streaming.util.serialization

Deprecated.

TypeInformationKeyValueSerializationSchema(Class<K>, Class<V>, ExecutionConfig) - Constructor for class org.apache.flink.streaming.util.serialization.TypeInformationKeyValueSerializationSchema

Deprecated.

Creates a new de-/serialization schema for the given types.

TypeInformationKeyValueSerializationSchema(TypeInformation<K>, TypeInformation<V>, ExecutionConfig) - Constructor for class org.apache.flink.streaming.util.serialization.TypeInformationKeyValueSerializationSchema

Deprecated.

Creates a new de-/serialization schema for the given types.

U

UNASSIGNED_INITIAL - Enum constant in enum class org.apache.flink.connector.kafka.source.enumerator.AssignmentStatus

The partitions that have been discovered during initialization but not assigned to readers yet.

unassignedInitialPartitions() - Method in class org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumState

unassignedPartitionsQueue - Variable in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

Queue of partitions that are not yet assigned to any Kafka clients for consuming.

UNBOUNDED - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.config.BoundedMode

Do not end consuming.

UNBOUNDED - Enum constant in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanBoundedMode

updateNumBytesInCounter() - Method in class org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics

Update MetricNames.IO_NUM_BYTES_IN.

UpsertKafkaDynamicTableFactory - Class in org.apache.flink.streaming.connectors.kafka.table

Upsert-Kafka factory.

UpsertKafkaDynamicTableFactory() - Constructor for class org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactory

UpsertKafkaDynamicTableFactory.DecodingFormatWrapper - Class in org.apache.flink.streaming.connectors.kafka.table

It is used to wrap the decoding format and expose the desired changelog mode.

UpsertKafkaDynamicTableFactory.EncodingFormatWrapper - Class in org.apache.flink.streaming.connectors.kafka.table

It is used to wrap the encoding format and expose the desired changelog mode.

upsertMode - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Flag to determine sink mode.

upsertMode - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Flag to determine source mode.

V

VALID_STARTING_OFFSET_MARKERS - Static variable in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

VALID_STOPPING_OFFSET_MARKERS - Static variable in class org.apache.flink.connector.kafka.source.split.KafkaPartitionSplit

validate(Properties) - Method in interface org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializerValidator

Validate offsets initializer with properties of Kafka source.

VALUE_FIELDS_INCLUDE - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

VALUE_FORMAT - Static variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions

valueDecodingFormat - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Format for decoding values from Kafka.

valueEncodingFormat - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Format for encoding values to Kafka.

valueOf(String) - Static method in enum class org.apache.flink.connector.kafka.source.enumerator.AssignmentStatus

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class org.apache.flink.streaming.connectors.kafka.config.BoundedMode

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class org.apache.flink.streaming.connectors.kafka.config.OffsetCommitMode

Deprecated.

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class org.apache.flink.streaming.connectors.kafka.config.StartupMode

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class org.apache.flink.streaming.connectors.kafka.FlinkKafkaErrorCode

Deprecated.

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.Semantic

Deprecated.

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanBoundedMode

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanStartupMode

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ValueFieldsStrategy

Returns the enum constant of this class with the specified name.

valueOnly(Class<? extends Deserializer<V>>) - Static method in interface org.apache.flink.connector.kafka.source.reader.deserializer.KafkaRecordDeserializationSchema

Wraps a Kafka Deserializer to a KafkaRecordDeserializationSchema.

valueOnly(Class<D>, Map<String, String>) - Static method in interface org.apache.flink.connector.kafka.source.reader.deserializer.KafkaRecordDeserializationSchema

Wraps a Kafka Deserializer to a KafkaRecordDeserializationSchema.

valueOnly(DeserializationSchema<V>) - Static method in interface org.apache.flink.connector.kafka.source.reader.deserializer.KafkaRecordDeserializationSchema

Wraps a DeserializationSchema as the value deserialization schema of the ConsumerRecords.

valueProjection - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSink

Indices that determine the value fields and the source position in the consumed row.

valueProjection - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Indices that determine the value fields and the target position in the produced row.

values() - Static method in enum class org.apache.flink.connector.kafka.source.enumerator.AssignmentStatus

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class org.apache.flink.streaming.connectors.kafka.config.BoundedMode

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class org.apache.flink.streaming.connectors.kafka.config.OffsetCommitMode

Deprecated.

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class org.apache.flink.streaming.connectors.kafka.config.StartupMode

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class org.apache.flink.streaming.connectors.kafka.FlinkKafkaErrorCode

Deprecated.

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.Semantic

Deprecated.

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanBoundedMode

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ScanStartupMode

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class org.apache.flink.streaming.connectors.kafka.table.KafkaConnectorOptions.ValueFieldsStrategy

Returns an array containing the constants of this enum class, in the order they are declared.

W

wakeup() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Interrupt an in-progress discovery attempt by throwing a AbstractPartitionDiscoverer.WakeupException.

wakeUp() - Method in class org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader

wakeupConnections() - Method in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Deprecated.

Attempt to eagerly wakeup from blocking calls to Kafka in AbstractPartitionDiscoverer.getAllTopics() and AbstractPartitionDiscoverer.getAllPartitionsForTopics(List).

wakeupConnections() - Method in class org.apache.flink.streaming.connectors.kafka.internals.KafkaPartitionDiscoverer

Deprecated.

WakeupException() - Constructor for exception class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer.WakeupException

Deprecated.

WakeupException() - Constructor for exception class org.apache.flink.streaming.connectors.kafka.internals.Handover.WakeupException

Deprecated.

wakeupProducer() - Method in class org.apache.flink.streaming.connectors.kafka.internals.Handover

Deprecated.

Wakes the producer thread up.

watermarkOutput - Variable in class org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher

Deprecated.

Wrapper around our SourceContext for allowing the WatermarkGenerator to emit watermarks and mark idleness.

watermarkStrategy - Variable in class org.apache.flink.streaming.connectors.kafka.table.KafkaDynamicSource

Watermark strategy that is used to generate per-partition watermark.

wrapCallAsyncCallable(Callable<T>) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

Wraps callable in call async executed in worker thread pool with exception propagation to optimize on doing IO in non-coordinator thread.

wrapCallAsyncCallableHandler(BiConsumer<T, Throwable>) - Method in class org.apache.flink.connector.kafka.dynamic.source.enumerator.StoppableKafkaEnumContextProxy

Handle exception that is propagated by a callable, executed on coordinator thread.

writeKeyBy(DataStream<T>, String, Properties, int...) - Static method in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffle

Deprecated.

The write side of FlinkKafkaShuffle.persistentKeyBy(org.apache.flink.streaming.api.datastream.DataStream<T>, java.lang.String, int, int, java.util.Properties, org.apache.flink.api.java.functions.KeySelector<T, K>).

writeKeyBy(DataStream<T>, String, Properties, KeySelector<T, K>) - Static method in class org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffle

Deprecated.

The write side of FlinkKafkaShuffle.persistentKeyBy(org.apache.flink.streaming.api.datastream.DataStream<T>, java.lang.String, int, int, java.util.Properties, org.apache.flink.api.java.functions.KeySelector<T, K>).

writeTimestampToKafka - Variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Deprecated.

Flag controlling whether we are writing the Flink record's timestamp into Kafka.

A B C D E F G H I J K L M N O P R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form