A C D F G I K L M N O P R S V Z

A

assignPartitions(int[], String, int, int) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

C

cancel() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

close() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

close() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

close() - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Closes the fetcher.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

close() - Method in interface org.apache.flink.streaming.connectors.kafka.internals.OffsetHandler

Closes the offset handler, releasing all resources.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

commit(Map<TopicPartition, Long>) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.OffsetHandler

Commits the given offset for the partitions.

commit(Map<TopicPartition, Long>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

D

DEFAULT_GET_PARTITIONS_RETRIES - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Default number of retries for getting the partition info.

deserialize(byte[]) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZooKeeperStringSerializer

F

Fetcher - Interface in org.apache.flink.streaming.connectors.kafka.internals

A fetcher pulls data from Kafka, from a fix set of partitions.

FixedPartitioner - Class in org.apache.flink.streaming.connectors.kafka.partitioner

A partitioner ensuring that each internal Flink partition ends up in one Kafka partition.

FixedPartitioner() - Constructor for class org.apache.flink.streaming.connectors.kafka.partitioner.FixedPartitioner

FlinkKafkaConsumer<T> - Class in org.apache.flink.streaming.connectors.kafka

The Flink Kafka Consumer is a streaming data source that pulls a parallel data stream from Apache Kafka.

FlinkKafkaConsumer(String, DeserializationSchema<T>, Properties, FlinkKafkaConsumer.OffsetStore, FlinkKafkaConsumer.FetcherType) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Creates a new Flink Kafka Consumer, using the given type of fetcher and offset handler.

FlinkKafkaConsumer.FetcherType - Enum in org.apache.flink.streaming.connectors.kafka

The fetcher type defines which code paths to use to pull data from teh Kafka broker.

FlinkKafkaConsumer.OffsetStore - Enum in org.apache.flink.streaming.connectors.kafka

The offset store defines how acknowledged offsets are committed back to Kafka.

FlinkKafkaConsumer081<T> - Class in org.apache.flink.streaming.connectors.kafka

Creates a Kafka consumer compatible with reading from Kafka 0.8.1.x brokers.

FlinkKafkaConsumer081(String, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer081

Creates a new Kafka 0.8.1.x streaming source consumer.

FlinkKafkaConsumer082<T> - Class in org.apache.flink.streaming.connectors.kafka

Creates a Kafka consumer compatible with reading from Kafka 0.8.2.x brokers.

FlinkKafkaConsumer082(String, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer082

Creates a new Kafka 0.8.2.x streaming source consumer.

FlinkKafkaProducer<IN> - Class in org.apache.flink.streaming.connectors.kafka

Flink Sink to produce data into a Kafka topic.

FlinkKafkaProducer(String, String, SerializationSchema<IN, byte[]>) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer(String, SerializationSchema<IN, byte[]>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Creates a FlinkKafkaProducer for a given topic.

FlinkKafkaProducer(String, SerializationSchema<IN, byte[]>, Properties, KafkaPartitioner) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

The main constructor for creating a FlinkKafkaProducer.

G

GET_PARTITIONS_RETRIES_KEY - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Configuration key for the number of retries for getting the partition info

getOffsetFromZooKeeper(ZkClient, String, String, int) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

getPartitionsForTopic(String, Properties) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Send request to Kafka to get partitions for topic.

getProducedType() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

getPropertiesFromBrokerList(String) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

I

invoke(IN) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Called when new data arrives to the sink, and forwards it to Kafka.

K

KafkaPartitioner - Class in org.apache.flink.streaming.connectors.kafka.partitioner

Extended Kafka Partitioner.

KafkaPartitioner() - Constructor for class org.apache.flink.streaming.connectors.kafka.partitioner.KafkaPartitioner

KafkaSink<IN> - Class in org.apache.flink.streaming.connectors.kafka.api

Deprecated.

Please use the FlinkKafkaProducer instead.

KafkaSink(String, String, SerializationSchema<IN, byte[]>) - Constructor for class org.apache.flink.streaming.connectors.kafka.api.KafkaSink

Deprecated.

L

LegacyFetcher - Class in org.apache.flink.streaming.connectors.kafka.internals

This fetcher uses Kafka's low-level API to pull data from a specific set of partitions and offsets for a certain topic.

LegacyFetcher(String, Properties, String) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

M

MAX_NUM_PENDING_CHECKPOINTS - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

The maximum number of pending non-committed checkpoints to track, to avoid memory leaks

N

notifyCheckpointComplete(long) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

O

OFFSET_NOT_SET - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Magic number to define an unset offset.

OffsetHandler - Interface in org.apache.flink.streaming.connectors.kafka.internals

The offset handler is responsible for locating the initial partition offsets where the source should start reading, as well as committing offsets from completed checkpoints.

open(Configuration) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

open(Configuration) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Initializes the connection to Kafka.

open(int, int, int[]) - Method in class org.apache.flink.streaming.connectors.kafka.partitioner.FixedPartitioner

open(int, int, int[]) - Method in class org.apache.flink.streaming.connectors.kafka.partitioner.KafkaPartitioner

Initializer for the Partitioner.

org.apache.flink.streaming.connectors.kafka - package org.apache.flink.streaming.connectors.kafka

org.apache.flink.streaming.connectors.kafka.api - package org.apache.flink.streaming.connectors.kafka.api

org.apache.flink.streaming.connectors.kafka.api.persistent - package org.apache.flink.streaming.connectors.kafka.api.persistent

org.apache.flink.streaming.connectors.kafka.internals - package org.apache.flink.streaming.connectors.kafka.internals

org.apache.flink.streaming.connectors.kafka.partitioner - package org.apache.flink.streaming.connectors.kafka.partitioner

P

partition(Object, int) - Method in class org.apache.flink.streaming.connectors.kafka.internals.PartitionerWrapper

partition(Object, int) - Method in class org.apache.flink.streaming.connectors.kafka.partitioner.FixedPartitioner

PartitionerWrapper - Class in org.apache.flink.streaming.connectors.kafka.internals

Hacky wrapper to send an object instance through a Properties - map.

PartitionerWrapper(VerifiableProperties) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.PartitionerWrapper

PersistentKafkaSource<T> - Class in org.apache.flink.streaming.connectors.kafka.api.persistent

Deprecated.

Due to Kafka protocol and architecture (offset handling) changes, please use the Kafka version specific consumers, like FlinkKafkaConsumer081, FlinkKafkaConsumer082, etc.

PersistentKafkaSource(String, DeserializationSchema<T>, ConsumerConfig) - Constructor for class org.apache.flink.streaming.connectors.kafka.api.persistent.PersistentKafkaSource

Deprecated.

Creates a new Kafka 0.8.2.x streaming source consumer.

R

restoreState(long[]) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

run(SourceFunction.SourceContext<T>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

run(SourceFunction.SourceContext<T>, DeserializationSchema<T>, long[]) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Starts fetch data from Kafka and emitting it into the stream.

run(SourceFunction.SourceContext<T>, DeserializationSchema<T>, long[]) - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

S

seek(TopicPartition, long) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Set the next offset to read from for the given partition.

seek(TopicPartition, long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

seekFetcherToInitialOffsets(List<TopicPartition>, Fetcher) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.OffsetHandler

Positions the given fetcher to the initial read offsets where the stream consumption will start from.

seekFetcherToInitialOffsets(List<TopicPartition>, Fetcher) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

serialize(Object) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZooKeeperStringSerializer

SERIALIZED_WRAPPER_NAME - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.PartitionerWrapper

setLogFailuresOnly(boolean) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

Defines whether the producer should fail on errors, or only log them.

setOffsetInZooKeeper(ZkClient, String, String, int, long) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

setPartitionsToRead(List<TopicPartition>) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Set which partitions the fetcher should pull from.

setPartitionsToRead(List<TopicPartition>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

snapshotState(long, long) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

stopWithError(Throwable) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Exit run loop with given error and release all resources.

stopWithError(Throwable) - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

Reports an error from a fetch thread.

V

validateZooKeeperConfig(Properties) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Validate the ZK configuration, checking for required parameters

valueOf(String) - Static method in enum org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.FetcherType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.OffsetStore

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.FetcherType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.OffsetStore

Returns an array containing the constants of this enum type, in the order they are declared.

Z

ZookeeperOffsetHandler - Class in org.apache.flink.streaming.connectors.kafka.internals

ZookeeperOffsetHandler(Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

ZooKeeperStringSerializer - Class in org.apache.flink.streaming.connectors.kafka.internals

Simple ZooKeeper serializer for Strings.

ZooKeeperStringSerializer() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ZooKeeperStringSerializer

A C D F G I K L M N O P R S V Z