A C D F G I K L M O P R S V Z

A

assignPartitions(int[], String, int, int) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

C

cancel() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

close() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

close() - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Closes the fetcher.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

close() - Method in interface org.apache.flink.streaming.connectors.kafka.internals.OffsetHandler

Closes the offset handler, releasing all resources.

close() - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

close() - Method in class org.apache.flink.streaming.connectors.kafka.KafkaSink

commit(Map<TopicPartition, Long>) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.OffsetHandler

Commits the given offset for the partitions.

commit(Map<TopicPartition, Long>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

commitCheckpoint(long) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

D

DEFAULT_GET_PARTITIONS_RETRIES - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Default number of retries for getting the partition info.

deserialize(byte[]) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZooKeeperStringSerializer

F

Fetcher - Interface in org.apache.flink.streaming.connectors.kafka.internals

A fetcher pulls data from Kafka, from a fix set of partitions.

FlinkKafkaConsumer<T> - Class in org.apache.flink.streaming.connectors.kafka

The Flink Kafka Consumer is a streaming data source that pulls a parallel data stream from Apache Kafka.

FlinkKafkaConsumer(String, DeserializationSchema<T>, Properties, FlinkKafkaConsumer.OffsetStore, FlinkKafkaConsumer.FetcherType) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Creates a new Flink Kafka Consumer, using the given type of fetcher and offset handler.

FlinkKafkaConsumer.FetcherType - Enum in org.apache.flink.streaming.connectors.kafka

The fetcher type defines which code paths to use to pull data from teh Kafka broker.

FlinkKafkaConsumer.OffsetStore - Enum in org.apache.flink.streaming.connectors.kafka

The offset store defines how acknowledged offsets are committed back to Kafka.

FlinkKafkaConsumer081<T> - Class in org.apache.flink.streaming.connectors.kafka

Creates a Kafka consumer compatible with reading from Kafka 0.8.1.x brokers.

FlinkKafkaConsumer081(String, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer081

Creates a new Kafka 0.8.1.x streaming source consumer.

FlinkKafkaConsumer082<T> - Class in org.apache.flink.streaming.connectors.kafka

Creates a Kafka consumer compatible with reading from Kafka 0.8.2.x brokers.

FlinkKafkaConsumer082(String, DeserializationSchema<T>, Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer082

Creates a new Kafka 0.8.2.x streaming source consumer.

G

GET_PARTITIONS_RETRIES_KEY - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Configuration key for the number of retries for getting the partition info

getOffsetFromZooKeeper(ZkClient, String, String, int) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

getPartitionsForTopic(String, Properties) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Send request to Kafka to get partitions for topic.

getProducedType() - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

I

invoke(IN) - Method in class org.apache.flink.streaming.connectors.kafka.KafkaSink

Called when new data arrives to the sink, and forwards it to Kafka.

K

KafkaSink<IN> - Class in org.apache.flink.streaming.connectors.kafka.api

Deprecated.

KafkaSink(String, String, SerializationSchema<IN, byte[]>) - Constructor for class org.apache.flink.streaming.connectors.kafka.api.KafkaSink

Deprecated.

KafkaSink<IN> - Class in org.apache.flink.streaming.connectors.kafka

Sink that emits its inputs to a Kafka topic.

KafkaSink(String, String, SerializationSchema<IN, byte[]>) - Constructor for class org.apache.flink.streaming.connectors.kafka.KafkaSink

Creates a KafkaSink for a given topic.

KafkaSink(String, String, Properties, SerializationSchema<IN, byte[]>) - Constructor for class org.apache.flink.streaming.connectors.kafka.KafkaSink

Creates a KafkaSink for a given topic with custom Producer configuration.

KafkaSink(String, String, SerializationSchema<IN, byte[]>, SerializableKafkaPartitioner) - Constructor for class org.apache.flink.streaming.connectors.kafka.KafkaSink

Creates a KafkaSink for a given topic.

KafkaSink(String, String, SerializationSchema<IN, byte[]>, Class<? extends SerializableKafkaPartitioner>) - Constructor for class org.apache.flink.streaming.connectors.kafka.KafkaSink

L

LegacyFetcher - Class in org.apache.flink.streaming.connectors.kafka.internals

This fetcher uses Kafka's low-level API to pull data from a specific set of partitions and offsets for a certain topic.

LegacyFetcher(String, Properties, String) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

M

MAX_NUM_PENDING_CHECKPOINTS - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

The maximum number of pending non-committed checkpoints to track, to avoid memory leaks

O

OFFSET_NOT_SET - Static variable in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

Magic number to define an unset offset.

OffsetHandler - Interface in org.apache.flink.streaming.connectors.kafka.internals

The offset handler is responsible for locating the initial partition offsets where the source should start reading, as well as committing offsets from completed checkpoints.

open(Configuration) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

open(Configuration) - Method in class org.apache.flink.streaming.connectors.kafka.KafkaSink

Initializes the connection to Kafka.

org.apache.flink.streaming.connectors.kafka - package org.apache.flink.streaming.connectors.kafka

org.apache.flink.streaming.connectors.kafka.api - package org.apache.flink.streaming.connectors.kafka.api

org.apache.flink.streaming.connectors.kafka.api.persistent - package org.apache.flink.streaming.connectors.kafka.api.persistent

org.apache.flink.streaming.connectors.kafka.internals - package org.apache.flink.streaming.connectors.kafka.internals

P

partition(Object, int) - Method in class org.apache.flink.streaming.connectors.kafka.internals.PartitionerWrapper

PartitionerWrapper - Class in org.apache.flink.streaming.connectors.kafka.internals

Hacky wrapper to send an object instance through a Properties - map.

PartitionerWrapper(VerifiableProperties) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.PartitionerWrapper

PersistentKafkaSource<T> - Class in org.apache.flink.streaming.connectors.kafka.api.persistent

Deprecated.

PersistentKafkaSource(String, DeserializationSchema<T>, ConsumerConfig) - Constructor for class org.apache.flink.streaming.connectors.kafka.api.persistent.PersistentKafkaSource

Deprecated.

Creates a new Kafka 0.8.2.x streaming source consumer.

R

restoreState(long[]) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

run(SourceFunction.SourceContext<T>) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

run(SourceFunction.SourceContext<T>, DeserializationSchema<T>, long[]) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Starts fetch data from Kafka and emitting it into the stream.

run(SourceFunction.SourceContext<T>, DeserializationSchema<T>, long[]) - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

S

seek(TopicPartition, long) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Set the next offset to read from for the given partition.

seek(TopicPartition, long) - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

seekFetcherToInitialOffsets(List<TopicPartition>, Fetcher) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.OffsetHandler

Positions the given fetcher to the initial read offsets where the stream consumption will start from.

seekFetcherToInitialOffsets(List<TopicPartition>, Fetcher) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

SerializableKafkaPartitioner - Interface in org.apache.flink.streaming.connectors.kafka

serialize(Object) - Method in class org.apache.flink.streaming.connectors.kafka.internals.ZooKeeperStringSerializer

SERIALIZED_WRAPPER_NAME - Static variable in class org.apache.flink.streaming.connectors.kafka.internals.PartitionerWrapper

setOffsetInZooKeeper(ZkClient, String, String, int, long) - Static method in class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

setPartitionsToRead(List<TopicPartition>) - Method in interface org.apache.flink.streaming.connectors.kafka.internals.Fetcher

Set which partitions the fetcher should pull from.

setPartitionsToRead(List<TopicPartition>) - Method in class org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher

snapshotState(long, long) - Method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

V

validateZooKeeperConfig(Properties) - Static method in class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

valueOf(String) - Static method in enum org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.FetcherType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.OffsetStore

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.FetcherType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.OffsetStore

Returns an array containing the constants of this enum type, in the order they are declared.

Z

ZookeeperOffsetHandler - Class in org.apache.flink.streaming.connectors.kafka.internals

ZookeeperOffsetHandler(Properties) - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

ZooKeeperStringSerializer - Class in org.apache.flink.streaming.connectors.kafka.internals

Simple ZooKeeper serializer for Strings.

ZooKeeperStringSerializer() - Constructor for class org.apache.flink.streaming.connectors.kafka.internals.ZooKeeperStringSerializer

A C D F G I K L M O P R S V Z