org.apache.flink.streaming.connectors.kafka

Class FlinkKafkaConsumer082<T>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichParallelSourceFunction<T>

org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer<T>

org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer082<T>

Type Parameters:

T - The type of elements produced by this consumer.

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>, Checkpointed<long[]>, CheckpointedAsynchronously<long[]>, CheckpointNotifier, ParallelSourceFunction<T>, SourceFunction<T>

public class FlinkKafkaConsumer082<T>
extends FlinkKafkaConsumer<T>

Creates a Kafka consumer compatible with reading from Kafka 0.8.2.x brokers. The consumer will internally use the old low-level Kafka API, and manually commit offsets partition offsets to ZooKeeper. Once Kafka released the new consumer with Kafka 0.8.3 Flink might use the 0.8.3 consumer API also against Kafka 0.8.2 installations.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

FlinkKafkaConsumer.FetcherType, FlinkKafkaConsumer.OffsetStore

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

SourceFunction.SourceContext<T>

Field Summary

Fields inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

DEFAULT_GET_PARTITIONS_RETRIES, GET_PARTITIONS_RETRIES_KEY, MAX_NUM_PENDING_CHECKPOINTS, OFFSET_NOT_SET

Constructor Summary

Constructors

Constructor and Description
FlinkKafkaConsumer082(String topic, DeserializationSchema<T> valueDeserializer, Properties props) Creates a new Kafka 0.8.2.x streaming source consumer.

Method Summary

Methods inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

assignPartitions, cancel, close, getPartitionsForTopic, getProducedType, notifyCheckpointComplete, open, restoreState, run, snapshotState, validateZooKeeperConfig

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkKafkaConsumer082

public FlinkKafkaConsumer082(String topic,
                     DeserializationSchema<T> valueDeserializer,
                     Properties props)

Creates a new Kafka 0.8.2.x streaming source consumer.

Parameters:

topic - The name of the topic that should be consumed.

valueDeserializer - The de-/serializer used to convert between Kafka's byte messages and Flink's objects.

props - The properties used to configure the Kafka consumer client, and the ZooKeeper client.