org.apache.flink.streaming.connectors.kafka.api.persistent

Class PersistentKafkaSource<T>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichParallelSourceFunction<T>

org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer<T>

org.apache.flink.streaming.connectors.kafka.api.persistent.PersistentKafkaSource<T>

Type Parameters:

T - The type of elements produced by this consumer.

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>, Checkpointed<long[]>, CheckpointedAsynchronously<long[]>, CheckpointNotifier, ParallelSourceFunction<T>, SourceFunction<T>

Deprecated.

Due to Kafka protocol and architecture (offset handling) changes, please use the Kafka version specific consumers, like FlinkKafkaConsumer081, FlinkKafkaConsumer082, etc.

@Deprecated
public class PersistentKafkaSource<T>
extends FlinkKafkaConsumer<T>

Creates a Kafka consumer compatible with reading from Kafka 0.8.1+ consumers. This class is provided as a migration path from the old Flink kafka connectors to the new, updated implemntations. Please use FlinkKafkaConsumer081 and FlinkKafkaConsumer082.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

FlinkKafkaConsumer.FetcherType, FlinkKafkaConsumer.OffsetStore

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

SourceFunction.SourceContext<T>

Field Summary

Fields inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

DEFAULT_GET_PARTITIONS_RETRIES, GET_PARTITIONS_RETRIES_KEY, MAX_NUM_PENDING_CHECKPOINTS, OFFSET_NOT_SET

Constructor Summary

Constructors

Constructor and Description
PersistentKafkaSource(String topic, DeserializationSchema<T> valueDeserializer, kafka.consumer.ConsumerConfig consumerConfig) Deprecated. Creates a new Kafka 0.8.2.x streaming source consumer.

Method Summary

Methods inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

assignPartitions, cancel, close, getPartitionsForTopic, getProducedType, notifyCheckpointComplete, open, restoreState, run, snapshotState, validateZooKeeperConfig

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PersistentKafkaSource

public PersistentKafkaSource(String topic,
                     DeserializationSchema<T> valueDeserializer,
                     kafka.consumer.ConsumerConfig consumerConfig)

Deprecated.

Creates a new Kafka 0.8.2.x streaming source consumer.

Parameters:

topic - The name of the topic that should be consumed.

valueDeserializer - The de-/serializer used to convert between Kafka's byte messages and Flink's objects.

consumerConfig - The consumer config used to configure the Kafka consumer client, and the ZooKeeper client.