org.apache.flink.streaming.connectors.kafka.api.persistent

Class PersistentKafkaSource<T>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichParallelSourceFunction<T>

org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer<T>

org.apache.flink.streaming.connectors.kafka.api.persistent.PersistentKafkaSource<T>

Type Parameters:

T - The type of elements produced by this consumer.

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>, org.apache.flink.streaming.api.checkpoint.Checkpointed<long[]>, org.apache.flink.streaming.api.checkpoint.CheckpointedAsynchronously<long[]>, org.apache.flink.streaming.api.checkpoint.CheckpointNotifier, org.apache.flink.streaming.api.functions.source.ParallelSourceFunction<T>, org.apache.flink.streaming.api.functions.source.SourceFunction<T>

Deprecated.

@Deprecated
public class PersistentKafkaSource<T>
extends FlinkKafkaConsumer<T>

Creates a Kafka consumer compatible with reading from Kafka 0.8.1+ consumers. This class is provided as a migration path from the old Flink kafka connectors to the new, updated implemntations. Please use FlinkKafkaConsumer081 and FlinkKafkaConsumer082.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

FlinkKafkaConsumer.FetcherType, FlinkKafkaConsumer.OffsetStore

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.source.SourceFunction

org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T>

Field Summary

Fields inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

DEFAULT_GET_PARTITIONS_RETRIES, GET_PARTITIONS_RETRIES_KEY, MAX_NUM_PENDING_CHECKPOINTS, OFFSET_NOT_SET

Constructor Summary

Constructors

Constructor and Description
PersistentKafkaSource(String topic, org.apache.flink.streaming.util.serialization.DeserializationSchema<T> valueDeserializer, kafka.consumer.ConsumerConfig consumerConfig) Deprecated. Creates a new Kafka 0.8.2.x streaming source consumer.

Method Summary

Methods inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

assignPartitions, cancel, close, getPartitionsForTopic, getProducedType, notifyCheckpointComplete, open, restoreState, run, snapshotState, validateZooKeeperConfig

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PersistentKafkaSource

public PersistentKafkaSource(String topic,
                             org.apache.flink.streaming.util.serialization.DeserializationSchema<T> valueDeserializer,
                             kafka.consumer.ConsumerConfig consumerConfig)

Deprecated.

Creates a new Kafka 0.8.2.x streaming source consumer.

Parameters:

topic - The name of the topic that should be consumed.

valueDeserializer - The de-/serializer used to convert between Kafka's byte messages and Flink's objects.

consumerConfig - The consumer config used to configure the Kafka consumer client, and the ZooKeeper client.