org.apache.flink.streaming.connectors.kafka.internals

Class ZookeeperOffsetHandler

java.lang.Object

org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

All Implemented Interfaces:

OffsetHandler

public class ZookeeperOffsetHandler
extends Object
implements OffsetHandler

Constructor Summary

Constructors

Constructor and Description
ZookeeperOffsetHandler(Properties props)

Method Summary

Modifier and Type	Method and Description
void	close() Closes the offset handler, releasing all resources.
void	commit(Map<org.apache.kafka.common.TopicPartition,Long> offsetsToCommit) Commits the given offset for the partitions.
static long	getOffsetFromZooKeeper(org.I0Itec.zkclient.ZkClient zkClient, String groupId, String topic, int partition)
void	seekFetcherToInitialOffsets(List<org.apache.kafka.common.TopicPartition> partitions, Fetcher fetcher) Positions the given fetcher to the initial read offsets where the stream consumption will start from.
static void	setOffsetInZooKeeper(org.I0Itec.zkclient.ZkClient zkClient, String groupId, String topic, int partition, long offset)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ZookeeperOffsetHandler

public ZookeeperOffsetHandler(Properties props)

Method Detail

commit

public void commit(Map<org.apache.kafka.common.TopicPartition,Long> offsetsToCommit)

Description copied from interface: OffsetHandler

Commits the given offset for the partitions. May commit the offsets to the Kafka broker, or to ZooKeeper, based on its configured behavior.

Specified by:

commit in interface OffsetHandler

Parameters:

offsetsToCommit - The offset to commit, per partition.

seekFetcherToInitialOffsets

public void seekFetcherToInitialOffsets(List<org.apache.kafka.common.TopicPartition> partitions,
                                        Fetcher fetcher)

Description copied from interface: OffsetHandler

Positions the given fetcher to the initial read offsets where the stream consumption will start from.

Specified by:

seekFetcherToInitialOffsets in interface OffsetHandler

Parameters:

partitions - The partitions for which to seeks the fetcher to the beginning.

fetcher - The fetcher that will pull data from Kafka and must be positioned.

close

public void close()
           throws IOException

Description copied from interface: OffsetHandler

Closes the offset handler, releasing all resources.

Specified by:

close in interface OffsetHandler

Throws:

IOException - Thrown, if the closing fails.

setOffsetInZooKeeper

public static void setOffsetInZooKeeper(org.I0Itec.zkclient.ZkClient zkClient,
                                        String groupId,
                                        String topic,
                                        int partition,
                                        long offset)

getOffsetFromZooKeeper

public static long getOffsetFromZooKeeper(org.I0Itec.zkclient.ZkClient zkClient,
                                          String groupId,
                                          String topic,
                                          int partition)