org.apache.flink.streaming.connectors.kafka.internals

Class ZookeeperOffsetHandler

java.lang.Object

org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler

All Implemented Interfaces:

OffsetHandler

public class ZookeeperOffsetHandler
extends Object
implements OffsetHandler

Handler for committing Kafka offsets to Zookeeper and to retrieve them again.

Constructor Summary

Constructors

Constructor and Description
ZookeeperOffsetHandler(Properties props)

Method Summary

Modifier and Type	Method and Description
void	close() Closes the offset handler, releasing all resources.
void	commit(Map<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition,Long> offsetsToCommit) Commits the given offset for the partitions.
static long	getOffsetFromZooKeeper(org.apache.curator.framework.CuratorFramework curatorClient, String groupId, String topic, int partition)
Map<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition,Long>	getOffsets(List<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition> partitions) Positions the given fetcher to the initial read offsets where the stream consumption will start from.
static void	setOffsetInZooKeeper(org.apache.curator.framework.CuratorFramework curatorClient, String groupId, String topic, int partition, long offset)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ZookeeperOffsetHandler

public ZookeeperOffsetHandler(Properties props)

Method Detail

commit

public void commit(Map<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition,Long> offsetsToCommit)
            throws Exception

Description copied from interface: OffsetHandler

Commits the given offset for the partitions. May commit the offsets to the Kafka broker, or to ZooKeeper, based on its configured behavior.

Specified by:

commit in interface OffsetHandler

Parameters:

offsetsToCommit - The offset to commit, per partition.

Throws:

Exception

getOffsets

public Map<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition,Long> getOffsets(List<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition> partitions)
                                                                                               throws Exception

Description copied from interface: OffsetHandler

Positions the given fetcher to the initial read offsets where the stream consumption will start from.

Specified by:

getOffsets in interface OffsetHandler

Parameters:

partitions - The partitions for which to seeks the fetcher to the beginning.

Throws:

Exception

close

public void close()
           throws IOException

Description copied from interface: OffsetHandler

Closes the offset handler, releasing all resources.

Specified by:

close in interface OffsetHandler

Throws:

IOException - Thrown, if the closing fails.

setOffsetInZooKeeper

public static void setOffsetInZooKeeper(org.apache.curator.framework.CuratorFramework curatorClient,
                                        String groupId,
                                        String topic,
                                        int partition,
                                        long offset)
                                 throws Exception

Throws:

Exception

getOffsetFromZooKeeper

public static long getOffsetFromZooKeeper(org.apache.curator.framework.CuratorFramework curatorClient,
                                          String groupId,
                                          String topic,
                                          int partition)
                                   throws Exception

Throws:

Exception