org.apache.flink.connector.kafka.source.enumerator

Class KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl

java.lang.Object

org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl

All Implemented Interfaces:

AutoCloseable, OffsetsInitializer.PartitionOffsetsRetriever

Enclosing class:

KafkaSourceEnumerator

@VisibleForTesting
public static class KafkaSourceEnumerator.PartitionOffsetsRetrieverImpl
extends Object
implements OffsetsInitializer.PartitionOffsetsRetriever, AutoCloseable

The implementation for offsets retriever with a consumer and an admin client.

Constructor Summary

Constructors

Constructor and Description
PartitionOffsetsRetrieverImpl(org.apache.kafka.clients.consumer.KafkaConsumer<?,?> consumer, org.apache.kafka.clients.admin.AdminClient adminClient, String groupId)

Method Summary

Modifier and Type	Method and Description
Map<org.apache.kafka.common.TopicPartition,Long>	beginningOffsets(Collection<org.apache.kafka.common.TopicPartition> partitions)
void	close()
Map<org.apache.kafka.common.TopicPartition,Long>	committedOffsets(Collection<org.apache.kafka.common.TopicPartition> partitions) The group id should be the set for KafkaSource before invoking this method.
Map<org.apache.kafka.common.TopicPartition,Long>	endOffsets(Collection<org.apache.kafka.common.TopicPartition> partitions)
Map<org.apache.kafka.common.TopicPartition,org.apache.kafka.clients.consumer.OffsetAndTimestamp>	offsetsForTimes(Map<org.apache.kafka.common.TopicPartition,Long> timestampsToSearch)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PartitionOffsetsRetrieverImpl

public PartitionOffsetsRetrieverImpl(org.apache.kafka.clients.consumer.KafkaConsumer<?,?> consumer,
                                     org.apache.kafka.clients.admin.AdminClient adminClient,
                                     String groupId)

Method Detail

committedOffsets

public Map<org.apache.kafka.common.TopicPartition,Long> committedOffsets(Collection<org.apache.kafka.common.TopicPartition> partitions)

Description copied from interface: OffsetsInitializer.PartitionOffsetsRetriever

The group id should be the set for KafkaSource before invoking this method. Otherwise an IllegalStateException will be thrown.

Specified by:

committedOffsets in interface OffsetsInitializer.PartitionOffsetsRetriever

See Also:

KafkaAdminClient.listConsumerGroupOffsets(String, ListConsumerGroupOffsetsOptions)

endOffsets

public Map<org.apache.kafka.common.TopicPartition,Long> endOffsets(Collection<org.apache.kafka.common.TopicPartition> partitions)

Specified by:

endOffsets in interface OffsetsInitializer.PartitionOffsetsRetriever

See Also:

KafkaConsumer.endOffsets(Collection)

beginningOffsets

public Map<org.apache.kafka.common.TopicPartition,Long> beginningOffsets(Collection<org.apache.kafka.common.TopicPartition> partitions)

Specified by:

beginningOffsets in interface OffsetsInitializer.PartitionOffsetsRetriever

See Also:

KafkaConsumer.beginningOffsets(Collection)

offsetsForTimes

public Map<org.apache.kafka.common.TopicPartition,org.apache.kafka.clients.consumer.OffsetAndTimestamp> offsetsForTimes(Map<org.apache.kafka.common.TopicPartition,Long> timestampsToSearch)

Specified by:

offsetsForTimes in interface OffsetsInitializer.PartitionOffsetsRetriever

See Also:

KafkaConsumer.offsetsForTimes(Map)

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception