org.apache.flink.streaming.connectors.kafka.internals

Class Kafka08PartitionDiscoverer

java.lang.Object

org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

org.apache.flink.streaming.connectors.kafka.internals.Kafka08PartitionDiscoverer

@Internal
public class Kafka08PartitionDiscoverer
extends org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

A partition discoverer that can be used to discover topics and partitions metadata from Kafka brokers via the Kafka 0.8 low-level consumer API.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer.ClosedException, org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer.WakeupException

Constructor Summary

Constructors

Constructor and Description
Kafka08PartitionDiscoverer(org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicsDescriptor topicsDescriptor, int indexOfThisSubtask, int numParallelSubtasks, Properties kafkaProperties)

Method Summary

Modifier and Type	Method and Description
protected void	closeConnections()
List<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition>	getAllPartitionsForTopics(List<String> topics)
protected List<String>	getAllTopics()
List<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionLeader>	getPartitionLeadersForTopics(List<String> topics) Send request to Kafka to get partitions for topics.
protected void	initializeConnections()
protected void	wakeupConnections()

Methods inherited from class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

close, discoverPartitions, open, setAndCheckDiscoveredPartition, wakeup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Kafka08PartitionDiscoverer

public Kafka08PartitionDiscoverer(org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicsDescriptor topicsDescriptor,
                                  int indexOfThisSubtask,
                                  int numParallelSubtasks,
                                  Properties kafkaProperties)

Method Detail

initializeConnections

protected void initializeConnections()

Specified by:

initializeConnections in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

getAllTopics

protected List<String> getAllTopics()

Specified by:

getAllTopics in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

getAllPartitionsForTopics

public List<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition> getAllPartitionsForTopics(List<String> topics)

Specified by:

getAllPartitionsForTopics in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

wakeupConnections

protected void wakeupConnections()

Specified by:

wakeupConnections in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

closeConnections

protected void closeConnections()
                         throws Exception

Specified by:

closeConnections in class org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer

Throws:

Exception

getPartitionLeadersForTopics

public List<org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionLeader> getPartitionLeadersForTopics(List<String> topics)

Send request to Kafka to get partitions for topics.

Parameters:

topics - The name of the topics.