org.apache.flink.connector.kafka.source.reader

Class KafkaPartitionSplitReader<T>

java.lang.Object

org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader<T>

Type Parameters:

T - the type of the record to be emitted from the Source.

All Implemented Interfaces:

org.apache.flink.connector.base.source.reader.splitreader.SplitReader<org.apache.flink.api.java.tuple.Tuple3<T,Long,Long>,KafkaPartitionSplit>

public class KafkaPartitionSplitReader<T>
extends Object
implements org.apache.flink.connector.base.source.reader.splitreader.SplitReader<org.apache.flink.api.java.tuple.Tuple3<T,Long,Long>,KafkaPartitionSplit>

A SplitReader implementation that reads records from Kafka partitions.

The returned type are in the format of tuple3(record, offset and timestamp.

Constructor Summary

Constructors

Constructor and Description
KafkaPartitionSplitReader(Properties props, KafkaRecordDeserializationSchema<T> deserializationSchema, org.apache.flink.api.connector.source.SourceReaderContext context, KafkaSourceReaderMetrics kafkaSourceReaderMetrics)

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.api.java.tuple.Tuple3<T,Long,Long>>	fetch()
void	handleSplitsChanges(org.apache.flink.connector.base.source.reader.splitreader.SplitsChange<KafkaPartitionSplit> splitsChange)
void	notifyCheckpointComplete(Map<org.apache.kafka.common.TopicPartition,org.apache.kafka.clients.consumer.OffsetAndMetadata> offsetsToCommit, org.apache.kafka.clients.consumer.OffsetCommitCallback offsetCommitCallback)
void	wakeUp()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KafkaPartitionSplitReader

public KafkaPartitionSplitReader(Properties props,
                                 KafkaRecordDeserializationSchema<T> deserializationSchema,
                                 org.apache.flink.api.connector.source.SourceReaderContext context,
                                 KafkaSourceReaderMetrics kafkaSourceReaderMetrics)

Method Detail

fetch

public org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.flink.api.java.tuple.Tuple3<T,Long,Long>> fetch()
                                                                                                                             throws IOException

Specified by:

fetch in interface org.apache.flink.connector.base.source.reader.splitreader.SplitReader<org.apache.flink.api.java.tuple.Tuple3<T,Long,Long>,KafkaPartitionSplit>

Throws:

IOException

handleSplitsChanges

public void handleSplitsChanges(org.apache.flink.connector.base.source.reader.splitreader.SplitsChange<KafkaPartitionSplit> splitsChange)

Specified by:

handleSplitsChanges in interface org.apache.flink.connector.base.source.reader.splitreader.SplitReader<org.apache.flink.api.java.tuple.Tuple3<T,Long,Long>,KafkaPartitionSplit>

wakeUp

public void wakeUp()

Specified by:

wakeUp in interface org.apache.flink.connector.base.source.reader.splitreader.SplitReader<org.apache.flink.api.java.tuple.Tuple3<T,Long,Long>,KafkaPartitionSplit>

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.connector.base.source.reader.splitreader.SplitReader<org.apache.flink.api.java.tuple.Tuple3<T,Long,Long>,KafkaPartitionSplit>

Throws:

Exception

notifyCheckpointComplete

public void notifyCheckpointComplete(Map<org.apache.kafka.common.TopicPartition,org.apache.kafka.clients.consumer.OffsetAndMetadata> offsetsToCommit,
                                     org.apache.kafka.clients.consumer.OffsetCommitCallback offsetCommitCallback)