org.apache.flink.connector.pulsar.source.reader

Class PulsarPartitionSplitReader<T>

java.lang.Object

org.apache.flink.connector.pulsar.source.reader.PulsarPartitionSplitReader<T>

Type Parameters:

T - the type of the record to be emitted from the Source.

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.flink.connector.base.source.reader.splitreader.SplitReader<ParsedMessage<T>,PulsarPartitionSplit>

public class PulsarPartitionSplitReader<T>
extends Object
implements org.apache.flink.connector.base.source.reader.splitreader.SplitReader<ParsedMessage<T>,PulsarPartitionSplit>, Closeable

A SplitReader implementation that reads records from Pulsar partitions.

The returned type are in the format of tuple3(record, offset and timestamp.

Constructor Summary

Constructors

Constructor and Description
PulsarPartitionSplitReader(org.apache.flink.configuration.Configuration configuration, org.apache.pulsar.client.impl.conf.ConsumerConfigurationData<byte[]> consumerConfigurationData, org.apache.pulsar.client.api.PulsarClient client, org.apache.pulsar.client.admin.PulsarAdmin pulsarAdmin, MessageDeserializer<T> messageDeserializer, org.apache.pulsar.client.util.ExecutorProvider listenerExecutor)

Method Summary

Modifier and Type	Method and Description
void	close()
CompletableFuture<PartitionReader>	createPartitionReaderAsync(PulsarPartitionSplit split)
org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<ParsedMessage<T>>	fetch()
void	handleSplitsChanges(org.apache.flink.connector.base.source.reader.splitreader.SplitsChange<PulsarPartitionSplit> splitsChange)
void	wakeUp()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PulsarPartitionSplitReader

public PulsarPartitionSplitReader(org.apache.flink.configuration.Configuration configuration,
                                  org.apache.pulsar.client.impl.conf.ConsumerConfigurationData<byte[]> consumerConfigurationData,
                                  org.apache.pulsar.client.api.PulsarClient client,
                                  org.apache.pulsar.client.admin.PulsarAdmin pulsarAdmin,
                                  MessageDeserializer<T> messageDeserializer,
                                  org.apache.pulsar.client.util.ExecutorProvider listenerExecutor)

Method Detail

close

public void close()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.apache.flink.connector.base.source.reader.splitreader.SplitReader<ParsedMessage<T>,PulsarPartitionSplit>

fetch

public org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<ParsedMessage<T>> fetch()

Specified by:

fetch in interface org.apache.flink.connector.base.source.reader.splitreader.SplitReader<ParsedMessage<T>,PulsarPartitionSplit>

handleSplitsChanges

public void handleSplitsChanges(org.apache.flink.connector.base.source.reader.splitreader.SplitsChange<PulsarPartitionSplit> splitsChange)

Specified by:

handleSplitsChanges in interface org.apache.flink.connector.base.source.reader.splitreader.SplitReader<ParsedMessage<T>,PulsarPartitionSplit>

createPartitionReaderAsync

public CompletableFuture<PartitionReader> createPartitionReaderAsync(PulsarPartitionSplit split)
                                                              throws org.apache.pulsar.client.api.PulsarClientException

Throws:

org.apache.pulsar.client.api.PulsarClientException

wakeUp

public void wakeUp()

Specified by:

wakeUp in interface org.apache.flink.connector.base.source.reader.splitreader.SplitReader<ParsedMessage<T>,PulsarPartitionSplit>