org.apache.flink.streaming.connectors.pulsar.internal

Class ReaderThread<T>

java.lang.Object

java.lang.Thread

org.apache.flink.streaming.connectors.pulsar.internal.ReaderThread<T>

Type Parameters:

T - the record type that read from each Pulsar message.

All Implemented Interfaces:

Runnable

public class ReaderThread<T>
extends Thread

Actual working thread that read a specific Pulsar topic.

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

Thread.State, Thread.UncaughtExceptionHandler

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.pulsar.client.impl.conf.ClientConfigurationData	clientConf
protected boolean	closed
protected PulsarDeserializationSchema<T>	deserializer
protected ExceptionProxy	exceptionProxy
protected boolean	excludeMessageId
protected PulsarFetcher<T>	owner
protected int	pollTimeoutMs
protected org.apache.pulsar.client.api.Reader<T>	reader
protected Map<String,Object>	readerConf
protected boolean	running
protected org.apache.pulsar.client.api.MessageId	startMessageId
protected PulsarTopicState<T>	state
protected TopicRange	topicRange

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
ReaderThread(PulsarFetcher<T> owner, PulsarTopicState state, org.apache.pulsar.client.impl.conf.ClientConfigurationData clientConf, Map<String,Object> readerConf, PulsarDeserializationSchema<T> deserializer, int pollTimeoutMs, ExceptionProxy exceptionProxy)
ReaderThread(PulsarFetcher<T> owner, PulsarTopicState state, org.apache.pulsar.client.impl.conf.ClientConfigurationData clientConf, Map<String,Object> readerConf, PulsarDeserializationSchema<T> deserializer, int pollTimeoutMs, ExceptionProxy exceptionProxy, boolean failOnDataLoss, boolean useEarliestWhenDataLoss, boolean excludeMessageId)

Method Summary

Modifier and Type	Method and Description
void	cancel()
void	close()
protected void	createActualReader()
protected void	emitRecord(org.apache.pulsar.client.api.Message<T> message)
protected void	handleTooLargeCursor()
boolean	isRunning()
static boolean	messageIdRoughEquals(org.apache.pulsar.client.api.MessageId l, org.apache.pulsar.client.api.MessageId r) used to check whether starting position and current message we got actually are equal we neglect the potential batchIdx deliberately while seeking to MessageIdImpl for batch entry.
void	run()

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

owner

protected final PulsarFetcher<T> owner

state

protected final PulsarTopicState<T> state

clientConf

protected final org.apache.pulsar.client.impl.conf.ClientConfigurationData clientConf

readerConf

protected final Map<String,Object> readerConf

pollTimeoutMs

protected final int pollTimeoutMs

exceptionProxy

protected final ExceptionProxy exceptionProxy

topicRange

protected final TopicRange topicRange

startMessageId

protected org.apache.pulsar.client.api.MessageId startMessageId

excludeMessageId

protected boolean excludeMessageId

running

protected volatile boolean running

closed

protected volatile boolean closed

deserializer

protected final PulsarDeserializationSchema<T> deserializer

reader

protected volatile org.apache.pulsar.client.api.Reader<T> reader

Constructor Detail

ReaderThread

public ReaderThread(PulsarFetcher<T> owner,
                    PulsarTopicState state,
                    org.apache.pulsar.client.impl.conf.ClientConfigurationData clientConf,
                    Map<String,Object> readerConf,
                    PulsarDeserializationSchema<T> deserializer,
                    int pollTimeoutMs,
                    ExceptionProxy exceptionProxy)

ReaderThread

public ReaderThread(PulsarFetcher<T> owner,
                    PulsarTopicState state,
                    org.apache.pulsar.client.impl.conf.ClientConfigurationData clientConf,
                    Map<String,Object> readerConf,
                    PulsarDeserializationSchema<T> deserializer,
                    int pollTimeoutMs,
                    ExceptionProxy exceptionProxy,
                    boolean failOnDataLoss,
                    boolean useEarliestWhenDataLoss,
                    boolean excludeMessageId)

Method Detail

run

public void run()

Specified by:

run in interface Runnable

Overrides:

run in class Thread

createActualReader

protected void createActualReader()
                           throws org.apache.pulsar.client.api.PulsarClientException

Throws:

org.apache.pulsar.client.api.PulsarClientException

handleTooLargeCursor

protected void handleTooLargeCursor()

emitRecord

protected void emitRecord(org.apache.pulsar.client.api.Message<T> message)
                   throws IOException

Throws:

IOException

cancel

public void cancel()
            throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Throws:

IOException

isRunning

public boolean isRunning()

messageIdRoughEquals

public static boolean messageIdRoughEquals(org.apache.pulsar.client.api.MessageId l,
                                           org.apache.pulsar.client.api.MessageId r)

used to check whether starting position and current message we got actually are equal we neglect the potential batchIdx deliberately while seeking to MessageIdImpl for batch entry.