org.apache.flink.streaming.connectors.pulsar.internal

Class SourceSinkUtils

java.lang.Object

org.apache.flink.streaming.connectors.pulsar.internal.SourceSinkUtils

public class SourceSinkUtils
extends Object

Utilities for source sink options parsing.

Constructor Summary

Constructors

Constructor and Description
SourceSinkUtils()

Method Summary

Modifier and Type	Method and Description
static boolean	belongsTo(TopicRange topicRange, int numParallelSubtasks, int index)
static org.apache.pulsar.client.api.Range	distributeRange(int countOfSubTasks, int indexOfSubTasks) Get shard information of the task Fragmentation rules, Can be divided equally: each subtask handles the same range of tasks Not evenly divided: each subtask first processes the tasks in the same range, and the remainder part is added to the tasks starting at index 0 until it is used up.
static boolean	failOnWrite(Map<String,String> parameters)
static boolean	flushOnCheckpoint(Map<String,String> parameters)
static int	getClientCacheSize(Map<String,String> parameters)
static int	getCommitMaxRetries(Map<String,String> parameters)
static boolean	getFailOnDataLossAndRemoveKey(Map<String,Object> readerConf)
static long	getMaxBlockTimeMs(Map<String,String> parameters)
static int	getOldStateVersion(Map<String,String> caseInsensitiveParams, int defaultValue)
static long	getPartitionDiscoveryIntervalInMillis(Map<String,String> parameters)
static int	getPollTimeoutMs(Map<String,String> parameters)
static Map<String,Object>	getProducerParams(Map<String,String> parameters)
static Map<String,Object>	getReaderParams(Map<String,String> parameters)
static int	getSendTimeoutMs(Map<String,String> parameters)
static long	getTransactionTimeout(Map<String,String> parameters)
static boolean	getUseEarliestWhenDataLossAndRemoveKey(Map<String,Object> readerConf)
static boolean	getUseMetrics(Map<String,String> parameters)
static Map<String,String>	toCaceInsensitiveParams(Map<String,String> parameters)
static Map<String,String>	validateStreamSourceOptions(Map<String,String> parameters)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SourceSinkUtils

public SourceSinkUtils()

Method Detail

validateStreamSourceOptions

public static Map<String,String> validateStreamSourceOptions(Map<String,String> parameters)

belongsTo

public static boolean belongsTo(TopicRange topicRange,
                                int numParallelSubtasks,
                                int index)

getPartitionDiscoveryIntervalInMillis

public static long getPartitionDiscoveryIntervalInMillis(Map<String,String> parameters)

getSendTimeoutMs

public static int getSendTimeoutMs(Map<String,String> parameters)

getPollTimeoutMs

public static int getPollTimeoutMs(Map<String,String> parameters)

getUseMetrics

public static boolean getUseMetrics(Map<String,String> parameters)

getCommitMaxRetries

public static int getCommitMaxRetries(Map<String,String> parameters)

getClientCacheSize

public static int getClientCacheSize(Map<String,String> parameters)

flushOnCheckpoint

public static boolean flushOnCheckpoint(Map<String,String> parameters)

failOnWrite

public static boolean failOnWrite(Map<String,String> parameters)

getTransactionTimeout

public static long getTransactionTimeout(Map<String,String> parameters)

getMaxBlockTimeMs

public static long getMaxBlockTimeMs(Map<String,String> parameters)

getReaderParams

public static Map<String,Object> getReaderParams(Map<String,String> parameters)

toCaceInsensitiveParams

public static Map<String,String> toCaceInsensitiveParams(Map<String,String> parameters)

getProducerParams

public static Map<String,Object> getProducerParams(Map<String,String> parameters)

distributeRange

public static org.apache.pulsar.client.api.Range distributeRange(int countOfSubTasks,
                                                                 int indexOfSubTasks)

Get shard information of the task Fragmentation rules, Can be divided equally: each subtask handles the same range of tasks Not evenly divided: each subtask first processes the tasks in the same range, and the remainder part is added to the tasks starting at index 0 until it is used up.

Parameters:

countOfSubTasks - total subtasks

indexOfSubTasks - current subtask index on subtasks

Returns:

task range

getOldStateVersion

public static int getOldStateVersion(Map<String,String> caseInsensitiveParams,
                                     int defaultValue)

getFailOnDataLossAndRemoveKey

public static boolean getFailOnDataLossAndRemoveKey(Map<String,Object> readerConf)

getUseEarliestWhenDataLossAndRemoveKey

public static boolean getUseEarliestWhenDataLossAndRemoveKey(Map<String,Object> readerConf)