| Package | Description |
|---|---|
| org.apache.flink.connector.pulsar.source | |
| org.apache.flink.streaming.connectors.pulsar | |
| org.apache.flink.streaming.connectors.pulsar.internal |
| Modifier and Type | Method and Description |
|---|---|
TopicRange |
BrokerPartition.getTopicRange() |
| Modifier and Type | Method and Description |
|---|---|
void |
BrokerPartition.setTopicRange(TopicRange topicRange) |
| Constructor and Description |
|---|
BrokerPartition(TopicRange topicRange) |
| Modifier and Type | Method and Description |
|---|---|
Map<TopicRange,org.apache.pulsar.client.api.MessageId> |
FlinkPulsarSource.getOwnedTopicStarts() |
Map<Long,Map<TopicRange,org.apache.pulsar.client.api.MessageId>> |
FlinkPulsarSource.getPendingOffsetsToCommit() |
Map<TopicRange,org.apache.pulsar.client.api.MessageId> |
FlinkPulsarSource.offsetForEachTopic(Set<TopicRange> topics,
StartupMode mode,
Map<TopicRange,org.apache.pulsar.client.api.MessageId> specificStartupOffsets) |
| Modifier and Type | Method and Description |
|---|---|
protected PulsarFetcher<T> |
FlinkPulsarSource.createFetcher(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
Map<TopicRange,org.apache.pulsar.client.api.MessageId> seedTopicsWithInitialOffsets,
org.apache.flink.util.SerializedValue<org.apache.flink.api.common.eventtime.WatermarkStrategy<T>> watermarkStrategy,
org.apache.flink.streaming.runtime.tasks.ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
org.apache.flink.streaming.api.operators.StreamingRuntimeContext streamingRuntime,
boolean useMetrics,
Set<TopicRange> excludeStartMessageIds) |
protected PulsarFetcher<T> |
FlinkPulsarSource.createFetcher(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
Map<TopicRange,org.apache.pulsar.client.api.MessageId> seedTopicsWithInitialOffsets,
org.apache.flink.util.SerializedValue<org.apache.flink.api.common.eventtime.WatermarkStrategy<T>> watermarkStrategy,
org.apache.flink.streaming.runtime.tasks.ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
org.apache.flink.streaming.api.operators.StreamingRuntimeContext streamingRuntime,
boolean useMetrics,
Set<TopicRange> excludeStartMessageIds) |
Map<TopicRange,org.apache.pulsar.client.api.MessageId> |
FlinkPulsarSource.offsetForEachTopic(Set<TopicRange> topics,
StartupMode mode,
Map<TopicRange,org.apache.pulsar.client.api.MessageId> specificStartupOffsets) |
Map<TopicRange,org.apache.pulsar.client.api.MessageId> |
FlinkPulsarSource.offsetForEachTopic(Set<TopicRange> topics,
StartupMode mode,
Map<TopicRange,org.apache.pulsar.client.api.MessageId> specificStartupOffsets) |
| Modifier and Type | Field and Description |
|---|---|
protected TopicRange |
ReaderThread.topicRange |
| Modifier and Type | Field and Description |
|---|---|
protected Set<TopicRange> |
PulsarFetcher.excludeStartMessageIds |
protected Map<TopicRange,org.apache.pulsar.client.api.MessageId> |
PulsarFetcher.seedTopicsWithInitialOffsets |
| Modifier and Type | Method and Description |
|---|---|
Map<TopicRange,ReaderThread<T>> |
PulsarFetcher.createAndStartReaderThread(List<PulsarTopicState<T>> states,
ExceptionProxy exceptionProxy) |
Set<TopicRange> |
PulsarMetadataReader.discoverTopicChanges() |
Set<TopicRange> |
PulsarMetadataReader.getTopicPartitions() |
Set<TopicRange> |
PulsarMetadataReader.getTopicPartitionsAll()
Get topic partitions all, If the topic does not exist, it is created automatically ont partition to topic.
|
List<TopicRange> |
PulsarMetadataReader.getTopics() |
org.apache.flink.api.java.typeutils.runtime.TupleSerializer<org.apache.flink.api.java.tuple.Tuple2<TopicRange,org.apache.pulsar.client.api.MessageId>> |
PulsarSourceStateSerializer.getV1Serializer() |
org.apache.flink.api.java.typeutils.runtime.TupleSerializer<org.apache.flink.api.java.tuple.Tuple3<TopicRange,org.apache.pulsar.client.api.MessageId,String>> |
PulsarSourceStateSerializer.getV2Serializer() |
Map<TopicRange,org.apache.pulsar.client.api.MessageId> |
PulsarFetcher.removeEarliestAndLatest(Map<TopicRange,org.apache.pulsar.client.api.MessageId> offset) |
Map<TopicRange,org.apache.pulsar.client.api.MessageId> |
PulsarFetcher.snapshotCurrentState()
Takes a snapshot of the partition offsets.
|
| Modifier and Type | Method and Description |
|---|---|
static boolean |
SourceSinkUtils.belongsTo(TopicRange topicRange,
int numParallelSubtasks,
int index) |
int |
TopicRange.compareTo(TopicRange o) |
org.apache.pulsar.client.api.MessageId |
PulsarMetadataReader.getPositionFromSubscription(TopicRange topic,
org.apache.pulsar.client.api.MessageId defaultPosition) |
void |
PulsarMetadataReader.resetCursor(TopicRange topicRange,
org.apache.pulsar.client.api.MessageId messageId) |
| Modifier and Type | Method and Description |
|---|---|
void |
PulsarFetcher.addDiscoveredTopics(Set<TopicRange> newTopics) |
void |
PulsarMetadataReader.commitOffsetToCursor(Map<TopicRange,org.apache.pulsar.client.api.MessageId> offset) |
void |
PulsarFetcher.commitOffsetToPulsar(Map<TopicRange,org.apache.pulsar.client.api.MessageId> offset,
PulsarCommitCallback offsetCommitCallback) |
protected void |
PulsarFetcher.doCommitOffsetToPulsar(Map<TopicRange,org.apache.pulsar.client.api.MessageId> offset,
PulsarCommitCallback offsetCommitCallback) |
void |
PulsarMetadataReader.removeCursor(Set<TopicRange> topics) |
Map<TopicRange,org.apache.pulsar.client.api.MessageId> |
PulsarFetcher.removeEarliestAndLatest(Map<TopicRange,org.apache.pulsar.client.api.MessageId> offset) |
void |
PulsarMetadataReader.setupCursor(Map<TopicRange,org.apache.pulsar.client.api.MessageId> offset) |
void |
PulsarMetadataReader.setupCursor(Map<TopicRange,org.apache.pulsar.client.api.MessageId> offset,
boolean failOnDataLoss) |
| Constructor and Description |
|---|
PulsarTopicPartitionStateWithWatermarkGenerator(TopicRange topicRange,
PulsarTopicState<T> topicState,
org.apache.flink.api.common.eventtime.TimestampAssigner<T> timestampAssigner,
org.apache.flink.api.common.eventtime.WatermarkGenerator<T> watermarkGenerator,
org.apache.flink.api.common.eventtime.WatermarkOutput immediateOutput,
org.apache.flink.api.common.eventtime.WatermarkOutput deferredOutput) |
PulsarTopicState(TopicRange topicRange) |
| Constructor and Description |
|---|
PulsarFetcher(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
Map<TopicRange,org.apache.pulsar.client.api.MessageId> seedTopicsWithInitialOffsets,
org.apache.flink.util.SerializedValue<org.apache.flink.api.common.eventtime.WatermarkStrategy<T>> watermarkStrategy,
org.apache.flink.streaming.runtime.tasks.ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
org.apache.flink.streaming.api.operators.StreamingRuntimeContext runtimeContext,
org.apache.pulsar.client.impl.conf.ClientConfigurationData clientConf,
Map<String,Object> readerConf,
int pollTimeoutMs,
PulsarDeserializationSchema<T> deserializer,
PulsarMetadataReader metadataReader,
org.apache.flink.metrics.MetricGroup consumerMetricGroup,
boolean useMetrics) |
PulsarFetcher(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
Map<TopicRange,org.apache.pulsar.client.api.MessageId> seedTopicsWithInitialOffsets,
Set<TopicRange> excludeStartMessageIds,
org.apache.flink.util.SerializedValue<org.apache.flink.api.common.eventtime.WatermarkStrategy<T>> watermarkStrategy,
org.apache.flink.streaming.runtime.tasks.ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
org.apache.flink.streaming.api.operators.StreamingRuntimeContext runtimeContext,
org.apache.pulsar.client.impl.conf.ClientConfigurationData clientConf,
Map<String,Object> readerConf,
int pollTimeoutMs,
int commitMaxRetries,
PulsarDeserializationSchema<T> deserializer,
PulsarMetadataReader metadataReader,
org.apache.flink.metrics.MetricGroup consumerMetricGroup,
boolean useMetrics) |
PulsarFetcher(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
Map<TopicRange,org.apache.pulsar.client.api.MessageId> seedTopicsWithInitialOffsets,
Set<TopicRange> excludeStartMessageIds,
org.apache.flink.util.SerializedValue<org.apache.flink.api.common.eventtime.WatermarkStrategy<T>> watermarkStrategy,
org.apache.flink.streaming.runtime.tasks.ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
org.apache.flink.streaming.api.operators.StreamingRuntimeContext runtimeContext,
org.apache.pulsar.client.impl.conf.ClientConfigurationData clientConf,
Map<String,Object> readerConf,
int pollTimeoutMs,
int commitMaxRetries,
PulsarDeserializationSchema<T> deserializer,
PulsarMetadataReader metadataReader,
org.apache.flink.metrics.MetricGroup consumerMetricGroup,
boolean useMetrics) |
Copyright © 2019–2022 The Apache Software Foundation. All rights reserved.