| Modifier and Type | Method and Description |
|---|---|
org.apache.flink.api.connector.source.SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> enumContext) |
org.apache.flink.api.connector.source.SourceReader<OUT,PulsarPartitionSplit> |
PulsarSource.createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext) |
org.apache.flink.core.io.SimpleVersionedSerializer<PulsarPartitionSplit> |
PulsarSource.getSplitSerializer() |
org.apache.flink.api.connector.source.SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> enumContext,
PulsarSourceEnumState checkpoint) |
| Modifier and Type | Method and Description |
|---|---|
org.apache.flink.api.connector.source.SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> enumContext) |
org.apache.flink.api.connector.source.SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> enumContext,
PulsarSourceEnumState checkpoint) |
| Modifier and Type | Method and Description |
|---|---|
Optional<org.apache.flink.api.connector.source.SplitsAssignment<PulsarPartitionSplit>> |
SplitsAssignmentState.assignSplits(List<Integer> pendingReaders) |
Set<PulsarPartitionSplit> |
PulsarSourceEnumState.getPendingPartitionSplits() |
Map<Integer,Set<PulsarPartitionSplit>> |
PulsarSourceEnumState.getSharedPendingPartitionSplits() |
| Modifier and Type | Method and Description |
|---|---|
void |
PulsarSourceEnumerator.addSplitsBack(List<PulsarPartitionSplit> splits,
int subtaskId) |
void |
SplitsAssignmentState.putSplitsBackToPendingList(List<PulsarPartitionSplit> splits,
int readerId)
Put these splits back to pending list.
|
| Constructor and Description |
|---|
PulsarSourceEnumerator(PulsarSubscriber subscriber,
StartCursor startCursor,
RangeGenerator rangeGenerator,
SourceConfiguration sourceConfiguration,
org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> context,
SplitsAssignmentState assignmentState) |
PulsarSourceEnumState(Set<TopicPartition> appendedPartitions,
Set<PulsarPartitionSplit> pendingPartitionSplits,
Map<Integer,Set<PulsarPartitionSplit>> pendingSharedPartitionSplits,
Map<Integer,Set<String>> readerAssignedSplits,
boolean initialized) |
PulsarSourceEnumState(Set<TopicPartition> appendedPartitions,
Set<PulsarPartitionSplit> pendingPartitionSplits,
Map<Integer,Set<PulsarPartitionSplit>> pendingSharedPartitionSplits,
Map<Integer,Set<String>> readerAssignedSplits,
boolean initialized) |
| Modifier and Type | Method and Description |
|---|---|
static <OUT> org.apache.flink.api.connector.source.SourceReader<OUT,PulsarPartitionSplit> |
PulsarSourceReaderFactory.create(org.apache.flink.api.connector.source.SourceReaderContext readerContext,
PulsarDeserializationSchema<OUT> deserializationSchema,
SourceConfiguration sourceConfiguration) |
| Modifier and Type | Method and Description |
|---|---|
protected org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher<PulsarMessage<T>,PulsarPartitionSplit> |
PulsarFetcherManagerBase.getOrCreateFetcher(String splitId) |
List<PulsarPartitionSplit> |
PulsarUnorderedFetcherManager.snapshotState(long checkpointId) |
| Modifier and Type | Method and Description |
|---|---|
void |
PulsarFetcherManagerBase.addSplits(List<PulsarPartitionSplit> splitsToAdd)
Override this method for supporting multiple thread fetching, one fetcher thread for one
split.
|
protected void |
PulsarFetcherManagerBase.startFetcher(org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher<PulsarMessage<T>,PulsarPartitionSplit> fetcher) |
| Constructor and Description |
|---|
PulsarFetcherManagerBase(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<PulsarMessage<T>>> elementsQueue,
java.util.function.Supplier<org.apache.flink.connector.base.source.reader.splitreader.SplitReader<PulsarMessage<T>,PulsarPartitionSplit>> splitReaderSupplier)
Creates a new SplitFetcherManager with multiple I/O threads.
|
PulsarOrderedFetcherManager(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<PulsarMessage<T>>> elementsQueue,
java.util.function.Supplier<org.apache.flink.connector.base.source.reader.splitreader.SplitReader<PulsarMessage<T>,PulsarPartitionSplit>> splitReaderSupplier) |
PulsarUnorderedFetcherManager(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<PulsarMessage<T>>> elementsQueue,
java.util.function.Supplier<org.apache.flink.connector.base.source.reader.splitreader.SplitReader<PulsarMessage<T>,PulsarPartitionSplit>> splitReaderSupplier) |
| Modifier and Type | Method and Description |
|---|---|
List<PulsarPartitionSplit> |
PulsarUnorderedSourceReader.snapshotState(long checkpointId) |
List<PulsarPartitionSplit> |
PulsarOrderedSourceReader.snapshotState(long checkpointId) |
| Modifier and Type | Method and Description |
|---|---|
protected void |
PulsarUnorderedPartitionSplitReader.startConsumer(PulsarPartitionSplit split,
org.apache.pulsar.client.api.Consumer<?> consumer) |
protected void |
PulsarOrderedPartitionSplitReader.startConsumer(PulsarPartitionSplit split,
org.apache.pulsar.client.api.Consumer<?> consumer) |
| Modifier and Type | Method and Description |
|---|---|
PulsarPartitionSplit |
PulsarPartitionSplitSerializer.deserialize(int version,
byte[] serialized) |
PulsarPartitionSplit |
PulsarPartitionSplitSerializer.deserializePulsarPartitionSplit(int version,
DataInputStream in) |
PulsarPartitionSplit |
PulsarPartitionSplitState.toPulsarPartitionSplit()
Create a partition split which contains the latest consumed message id as the start position.
|
| Modifier and Type | Method and Description |
|---|---|
byte[] |
PulsarPartitionSplitSerializer.serialize(PulsarPartitionSplit obj) |
void |
PulsarPartitionSplitSerializer.serializePulsarPartitionSplit(DataOutputStream out,
PulsarPartitionSplit split) |
| Constructor and Description |
|---|
PulsarPartitionSplitState(PulsarPartitionSplit split) |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.