| Modifier and Type | Method and Description |
|---|---|
org.apache.flink.api.connector.source.SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> enumContext) |
org.apache.flink.api.connector.source.SourceReader<OUT,PulsarPartitionSplit> |
PulsarSource.createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext) |
org.apache.flink.core.io.SimpleVersionedSerializer<PulsarPartitionSplit> |
PulsarSource.getSplitSerializer() |
org.apache.flink.api.connector.source.SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> enumContext,
PulsarSourceEnumState checkpoint) |
| Modifier and Type | Method and Description |
|---|---|
org.apache.flink.api.connector.source.SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> enumContext) |
org.apache.flink.api.connector.source.SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> enumContext,
PulsarSourceEnumState checkpoint) |
| Modifier and Type | Method and Description |
|---|---|
Set<PulsarPartitionSplit> |
PulsarSourceEnumState.getPendingPartitionSplits() |
Map<Integer,Set<PulsarPartitionSplit>> |
PulsarSourceEnumState.getSharedPendingPartitionSplits() |
| Modifier and Type | Method and Description |
|---|---|
void |
PulsarSourceEnumerator.addSplitsBack(List<PulsarPartitionSplit> splits,
int subtaskId) |
| Constructor and Description |
|---|
PulsarSourceEnumerator(PulsarSubscriber subscriber,
StartCursor startCursor,
RangeGenerator rangeGenerator,
SourceConfiguration sourceConfiguration,
org.apache.flink.api.connector.source.SplitEnumeratorContext<PulsarPartitionSplit> context,
SplitAssigner splitAssigner) |
PulsarSourceEnumState(Set<TopicPartition> appendedPartitions,
Set<PulsarPartitionSplit> pendingPartitionSplits,
Map<Integer,Set<PulsarPartitionSplit>> pendingSharedPartitionSplits,
Map<Integer,Set<String>> readerAssignedSplits,
boolean initialized) |
PulsarSourceEnumState(Set<TopicPartition> appendedPartitions,
Set<PulsarPartitionSplit> pendingPartitionSplits,
Map<Integer,Set<PulsarPartitionSplit>> pendingSharedPartitionSplits,
Map<Integer,Set<String>> readerAssignedSplits,
boolean initialized) |
| Modifier and Type | Method and Description |
|---|---|
Optional<org.apache.flink.api.connector.source.SplitsAssignment<PulsarPartitionSplit>> |
SharedSplitAssigner.createAssignment(List<Integer> readers) |
Optional<org.apache.flink.api.connector.source.SplitsAssignment<PulsarPartitionSplit>> |
SplitAssigner.createAssignment(List<Integer> readers)
Create a split assignment from the current readers.
|
Optional<org.apache.flink.api.connector.source.SplitsAssignment<PulsarPartitionSplit>> |
NormalSplitAssigner.createAssignment(List<Integer> readers) |
| Modifier and Type | Method and Description |
|---|---|
void |
SharedSplitAssigner.addSplitsBack(List<PulsarPartitionSplit> splits,
int subtaskId) |
void |
SplitAssigner.addSplitsBack(List<PulsarPartitionSplit> splits,
int subtaskId)
Add a split back to the split assigner if the reader fails.
|
void |
NormalSplitAssigner.addSplitsBack(List<PulsarPartitionSplit> splits,
int subtaskId) |
| Modifier and Type | Method and Description |
|---|---|
static <OUT> org.apache.flink.api.connector.source.SourceReader<OUT,PulsarPartitionSplit> |
PulsarSourceReaderFactory.create(org.apache.flink.api.connector.source.SourceReaderContext readerContext,
PulsarDeserializationSchema<OUT> deserializationSchema,
SourceConfiguration sourceConfiguration,
org.apache.pulsar.client.api.CryptoKeyReader cryptoKeyReader) |
| Modifier and Type | Method and Description |
|---|---|
protected org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher<org.apache.pulsar.client.api.Message<byte[]>,PulsarPartitionSplit> |
PulsarFetcherManagerBase.getOrCreateFetcher(String splitId) |
List<PulsarPartitionSplit> |
PulsarUnorderedFetcherManager.snapshotState(long checkpointId) |
| Modifier and Type | Method and Description |
|---|---|
void |
PulsarFetcherManagerBase.addSplits(List<PulsarPartitionSplit> splitsToAdd)
Override this method for supporting multiple thread fetching, one fetcher thread for one
split.
|
protected void |
PulsarFetcherManagerBase.startFetcher(org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher<org.apache.pulsar.client.api.Message<byte[]>,PulsarPartitionSplit> fetcher) |
| Constructor and Description |
|---|
PulsarFetcherManagerBase(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.pulsar.client.api.Message<byte[]>>> elementsQueue,
java.util.function.Supplier<org.apache.flink.connector.base.source.reader.splitreader.SplitReader<org.apache.pulsar.client.api.Message<byte[]>,PulsarPartitionSplit>> splitReaderSupplier)
Creates a new SplitFetcherManager with multiple I/O threads.
|
PulsarOrderedFetcherManager(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.pulsar.client.api.Message<byte[]>>> elementsQueue,
java.util.function.Supplier<org.apache.flink.connector.base.source.reader.splitreader.SplitReader<org.apache.pulsar.client.api.Message<byte[]>,PulsarPartitionSplit>> splitReaderSupplier) |
PulsarUnorderedFetcherManager(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.pulsar.client.api.Message<byte[]>>> elementsQueue,
java.util.function.Supplier<org.apache.flink.connector.base.source.reader.splitreader.SplitReader<org.apache.pulsar.client.api.Message<byte[]>,PulsarPartitionSplit>> splitReaderSupplier) |
| Modifier and Type | Method and Description |
|---|---|
List<PulsarPartitionSplit> |
PulsarOrderedSourceReader.snapshotState(long checkpointId) |
List<PulsarPartitionSplit> |
PulsarUnorderedSourceReader.snapshotState(long checkpointId) |
| Modifier and Type | Method and Description |
|---|---|
protected void |
PulsarUnorderedPartitionSplitReader.startConsumer(PulsarPartitionSplit split,
org.apache.pulsar.client.api.Consumer<?> consumer) |
protected void |
PulsarOrderedPartitionSplitReader.startConsumer(PulsarPartitionSplit split,
org.apache.pulsar.client.api.Consumer<?> consumer) |
| Modifier and Type | Method and Description |
|---|---|
PulsarPartitionSplit |
PulsarPartitionSplitSerializer.deserialize(int version,
byte[] serialized) |
PulsarPartitionSplit |
PulsarPartitionSplitSerializer.deserializePulsarPartitionSplit(int version,
DataInputStream in) |
PulsarPartitionSplit |
PulsarPartitionSplitState.toPulsarPartitionSplit()
Create a partition split which contains the latest consumed message id as the start position.
|
| Modifier and Type | Method and Description |
|---|---|
byte[] |
PulsarPartitionSplitSerializer.serialize(PulsarPartitionSplit obj) |
void |
PulsarPartitionSplitSerializer.serializePulsarPartitionSplit(DataOutputStream out,
PulsarPartitionSplit split) |
| Constructor and Description |
|---|
PulsarPartitionSplitState(PulsarPartitionSplit split) |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.