org.apache.flink.connector.pulsar.source.enumerator.assigner

Class SharedSplitAssigner

java.lang.Object

org.apache.flink.connector.pulsar.source.enumerator.assigner.SharedSplitAssigner

All Implemented Interfaces:

Serializable, SplitAssigner

public class SharedSplitAssigner
extends Object
implements SplitAssigner

This assigner is used for SubscriptionType.Shared subscriptions.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SharedSplitAssigner(StopCursor stopCursor, SourceConfiguration sourceConfiguration)
SharedSplitAssigner(StopCursor stopCursor, SourceConfiguration sourceConfiguration, PulsarSourceEnumState sourceEnumState)

Method Summary

Modifier and Type	Method and Description
void	addSplitsBack(List<PulsarPartitionSplit> splits, int subtaskId) Add a split back to the split assigner if the reader fails.
Optional<org.apache.flink.api.connector.source.SplitsAssignment<PulsarPartitionSplit>>	createAssignment(List<Integer> readers) Create a split assignment from the current readers.
boolean	noMoreSplits(Integer reader) It would return true only if periodically partition discovery is disabled, the initializing partition discovery has finished AND there is no pending splits for assignment.
List<TopicPartition>	registerTopicPartitions(Set<TopicPartition> fetchedPartitions) Add the current available partitions into assigner.
PulsarSourceEnumState	snapshotState() Snapshot the current assign state into checkpoint.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SharedSplitAssigner

public SharedSplitAssigner(StopCursor stopCursor,
                           SourceConfiguration sourceConfiguration)

SharedSplitAssigner

public SharedSplitAssigner(StopCursor stopCursor,
                           SourceConfiguration sourceConfiguration,
                           PulsarSourceEnumState sourceEnumState)

Method Detail

registerTopicPartitions

public List<TopicPartition> registerTopicPartitions(Set<TopicPartition> fetchedPartitions)

Description copied from interface: SplitAssigner

Add the current available partitions into assigner.

Specified by:

registerTopicPartitions in interface SplitAssigner

Parameters:

fetchedPartitions - The available partitions queried from Pulsar broker.

Returns:

New topic partitions compare to previous registered partitions.

addSplitsBack

public void addSplitsBack(List<PulsarPartitionSplit> splits,
                          int subtaskId)

Description copied from interface: SplitAssigner

Add a split back to the split assigner if the reader fails. We would try to reassign the split or add it to the pending list.

Specified by:

addSplitsBack in interface SplitAssigner

createAssignment

public Optional<org.apache.flink.api.connector.source.SplitsAssignment<PulsarPartitionSplit>> createAssignment(List<Integer> readers)

Description copied from interface: SplitAssigner

Create a split assignment from the current readers.

Specified by:

createAssignment in interface SplitAssigner

noMoreSplits

public boolean noMoreSplits(Integer reader)

Description copied from interface: SplitAssigner

It would return true only if periodically partition discovery is disabled, the initializing partition discovery has finished AND there is no pending splits for assignment.

Specified by:

noMoreSplits in interface SplitAssigner

snapshotState

public PulsarSourceEnumState snapshotState()

Description copied from interface: SplitAssigner

Snapshot the current assign state into checkpoint.

Specified by:

snapshotState in interface SplitAssigner