Package org.apache.pinot.plugin.stream.kinesis

Class KinesisPartitionGroupOffset

java.lang.Object

org.apache.pinot.plugin.stream.kinesis.KinesisPartitionGroupOffset

All Implemented Interfaces:

Comparable<StreamPartitionMsgOffset>, StreamPartitionMsgOffset

public class KinesisPartitionGroupOffset
extends Object
implements StreamPartitionMsgOffset

A StreamPartitionMsgOffset implementation for the Kinesis partition group consumption A partition group consists of 1 or more shards. The KinesisCheckpoint maintains a Map of shards to the sequenceNumber. The sequenceNumber is the id (equivalent to offset in kafka) for the messages in the shard. From the Kinesis documentation: Each data record has a sequence number that is unique per partition-key within its shard. Kinesis Data Streams assigns the sequence number after you write to the stream with client.putRecords or client .putRecord. Sequence numbers for the same partition key generally increase over time. The longer the time period between write requests, the larger the sequence numbers become.

Constructor Summary

Constructors

Constructor	Description
KinesisPartitionGroupOffset(String offsetStr)
KinesisPartitionGroupOffset(Map<String,String> shardToStartSequenceMap)

Method Summary

Modifier and Type	Method	Description
int	compareTo(StreamPartitionMsgOffset o)
KinesisPartitionGroupOffset	fromString(String kinesisCheckpointStr)
Map<String,String>	getShardToStartSequenceMap()
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

KinesisPartitionGroupOffset

public KinesisPartitionGroupOffset(Map<String,String> shardToStartSequenceMap)

KinesisPartitionGroupOffset

public KinesisPartitionGroupOffset(String offsetStr)
                            throws IOException

Throws:

IOException

Method Detail

getShardToStartSequenceMap

public Map<String,String> getShardToStartSequenceMap()

toString

public String toString()

Specified by:

toString in interface StreamPartitionMsgOffset

Overrides:

toString in class Object

fromString

public KinesisPartitionGroupOffset fromString(String kinesisCheckpointStr)

Specified by:

fromString in interface StreamPartitionMsgOffset

compareTo

public int compareTo(StreamPartitionMsgOffset o)

Specified by:

compareTo in interface Comparable<StreamPartitionMsgOffset>