Package org.apache.pinot.plugin.stream.kinesis

Class KinesisConsumer

java.lang.Object

org.apache.pinot.plugin.stream.kinesis.KinesisConnectionHandler

org.apache.pinot.plugin.stream.kinesis.KinesisConsumer

All Implemented Interfaces:

Closeable, AutoCloseable, PartitionGroupConsumer

public class KinesisConsumer
extends KinesisConnectionHandler
implements PartitionGroupConsumer

A PartitionGroupConsumer implementation for the Kinesis stream

Field Summary

Fields inherited from class org.apache.pinot.plugin.stream.kinesis.KinesisConnectionHandler

_kinesisClient

Constructor Summary

Constructors

Constructor	Description
KinesisConsumer(KinesisConfig kinesisConfig)
KinesisConsumer(KinesisConfig kinesisConfig, software.amazon.awssdk.services.kinesis.KinesisClient kinesisClient)

Method Summary

Modifier and Type	Method	Description
void	close()
KinesisRecordsBatch	fetchMessages(StreamPartitionMsgOffset startCheckpoint, StreamPartitionMsgOffset endCheckpoint, int timeoutMs)	Fetch records from the Kinesis stream between the start and end KinesisCheckpoint

Methods inherited from class org.apache.pinot.plugin.stream.kinesis.KinesisConnectionHandler

createConnection, getShards

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KinesisConsumer

public KinesisConsumer(KinesisConfig kinesisConfig)

KinesisConsumer

public KinesisConsumer(KinesisConfig kinesisConfig,
                       software.amazon.awssdk.services.kinesis.KinesisClient kinesisClient)

Method Detail

fetchMessages

public KinesisRecordsBatch fetchMessages(StreamPartitionMsgOffset startCheckpoint,
                                         StreamPartitionMsgOffset endCheckpoint,
                                         int timeoutMs)

Fetch records from the Kinesis stream between the start and end KinesisCheckpoint

Specified by:

fetchMessages in interface PartitionGroupConsumer

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Overrides:

close in class KinesisConnectionHandler