@Experimental(SOURCE_SINK)
Package org.apache.beam.sdk.io.aws2.kinesis
Transforms for reading from Amazon Kinesis.
-
Interface Summary Interface Description AWSClientsProvider Deprecated. Configure a customClientBuilderFactoryusingAwsOptions.getClientBuilderFactory()instead.KinesisPartitioner<T> Kinesis interface for custom partitioner.KinesisPartitioner.ExplicitPartitioner<T> An explicit partitioner that always returns aNonnullexplicit hash key.RateLimitPolicy RateLimitPolicyFactory Implement this interface to create aRateLimitPolicy.WatermarkPolicy Implement this interface to define a custom watermark calculation heuristic.WatermarkPolicyFactory Implement this interface to create aWatermarkPolicy. -
Class Summary Class Description KinesisIO IO to read from Kinesis streams.KinesisIO.Read Implementation ofKinesisIO.read().KinesisIO.RecordAggregation Configuration of Kinesis record aggregation.KinesisIO.RecordAggregation.Builder KinesisIO.Write<T> Implementation ofKinesisIO.write().KinesisIO.Write.Result Result ofKinesisIO.write().KinesisRecord KinesisClientRecordenhanced with utility methods.RateLimitPolicyFactory.DefaultRateLimiter Default rate limiter that throttles reading from a shard using an exponential backoff if the response is empty or if the consumer is throttled by AWS.RateLimitPolicyFactory.DelayIntervalRateLimiter TimeUtil Time conversion utilities.WatermarkParameters WatermarkParameterscontains the parameters used for watermark computation.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy ArrivalTimeWatermarkPolicy usesWatermarkPolicyFactory.CustomWatermarkPolicyfor watermark computation.WatermarkPolicyFactory.CustomWatermarkPolicy CustomWatermarkPolicy uses parameters defined inWatermarkParametersto compute watermarks.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy Watermark policy where the processing time is used as the event time. -
Exception Summary Exception Description KinesisClientThrottledException Thrown when the Kinesis client was throttled due to rate limits.