A B C D E G H K O P R S T U W

A

AWSClientsProvider - Interface in org.apache.beam.sdk.io.kinesis

Provides instances of AWS clients.

AwsSerializableUtils - Class in org.apache.beam.sdk.io.kinesis.serde

Utilities for working with AWS Serializables.

AwsSerializableUtils() - Constructor for class org.apache.beam.sdk.io.kinesis.serde.AwsSerializableUtils

B

builder() - Static method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters

buildExternal(KinesisTransformRegistrar.ReadDataBuilder.Configuration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder

buildExternal(KinesisTransformRegistrar.WriteBuilder.Configuration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder

C

Configuration() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

Configuration() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder.Configuration

create() - Static method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters

createKinesisProducer(KinesisProducerConfiguration) - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider

createWatermarkPolicy() - Method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory

D

DefaultRateLimiter(BackOff, BackOff) - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter

DefaultRateLimiter(Duration, Duration, Duration) - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter

DelayIntervalRateLimiter() - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter

DelayIntervalRateLimiter(Supplier<Duration>) - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter

deserialize(String) - Static method in class org.apache.beam.sdk.io.kinesis.serde.AwsSerializableUtils

E

equals(Object) - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

expand(PBegin) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

expand(PCollection<byte[]>) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

G

getApproximateArrivalTimestamp() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getCloudWatchClient() - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider

getData() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getDataAsBytes() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getExplicitHashKey(byte[]) - Method in interface org.apache.beam.sdk.io.kinesis.KinesisPartitioner

getExtendedSequenceNumber() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getKinesisClient() - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider

getPartitionKey(byte[]) - Method in interface org.apache.beam.sdk.io.kinesis.KinesisPartitioner

getPartitionKey() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getRateLimitPolicy() - Method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory

getReadTime() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getSequenceNumber() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getShardId() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getStreamName() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getSubSequenceNumber() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getUniqueId() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

getWatermark() - Method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicy

getWatermark() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy

getWatermark() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy

getWatermark() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy

H

hashCode() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord

K

KinesisClientThrottledException - Exception in org.apache.beam.sdk.io.kinesis

Thrown when the Kinesis client was throttled due to rate limits.

KinesisClientThrottledException(String, AmazonClientException) - Constructor for exception org.apache.beam.sdk.io.kinesis.KinesisClientThrottledException

KinesisIO - Class in org.apache.beam.sdk.io.kinesis

Deprecated.

Module beam-sdks-java-io-kinesis is deprecated and will be eventually removed. Please migrate to org.apache.beam.sdk.io.aws2.kinesis.KinesisIO in module beam-sdks-java-io-amazon-web-services2.

KinesisIO() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisIO

Deprecated.

KinesisIO.Read<T> - Class in org.apache.beam.sdk.io.kinesis

Deprecated.

Implementation of KinesisIO.read().

KinesisIO.Write - Class in org.apache.beam.sdk.io.kinesis

Deprecated.

Implementation of KinesisIO.write().

KinesisPartitioner - Interface in org.apache.beam.sdk.io.kinesis

Kinesis interface for custom partitioner.

KinesisRecord - Class in org.apache.beam.sdk.io.kinesis

UserRecord enhanced with utility methods.

KinesisRecord(UserRecord, String, String) - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisRecord

KinesisRecord(ByteBuffer, String, long, String, Instant, Instant, String, String) - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisRecord

KinesisTransformRegistrar - Class in org.apache.beam.sdk.io.kinesis

Exposes KinesisIO.Write and KinesisIO.Read as an external transform for cross-language usage.

KinesisTransformRegistrar() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar

KinesisTransformRegistrar.ReadDataBuilder - Class in org.apache.beam.sdk.io.kinesis

KinesisTransformRegistrar.ReadDataBuilder.Configuration - Class in org.apache.beam.sdk.io.kinesis

KinesisTransformRegistrar.WriteBuilder - Class in org.apache.beam.sdk.io.kinesis

KinesisTransformRegistrar.WriteBuilder.Configuration - Class in org.apache.beam.sdk.io.kinesis

knownBuilderInstances() - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar

O

onSuccess(List<KinesisRecord>) - Method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicy

Called after Kinesis records are successfully retrieved.

onSuccess(List<KinesisRecord>) - Method in class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter

onSuccess(List<KinesisRecord>) - Method in class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter

onThrottle(KinesisClientThrottledException) - Method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicy

Called after the Kinesis client is throttled.

onThrottle(KinesisClientThrottledException) - Method in class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter

org.apache.beam.sdk.io.kinesis - package org.apache.beam.sdk.io.kinesis

Transforms for reading and writing from Amazon Kinesis.

org.apache.beam.sdk.io.kinesis.serde - package org.apache.beam.sdk.io.kinesis.serde

Defines serializers / deserializers for AWS.

P

ProcessingTimeWatermarkPolicy() - Constructor for class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy

R

RateLimitPolicy - Interface in org.apache.beam.sdk.io.kinesis

RateLimitPolicyFactory - Interface in org.apache.beam.sdk.io.kinesis

Implement this interface to create a RateLimitPolicy.

RateLimitPolicyFactory.DefaultRateLimiter - Class in org.apache.beam.sdk.io.kinesis

Default rate limiter that throttles reading from a shard using an exponential backoff if the response is empty or if the consumer is throttled by AWS.

RateLimitPolicyFactory.DelayIntervalRateLimiter - Class in org.apache.beam.sdk.io.kinesis

read() - Static method in class org.apache.beam.sdk.io.kinesis.KinesisIO

Deprecated.

Returns a new KinesisIO.Read transform for reading from Kinesis.

Read() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

READ_DATA_URN - Static variable in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar

readData() - Static method in class org.apache.beam.sdk.io.kinesis.KinesisIO

Deprecated.

A PTransform to read from Kinesis stream as bytes without metadata and returns a PCollection of byte[].

ReadDataBuilder() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder

S

serialize(AWSCredentialsProvider) - Static method in class org.apache.beam.sdk.io.kinesis.serde.AwsSerializableUtils

setInitialPositionInStream(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

setInitialTimestampInStream(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

setMaxCapacityPerShard(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

setMaxNumRecords(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

setMaxReadTime(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

setPartitionKey(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder.Configuration

setProducerProperties(Map<String, String>) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder.Configuration

setRateLimit(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

setRequestRecordsLimit(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

setUpToDateThreshold(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

setWatermarkIdleDurationThreshold(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

setWatermarkPolicy(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration

T

toBuilder() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters

U

update(KinesisRecord) - Method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicy

update(KinesisRecord) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy

update(KinesisRecord) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy

update(KinesisRecord) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy

W

WatermarkParameters - Class in org.apache.beam.sdk.io.kinesis

WatermarkParameters contains the parameters used for watermark computation.

WatermarkParameters() - Constructor for class org.apache.beam.sdk.io.kinesis.WatermarkParameters

WatermarkPolicy - Interface in org.apache.beam.sdk.io.kinesis

Implement this interface to define a custom watermark calculation heuristic.

WatermarkPolicyFactory - Interface in org.apache.beam.sdk.io.kinesis

Implement this interface to create a WatermarkPolicy.

WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.kinesis

ArrivalTimeWatermarkPolicy uses WatermarkPolicyFactory.CustomWatermarkPolicy for watermark computation.

WatermarkPolicyFactory.CustomWatermarkPolicy - Class in org.apache.beam.sdk.io.kinesis

CustomWatermarkPolicy uses parameters defined in WatermarkParameters to compute watermarks.

WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.kinesis

Watermark policy where the processing time is used as the event time.

withArrivalTimePolicy() - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory

Returns an ArrivalTimeWatermarkPolicy.

withArrivalTimePolicy(Duration) - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory

Returns an ArrivalTimeWatermarkPolicy.

withArrivalTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies the WatermarkPolicyFactory as ArrivalTimeWatermarkPolicyFactory.

withArrivalTimeWatermarkPolicy(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies the WatermarkPolicyFactory as ArrivalTimeWatermarkPolicyFactory.

withAWSClientsProvider(AWSClientsProvider) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Allows to specify custom AWSClientsProvider.

withAWSClientsProvider(AWSCredentialsProvider, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specify AWSCredentialsProvider and region to be used to read from Kinesis.

withAWSClientsProvider(String, String, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specify credential details and region to be used to read from Kinesis.

withAWSClientsProvider(AWSCredentialsProvider, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specify AWSCredentialsProvider and region to be used to read from Kinesis.

withAWSClientsProvider(String, String, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specify credential details and region to be used to read from Kinesis.

withAWSClientsProvider(AWSCredentialsProvider, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specify AWSCredentialsProvider and region to be used to read from Kinesis.

withAWSClientsProvider(String, String, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specify credential details and region to be used to read from Kinesis.

withAWSClientsProvider(AWSClientsProvider) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Allows to specify custom AWSClientsProvider.

withAWSClientsProvider(AWSCredentialsProvider, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Specify AWSCredentialsProvider and region to be used to write to Kinesis.

withAWSClientsProvider(String, String, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Specify credential details and region to be used to write to Kinesis.

withAWSClientsProvider(AWSCredentialsProvider, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Specify AWSCredentialsProvider and region to be used to write to Kinesis.

withAWSClientsProvider(String, String, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Specify credential details and region to be used to write to Kinesis.

withAWSClientsProvider(AWSCredentialsProvider, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Specify credential details and region to be used to write to Kinesis.

withAWSClientsProvider(String, String, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Specify credential details and region to be used to write to Kinesis.

withCustomRateLimitPolicy(RateLimitPolicyFactory) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies the RateLimitPolicyFactory for a custom rate limiter.

withCustomWatermarkPolicy(WatermarkPolicyFactory) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies the WatermarkPolicyFactory as a custom watermarkPolicyFactory.

withCustomWatermarkPolicy(WatermarkParameters) - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory

Returns an custom WatermarkPolicyFactory.

withDefaultRateLimiter() - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory

withDefaultRateLimiter(Duration, Duration, Duration) - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory

withDelay(Supplier<Duration>) - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory

withDynamicDelayRateLimitPolicy(Supplier<Duration>) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies a dynamic delay rate limit policy with the given function being called at each polling interval to get the next delay value.

withFixedDelay() - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory

withFixedDelay(Duration) - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory

withFixedDelayRateLimitPolicy() - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies a fixed delay rate limit policy with the default delay of 1 second.

withFixedDelayRateLimitPolicy(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies a fixed delay rate limit policy with the given delay.

withInitialPositionInStream(InitialPositionInStream) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specify reading from some initial position in stream.

withInitialTimestampInStream(Instant) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specify reading beginning at given Instant.

withMaxCapacityPerShard(Integer) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies the maximum number of messages per one shard.

withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies to read at most a given number of records.

withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies to read records during maxReadTime.

withoutLimiter() - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory

withPartitioner(KinesisPartitioner) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Allows to specify custom implementation of KinesisPartitioner.

withPartitionKey(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Specify default partition key.

withProcessingTimePolicy() - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory

Returns an ProcessingTimeWatermarkPolicy.

withProcessingTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies the WatermarkPolicyFactory as ProcessingTimeWatermarkPolicyFactory.

withProducerProperties(Properties) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Specify the configuration properties for Kinesis Producer Library (KPL).

withRequestRecordsLimit(int) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies the maximum number of records in GetRecordsResult returned by GetRecords call which is limited by 10K records.

withStreamName(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specify reading from streamName.

withStreamName(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

Specify Kinesis stream name which will be used for writing, this name is required.

withTimestampFn(SerializableFunction<KinesisRecord, Instant>) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters

Specify the SerializableFunction to extract the event time from a KinesisRecord.

withUpToDateThreshold(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read

Deprecated.

Specifies how late records consumed by this source can be to still be considered on time.

withWatermarkIdleDurationThreshold(Duration) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters

Specify the watermark idle duration to consider before advancing the watermark.

write() - Static method in class org.apache.beam.sdk.io.kinesis.KinesisIO

Deprecated.

A PTransform writing data to Kinesis.

Write() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisIO.Write

Deprecated.

WRITE_URN - Static variable in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar

WriteBuilder() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder

A B C D E G H K O P R S T U W