Skip navigation links
A B C D E F G H I K M O P R S T U W 

A

algorithm(String) - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey.Builder
 
AttributeValueCoder - Class in org.apache.beam.sdk.io.aws2.dynamodb
A Coder that serializes and deserializes the AttributeValue objects.
AWSClientsProvider - Interface in org.apache.beam.sdk.io.aws2.kinesis
Provides instances of AWS clients.
AwsModule - Class in org.apache.beam.sdk.io.aws2.options
A Jackson Module that registers a JsonSerializer and JsonDeserializer for AwsCredentialsProvider and some subclasses.
AwsModule() - Constructor for class org.apache.beam.sdk.io.aws2.options.AwsModule
 
AwsOptions - Interface in org.apache.beam.sdk.io.aws2.options
Options used to configure Amazon Web Services specific options such as credentials and region.
AwsOptions.AwsUserCredentialsFactory - Class in org.apache.beam.sdk.io.aws2.options
Attempts to load AWS credentials.
AwsPipelineOptionsRegistrar - Class in org.apache.beam.sdk.io.aws2.options
A registrar containing the default AWS options.
AwsPipelineOptionsRegistrar() - Constructor for class org.apache.beam.sdk.io.aws2.options.AwsPipelineOptionsRegistrar
 
AwsSerializableUtils - Class in org.apache.beam.sdk.io.aws2.options
Utilities for working with AWS Serializables.
AwsSerializableUtils() - Constructor for class org.apache.beam.sdk.io.aws2.options.AwsSerializableUtils
 
AwsUserCredentialsFactory() - Constructor for class org.apache.beam.sdk.io.aws2.options.AwsOptions.AwsUserCredentialsFactory
 

B

BasicDynamoDbClientProvider - Class in org.apache.beam.sdk.io.aws2.dynamodb
Basic implementation of DynamoDbClientProvider used by default in DynamoDBIO.
build() - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration.Builder
 
build() - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey.Builder
 
builder() - Static method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration
 
Builder() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration.Builder
 
builder() - Static method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
 
builder() - Static method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey
 

C

CONNECTION_ACQUIRE_TIMEOUT - Static variable in class org.apache.beam.sdk.io.aws2.options.AwsModule
 
CONNECTION_MAX_IDLE_TIMEOUT - Static variable in class org.apache.beam.sdk.io.aws2.options.AwsModule
 
CONNECTION_TIME_TO_LIVE - Static variable in class org.apache.beam.sdk.io.aws2.options.AwsModule
 
CONNECTION_TIMEOUT - Static variable in class org.apache.beam.sdk.io.aws2.options.AwsModule
 
create() - Static method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.options.AwsOptions.AwsUserCredentialsFactory
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.options.S3Options.SSECustomerKeyFactory
 
create(int, Duration) - Static method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.RetryConfiguration
 
createBuilder(S3Options) - Method in interface org.apache.beam.sdk.io.aws2.options.S3ClientBuilderFactory
 
createBuilder(S3Options) - Method in class org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory
 
createWatermarkPolicy() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
 

D

decode(InputStream) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.AttributeValueCoder
 
decode(InputStream) - Method in class org.apache.beam.sdk.io.aws2.sns.PublishResponseCoder
 
decode(InputStream) - Method in class org.apache.beam.sdk.io.aws2.sqs.MessageCoder
 
decode(InputStream) - Method in class org.apache.beam.sdk.io.aws2.sqs.SendMessageRequestCoder
 
DEFAULT_UPLOAD_BUFFER_SIZE_BYTES - Static variable in class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
 
DefaultS3ClientBuilderFactory - Class in org.apache.beam.sdk.io.aws2.s3
Construct S3ClientBuilder with default values of S3 client properties like path style access, accelerated mode, etc.
DefaultS3ClientBuilderFactory() - Constructor for class org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory
 
DelayIntervalRateLimiter() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
 
DelayIntervalRateLimiter(Supplier<Duration>) - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
 
deserializeAwsCredentialsProvider(String) - Static method in class org.apache.beam.sdk.io.aws2.options.AwsSerializableUtils
 
DynamoDbClientProvider - Interface in org.apache.beam.sdk.io.aws2.dynamodb
Provides instances of DynamoDB clients.
DynamoDBIO - Class in org.apache.beam.sdk.io.aws2.dynamodb
PTransforms to read/write from/to Amazon DynamoDB.
DynamoDBIO() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO
 
DynamoDBIO.Read<T> - Class in org.apache.beam.sdk.io.aws2.dynamodb
Read data from DynamoDB and return ScanResult.
DynamoDBIO.RetryConfiguration - Class in org.apache.beam.sdk.io.aws2.dynamodb
A POJO encapsulating a configuration for retry behavior when issuing requests to DynamoDB.
DynamoDBIO.RetryConfiguration.Builder - Class in org.apache.beam.sdk.io.aws2.dynamodb
 
DynamoDBIO.Write<T> - Class in org.apache.beam.sdk.io.aws2.dynamodb
Write a PCollection data into DynamoDB.

E

encode(AttributeValue, OutputStream) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.AttributeValueCoder
 
encode(PublishResponse, OutputStream) - Method in class org.apache.beam.sdk.io.aws2.sns.PublishResponseCoder
 
encode(Message, OutputStream) - Method in class org.apache.beam.sdk.io.aws2.sqs.MessageCoder
 
encode(SendMessageRequest, OutputStream) - Method in class org.apache.beam.sdk.io.aws2.sqs.SendMessageRequestCoder
 
equals(Object) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.BasicDynamoDbClientProvider
 
equals(Object) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
expand(PBegin) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
 
expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
 
expand(PBegin) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
 
expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
 
expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
 
expand(PBegin) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
 
expand(PCollection<SendMessageRequest>) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
 

F

fromOptions(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemRegistrar
 

G

getAlgorithm() - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey
 
getApproximateArrivalTimestamp() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getAttributeMap() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
The client configuration instance that should be used to configure AWS service clients.
getAwsCredentialsProvider() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
The credential instance that should be used to authenticate against AWS services.
getAwsRegion() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
AWS region used by the AWS client.
getCloudWatchClient() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.AWSClientsProvider
 
getCoderProviders() - Method in class org.apache.beam.sdk.io.aws2.sns.SnsCoderProviderRegistrar
 
getCoderProviders() - Method in class org.apache.beam.sdk.io.aws2.sqs.MessageCoderRegistrar
 
getCoderProviders() - Method in class org.apache.beam.sdk.io.aws2.sqs.SendMessageRequestCoderRegistrar
 
getData() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getDataAsBytes() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getDynamoDbClient() - Method in class org.apache.beam.sdk.io.aws2.dynamodb.BasicDynamoDbClientProvider
 
getDynamoDbClient() - Method in interface org.apache.beam.sdk.io.aws2.dynamodb.DynamoDbClientProvider
 
getEndpoint() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
The AWS service endpoint used by the AWS client.
getExtendedSequenceNumber() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getKey() - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey
 
getKinesisClient() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.AWSClientsProvider
 
getMD5() - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey
 
getPartitionKey() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getPipelineOptions() - Method in class org.apache.beam.sdk.io.aws2.options.AwsPipelineOptionsRegistrar
 
getProxyConfiguration() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
The client configuration instance that should be used to configure AWS service clients.
getRateLimitPolicy() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
 
getReadTime() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getS3ClientFactoryClass() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
getS3StorageClass() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
getS3ThreadPoolSize() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
getS3UploadBufferSizeBytes() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
getSequenceNumber() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getShardId() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getSnsAsyncClient() - Method in interface org.apache.beam.sdk.io.aws2.sns.SnsAsyncClientProvider
 
getSnsClient() - Method in interface org.apache.beam.sdk.io.aws2.sns.SnsClientProvider
 
getSqsClient() - Method in interface org.apache.beam.sdk.io.aws2.sqs.SqsClientProvider
 
getSSEAlgorithm() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
getSSECustomerKey() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
getSSEKMSKeyId() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
getStreamName() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getSubSequenceNumber() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getUniqueId() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
getWatermark() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicy
 
getWatermark() - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy
 
getWatermark() - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy
 
getWatermark() - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
 

H

hashCode() - Method in class org.apache.beam.sdk.io.aws2.dynamodb.BasicDynamoDbClientProvider
 
hashCode() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 

I

items() - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
 

K

key(String) - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey.Builder
 
KinesisClientThrottledException - Exception in org.apache.beam.sdk.io.aws2.kinesis
Thrown when the Kinesis client was throttled due to rate limits.
KinesisClientThrottledException(String, KinesisException) - Constructor for exception org.apache.beam.sdk.io.aws2.kinesis.KinesisClientThrottledException
 
KinesisIO - Class in org.apache.beam.sdk.io.aws2.kinesis
PTransforms for reading from Kinesis streams.
KinesisIO() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO
 
KinesisIO.Read - Class in org.apache.beam.sdk.io.aws2.kinesis
Implementation of KinesisIO.read().
KinesisRecord - Class in org.apache.beam.sdk.io.aws2.kinesis
KinesisClientRecord enhanced with utility methods.
KinesisRecord(KinesisClientRecord, String, String) - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 
KinesisRecord(ByteBuffer, String, long, String, Instant, Instant, String, String) - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 

M

MAX_CONNECTIONS - Static variable in class org.apache.beam.sdk.io.aws2.options.AwsModule
 
md5(String) - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey.Builder
 
MessageCoder - Class in org.apache.beam.sdk.io.aws2.sqs
Custom Coder for handling SendMessageRequest for using in Write.
MessageCoderRegistrar - Class in org.apache.beam.sdk.io.aws2.sqs
A CoderProviderRegistrar for standard types used with SqsIO.
MessageCoderRegistrar() - Constructor for class org.apache.beam.sdk.io.aws2.sqs.MessageCoderRegistrar
 
MINIMUM_UPLOAD_BUFFER_SIZE_BYTES - Static variable in class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
 

O

of() - Static method in class org.apache.beam.sdk.io.aws2.dynamodb.AttributeValueCoder
 
onSuccess(List<KinesisRecord>) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicy
Called after Kinesis records are successfully retrieved.
onSuccess(List<KinesisRecord>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
 
onThrottle(KinesisClientThrottledException) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicy
Called after the Kinesis client is throttled.
org.apache.beam.sdk.io.aws2.dynamodb - package org.apache.beam.sdk.io.aws2.dynamodb
Defines IO connectors for Amazon Web Services DynamoDB.
org.apache.beam.sdk.io.aws2.kinesis - package org.apache.beam.sdk.io.aws2.kinesis
Transforms for reading from Amazon Kinesis.
org.apache.beam.sdk.io.aws2.options - package org.apache.beam.sdk.io.aws2.options
Defines PipelineOptions for configuring pipeline execution for Amazon Web Services components.
org.apache.beam.sdk.io.aws2.s3 - package org.apache.beam.sdk.io.aws2.s3
Defines IO connectors for Amazon Web Services S3.
org.apache.beam.sdk.io.aws2.sns - package org.apache.beam.sdk.io.aws2.sns
Defines IO connectors for Amazon Web Services SNS.
org.apache.beam.sdk.io.aws2.sqs - package org.apache.beam.sdk.io.aws2.sqs
Defines IO connectors for Amazon Web Services SQS.

P

ProcessingTimeWatermarkPolicy() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
 
PublishResponseCoder - Class in org.apache.beam.sdk.io.aws2.sns
Custom Coder for handling publish result.

R

RateLimitPolicy - Interface in org.apache.beam.sdk.io.aws2.kinesis
 
RateLimitPolicyFactory - Interface in org.apache.beam.sdk.io.aws2.kinesis
Implement this interface to create a RateLimitPolicy.
RateLimitPolicyFactory.DelayIntervalRateLimiter - Class in org.apache.beam.sdk.io.aws2.kinesis
 
read() - Static method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO
 
Read() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
 
read() - Static method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO
Returns a new KinesisIO.Read transform for reading from Kinesis.
Read() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
 
read() - Static method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO
 
Read() - Constructor for class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
 
READ_TIMEOUT - Static variable in class org.apache.beam.sdk.io.aws2.options.AwsModule
 
REQUIRED_MEMORY_FOR_DEFAULT_BUFFER_BYTES - Static variable in class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
 
RetryConfiguration() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration
 
RetryConfiguration() - Constructor for class org.apache.beam.sdk.io.aws2.sns.SnsIO.RetryConfiguration
 

S

S3ClientBuilderFactory - Interface in org.apache.beam.sdk.io.aws2.options
Construct S3ClientBuilder from S3 pipeline options.
S3FileSystemRegistrar - Class in org.apache.beam.sdk.io.aws2.s3
AutoService registrar for the S3FileSystem.
S3FileSystemRegistrar() - Constructor for class org.apache.beam.sdk.io.aws2.s3.S3FileSystemRegistrar
 
S3Options - Interface in org.apache.beam.sdk.io.aws2.options
Options used to configure Amazon Web Services S3.
S3Options.S3UploadBufferSizeBytesFactory - Class in org.apache.beam.sdk.io.aws2.options
Provide the default s3 upload buffer size in bytes: 64MB if more than 512MB in RAM are available and 5MB otherwise.
S3Options.SSECustomerKeyFactory - Class in org.apache.beam.sdk.io.aws2.options
 
S3UploadBufferSizeBytesFactory() - Constructor for class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
 
SendMessageRequestCoder - Class in org.apache.beam.sdk.io.aws2.sqs
Custom Coder for handling SendMessageRequest for using in Write.
SendMessageRequestCoderRegistrar - Class in org.apache.beam.sdk.io.aws2.sqs
A CoderProviderRegistrar for standard types used with SqsIO.
SendMessageRequestCoderRegistrar() - Constructor for class org.apache.beam.sdk.io.aws2.sqs.SendMessageRequestCoderRegistrar
 
serializeAwsCredentialsProvider(AwsCredentialsProvider) - Static method in class org.apache.beam.sdk.io.aws2.options.AwsSerializableUtils
 
setAttributeMap(AttributeMap) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
 
setAwsCredentialsProvider(AwsCredentialsProvider) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
 
setAwsRegion(String) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
 
setEndpoint(String) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
 
setMaxAttempts(int) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration.Builder
 
setMaxDuration(Duration) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration.Builder
 
setProxyConfiguration(ProxyConfiguration) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
 
setS3ClientFactoryClass(Class<? extends S3ClientBuilderFactory>) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
setS3StorageClass(String) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
setS3ThreadPoolSize(int) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
setS3UploadBufferSizeBytes(Integer) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
setSSEAlgorithm(String) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
setSSECustomerKey(SSECustomerKey) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
setSSEKMSKeyId(String) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
 
SnsAsyncClientProvider - Interface in org.apache.beam.sdk.io.aws2.sns
Provides instances of Asynchronous SNS client.
SnsClientProvider - Interface in org.apache.beam.sdk.io.aws2.sns
Provides instances of SNS client.
SnsCoderProviderRegistrar - Class in org.apache.beam.sdk.io.aws2.sns
A CoderProviderRegistrar for standard types used with SnsIO.
SnsCoderProviderRegistrar() - Constructor for class org.apache.beam.sdk.io.aws2.sns.SnsCoderProviderRegistrar
 
SnsIO - Class in org.apache.beam.sdk.io.aws2.sns
PTransforms for writing to SNS.
SnsIO() - Constructor for class org.apache.beam.sdk.io.aws2.sns.SnsIO
 
SnsIO.RetryConfiguration - Class in org.apache.beam.sdk.io.aws2.sns
A POJO encapsulating a configuration for retry behavior when issuing requests to SNS.
SnsIO.SnsWriteException - Exception in org.apache.beam.sdk.io.aws2.sns
Exception class for SNS write exceptions.
SnsIO.Write<T> - Class in org.apache.beam.sdk.io.aws2.sns
Implementation of SnsIO.write().
SnsIO.WriteAsync<T> - Class in org.apache.beam.sdk.io.aws2.sns
Implementation of SnsIO.writeAsync().
SqsClientProvider - Interface in org.apache.beam.sdk.io.aws2.sqs
Provides instances of Sqs clients.
SqsIO - Class in org.apache.beam.sdk.io.aws2.sqs
An unbounded source for Amazon Simple Queue Service (SQS).
SqsIO.Read - Class in org.apache.beam.sdk.io.aws2.sqs
A PTransform to read/receive messages from SQS.
SqsIO.Write - Class in org.apache.beam.sdk.io.aws2.sqs
A PTransform to send messages to SQS.
SqsMessage - Class in org.apache.beam.sdk.io.aws2.sqs
 
SqsMessage() - Constructor for class org.apache.beam.sdk.io.aws2.sqs.SqsMessage
 
SSECustomerKey - Class in org.apache.beam.sdk.io.aws2.s3
Customer provided key for use with Amazon S3 server-side encryption.
SSECustomerKey.Builder - Class in org.apache.beam.sdk.io.aws2.s3
 
SSECustomerKeyFactory() - Constructor for class org.apache.beam.sdk.io.aws2.options.S3Options.SSECustomerKeyFactory
 

T

TimeUtil - Class in org.apache.beam.sdk.io.aws2.kinesis
Time conversion utilities.
toBuilder() - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
 
toJava(Instant) - Static method in class org.apache.beam.sdk.io.aws2.kinesis.TimeUtil
 
toJoda(Instant) - Static method in class org.apache.beam.sdk.io.aws2.kinesis.TimeUtil
 
toString() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
 

U

update(KinesisRecord) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicy
 
update(KinesisRecord) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy
 
update(KinesisRecord) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy
 
update(KinesisRecord) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
 

W

WatermarkParameters - Class in org.apache.beam.sdk.io.aws2.kinesis
WatermarkParameters contains the parameters used for watermark computation.
WatermarkParameters() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
 
WatermarkPolicy - Interface in org.apache.beam.sdk.io.aws2.kinesis
Implement this interface to define a custom watermark calculation heuristic.
WatermarkPolicyFactory - Interface in org.apache.beam.sdk.io.aws2.kinesis
Implement this interface to create a WatermarkPolicy.
WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.aws2.kinesis
ArrivalTimeWatermarkPolicy uses WatermarkPolicyFactory.CustomWatermarkPolicy for watermark computation.
WatermarkPolicyFactory.CustomWatermarkPolicy - Class in org.apache.beam.sdk.io.aws2.kinesis
CustomWatermarkPolicy uses parameters defined in WatermarkParameters to compute watermarks.
WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.aws2.kinesis
Watermark policy where the processing time is used as the event time.
withArrivalTimePolicy() - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
Returns an ArrivalTimeWatermarkPolicy.
withArrivalTimePolicy(Duration) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
Returns an ArrivalTimeWatermarkPolicy.
withArrivalTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies the WatermarkPolicyFactory as ArrivalTimeWatermarkPolicyFactory.
withArrivalTimeWatermarkPolicy(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies the WatermarkPolicyFactory as ArrivalTimeWatermarkPolicyFactory.
withAWSClientsProvider(AWSClientsProvider) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Allows to specify custom AWSClientsProvider.
withAWSClientsProvider(String, String, Region) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specify credential details and region to be used to read from Kinesis.
withAWSClientsProvider(String, String, Region, String) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specify credential details and region to be used to read from Kinesis.
withCoder(Coder<T>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
 
withCoder(Coder<T>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
Specify a Coder for SNS PublishRequest object.
withCustomRateLimitPolicy(RateLimitPolicyFactory) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies the RateLimitPolicyFactory for a custom rate limiter.
withCustomWatermarkPolicy(WatermarkPolicyFactory) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies the WatermarkPolicyFactory as a custom watermarkPolicyFactory.
withCustomWatermarkPolicy(WatermarkParameters) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
Returns an custom WatermarkPolicyFactory.
withDeduplicateKeys(List<String>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
 
withDelay(Supplier<Duration>) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
 
withDynamicDelayRateLimitPolicy(Supplier<Duration>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies a dynamic delay rate limit policy with the given function being called at each polling interval to get the next delay value.
withDynamoDbClientProvider(DynamoDbClientProvider) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
 
withDynamoDbClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
 
withDynamoDbClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
 
withDynamoDbClientProvider(DynamoDbClientProvider) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
 
withDynamoDbClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
 
withDynamoDbClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
 
withFixedDelay() - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
 
withFixedDelay(Duration) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
 
withFixedDelayRateLimitPolicy() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies a fixed delay rate limit policy with the default delay of 1 second.
withFixedDelayRateLimitPolicy(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies a fixed delay rate limit policy with the given delay.
withInitialPositionInStream(InitialPositionInStream) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specify reading from some initial position in stream.
withInitialTimestampInStream(Instant) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specify reading beginning at given Instant.
withMaxCapacityPerShard(Integer) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies the maximum number of messages per one shard.
withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies to read at most a given number of records.
withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
Define the max number of records received by the SqsIO.Read.
withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies to read records during maxReadTime.
withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
Define the max read time (duration) while the SqsIO.Read will receive messages.
withoutLimiter() - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
 
withProcessingTimePolicy() - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
Returns an ProcessingTimeWatermarkPolicy.
withProcessingTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies the WatermarkPolicyFactory as ProcessingTimeWatermarkPolicyFactory.
withPublishRequestFn(SerializableFunction<T, PublishRequest>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
Specify a function for converting a message into PublishRequest object, this function is mandatory.
withPublishRequestFn(SerializableFunction<T, PublishRequest>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
Specify a function for converting a message into PublishRequest object.
withQueueUrl(String) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
Define the queueUrl used by the SqsIO.Read to receive messages from SQS.
withRequestRecordsLimit(int) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies the maximum number of records in GetRecordsResult returned by GetRecords call which is limited by 10K records.
withRetryConfiguration(DynamoDBIO.RetryConfiguration) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
Provides configuration to retry a failed request to publish a set of records to DynamoDb.
withRetryConfiguration(SnsIO.RetryConfiguration) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
Provides configuration to retry a failed request to publish a message to SNS.
withScanRequestFn(SerializableFunction<Void, ScanRequest>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
Can't pass ScanRequest object directly from client since this object is not full serializable.
withScanResponseMapperFn(SerializableFunction<ScanResponse, T>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
 
withSnsClientProvider(SnsClientProvider) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
Allows to specify custom SnsClientProvider.
withSnsClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
Specify AwsCredentialsProvider and region to be used to write to SNS.
withSnsClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
Specify AwsCredentialsProvider and region to be used to write to SNS.
withSnsClientProvider(SnsAsyncClientProvider) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
Allows to specify custom SnsAsyncClientProvider.
withSnsClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
Specify credential details and region to be used to write to SNS.
withSnsClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
Specify credential details and region to be used to write to SNS.
withSqsClientProvider(SqsClientProvider) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
Allows to specify custom SqsClientProvider.
withSqsClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
Specify AwsCredentialsProvider and region to be used to read from SQS.
withSqsClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
Specify AwsCredentialsProvider and region to be used to write to SQS.
withSqsClientProvider(SqsClientProvider) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
Allows to specify custom SqsClientProvider.
withSqsClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
Specify AwsCredentialsProvider and region to be used to write to SQS.
withSqsClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
Specify AwsCredentialsProvider and region to be used to write to SQS.
withStreamName(String) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specify reading from streamName.
withTimestampFn(SerializableFunction<KinesisRecord, Instant>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
Specify the SerializableFunction to extract the event time from a KinesisRecord.
withTopicArn(String) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
Specify the SNS topic which will be used for writing, this name is mandatory.
withUpToDateThreshold(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
Specifies how late records consumed by this source can be to still be considered on time.
withWatermarkIdleDurationThreshold(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
Specify the watermark idle duration to consider before advancing the watermark.
withWriteRequestMapperFn(SerializableFunction<T, KV<String, WriteRequest>>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
 
write() - Static method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO
 
Write() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
 
write() - Static method in class org.apache.beam.sdk.io.aws2.sns.SnsIO
 
Write() - Constructor for class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
 
write() - Static method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO
 
Write() - Constructor for class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
 
writeAsync() - Static method in class org.apache.beam.sdk.io.aws2.sns.SnsIO
 
WriteAsync() - Constructor for class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
 
A B C D E F G H I K M O P R S T U W 
Skip navigation links