A B C D E F G H I K M N O P R S T U V W
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- algorithm(String) - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey.Builder
- AttributeValueCoder - Class in org.apache.beam.sdk.io.aws2.dynamodb
-
A
Coderthat serializes and deserializes theAttributeValueobjects. - AwsBuilderFactory<PojoT extends software.amazon.awssdk.core.SdkPojo,BuilderT extends software.amazon.awssdk.utils.builder.SdkBuilder<BuilderT,PojoT> & software.amazon.awssdk.core.SdkPojo> - Class in org.apache.beam.sdk.io.aws2.schemas
-
Builder factory for AWS
SdkPojoto avoid using reflection to instantiate a builder. - AwsBuilderFactory() - Constructor for class org.apache.beam.sdk.io.aws2.schemas.AwsBuilderFactory
- AWSClientsProvider - Interface in org.apache.beam.sdk.io.aws2.kinesis
-
Deprecated.Configure a custom
ClientBuilderFactoryusingAwsOptions.getClientBuilderFactory()instead. - AwsCoders - Class in org.apache.beam.sdk.io.aws2.coders
-
Deprecated.
- AwsModule - Class in org.apache.beam.sdk.io.aws2.options
-
A Jackson
Modulethat registers aJsonSerializerandJsonDeserializerforAwsCredentialsProviderand some subclasses. - AwsModule() - Constructor for class org.apache.beam.sdk.io.aws2.options.AwsModule
- AwsOptions - Interface in org.apache.beam.sdk.io.aws2.options
-
Options used to configure Amazon Web Services specific options such as credentials and region.
- AwsOptions.AwsRegionFactory - Class in org.apache.beam.sdk.io.aws2.options
-
Attempt to load default region.
- AwsOptions.AwsUserCredentialsFactory - Class in org.apache.beam.sdk.io.aws2.options
-
Return
DefaultCredentialsProvideras default provider. - AwsPipelineOptionsRegistrar - Class in org.apache.beam.sdk.io.aws2.options
-
A registrar containing the default AWS options.
- AwsPipelineOptionsRegistrar() - Constructor for class org.apache.beam.sdk.io.aws2.options.AwsPipelineOptionsRegistrar
- AwsRegionFactory() - Constructor for class org.apache.beam.sdk.io.aws2.options.AwsOptions.AwsRegionFactory
- awsResponseMetadata() - Static method in class org.apache.beam.sdk.io.aws2.coders.AwsCoders
-
Deprecated.Returns a new coder for
AwsResponseMetadata(AWS request ID only). - AwsSchemaProvider - Class in org.apache.beam.sdk.io.aws2.schemas
-
Schema provider for AWS
SdkPojomodels using the provided field metadata (@seeSdkPojo.sdkFields()) rather than reflection. - AwsSchemaProvider() - Constructor for class org.apache.beam.sdk.io.aws2.schemas.AwsSchemaProvider
- AwsSchemaRegistrar - Class in org.apache.beam.sdk.io.aws2.schemas
- AwsSchemaRegistrar() - Constructor for class org.apache.beam.sdk.io.aws2.schemas.AwsSchemaRegistrar
- AwsSerializableUtils - Class in org.apache.beam.sdk.io.aws2.options
-
Utilities for working with AWS Serializables.
- AwsSerializableUtils() - Constructor for class org.apache.beam.sdk.io.aws2.options.AwsSerializableUtils
- AwsTypes - Class in org.apache.beam.sdk.io.aws2.schemas
- AwsTypes() - Constructor for class org.apache.beam.sdk.io.aws2.schemas.AwsTypes
- AwsUserCredentialsFactory() - Constructor for class org.apache.beam.sdk.io.aws2.options.AwsOptions.AwsUserCredentialsFactory
B
- baseBackoff() - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration
- baseBackoff(Duration) - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration.Builder
- BasicDynamoDbClientProvider - Class in org.apache.beam.sdk.io.aws2.dynamodb
-
Deprecated.Configure a custom
ClientBuilderFactoryusingAwsOptions.getClientBuilderFactory()instead. - build() - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration.Builder
- build() - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
- build() - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration.Builder
- build() - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration.Builder
-
Deprecated.
- build() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.RecordAggregation.Builder
- build() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- build() - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey.Builder
- buildClient(AwsOptions, BuilderT, ClientConfiguration) - Static method in interface org.apache.beam.sdk.io.aws2.common.ClientBuilderFactory
-
Utility to directly build a client of type
ClientBuilderFactoryusing builder ofClientBuilderFactory. - builder() - Static method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration
- builder() - Static method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
- builder() - Static method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration
- builder() - Static method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration
-
Deprecated.
- builder() - Static method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.RecordAggregation
- builder() - Static method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
- builder() - Static method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
Creates a new uninitialized
S3FileSystemConfiguration.Builder. - builder() - Static method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey
- Builder() - Constructor for class org.apache.beam.sdk.io.aws2.common.ClientConfiguration.Builder
- Builder() - Constructor for class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
- Builder() - Constructor for class org.apache.beam.sdk.io.aws2.common.RetryConfiguration.Builder
- Builder() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration.Builder
-
Deprecated.
- Builder() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.RecordAggregation.Builder
- Builder() - Constructor for class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- builderFrom(S3Options) - Static method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
Creates a new
S3FileSystemConfiguration.Builderwith values initialized by the properties ofs3Options.
C
- checkConfiguration(ClientConfiguration, AwsOptions) - Method in interface org.apache.beam.sdk.io.aws2.common.ClientBuilderFactory
-
Check if all necessary configuration is available to create clients.
- checkConfiguration(ClientConfiguration, AwsOptions) - Method in class org.apache.beam.sdk.io.aws2.common.ClientBuilderFactory.DefaultClientBuilder
- ClientBuilderFactory - Interface in org.apache.beam.sdk.io.aws2.common
-
Factory to build and configure any
AwsClientBuilderusing a specificClientConfigurationor the globally provided settings inAwsOptionsas fallback. - ClientBuilderFactory.DefaultClientBuilder - Class in org.apache.beam.sdk.io.aws2.common
-
Default implementation of
ClientBuilderFactory. - ClientConfiguration - Class in org.apache.beam.sdk.io.aws2.common
-
AWS client configuration.
- ClientConfiguration() - Constructor for class org.apache.beam.sdk.io.aws2.common.ClientConfiguration
- ClientConfiguration.Builder - Class in org.apache.beam.sdk.io.aws2.common
- connectionAcquisitionTimeout() - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
-
Milliseconds to wait when acquiring a connection from the pool before giving up and timing out.
- connectionAcquisitionTimeout(Integer) - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
-
Milliseconds to wait when acquiring a connection from the pool before giving up and timing out.
- connectionMaxIdleTime() - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
-
Maximum milliseconds a connection should be allowed to remain open while idle.
- connectionMaxIdleTime(Integer) - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
-
Maximum milliseconds a connection should be allowed to remain open while idle.
- connectionTimeout() - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
-
Milliseconds to wait when initially establishing a connection before giving up and timing out.
- connectionTimeout(Integer) - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
-
Milliseconds to wait when initially establishing a connection before giving up and timing out.
- connectionTimeToLive() - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
-
Maximum milliseconds a connection should be allowed to remain open, regardless of usage frequency.
- connectionTimeToLive(Integer) - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
-
Maximum milliseconds a connection should be allowed to remain open, regardless of usage frequency.
- create() - Static method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
- create(int, Duration) - Static method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.RetryConfiguration
-
Deprecated.Use
RetryConfigurationinstead. - create(BuilderT, ClientConfiguration, AwsOptions) - Method in interface org.apache.beam.sdk.io.aws2.common.ClientBuilderFactory
-
Configure a client builder
ClientBuilderFactoryusing the providedClientConfigurationand fall back to the global defaults inAwsOptionswhere necessary. - create(BuilderT, ClientConfiguration, AwsOptions) - Method in class org.apache.beam.sdk.io.aws2.common.ClientBuilderFactory.DefaultClientBuilder
- create(BuilderT, AwsOptions) - Method in interface org.apache.beam.sdk.io.aws2.common.ClientBuilderFactory
-
Configure a client builder
ClientBuilderFactoryusing the global defaults inAwsOptions. - create(String, String, String, long, long) - Static method in class org.apache.beam.sdk.io.aws2.sqs.SqsMessage
- create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.options.AwsOptions.AwsRegionFactory
- create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.options.AwsOptions.AwsUserCredentialsFactory
- create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
- create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.options.S3Options.SSECustomerKeyFactory
- create(AwsCredentialsProvider, Region, URI) - Static method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration
- createBuilder(S3Options) - Method in interface org.apache.beam.sdk.io.aws2.options.S3ClientBuilderFactory
- createBuilder(S3Options) - Method in class org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory
- createWatermarkPolicy() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
- credentialsProvider() - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration
-
Optional
AwsCredentialsProvider. - credentialsProvider(AwsCredentialsProvider) - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration.Builder
-
Optional
AwsCredentialsProvider.
D
- decode(InputStream) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.AttributeValueCoder
- DEFAULT_UPLOAD_BUFFER_SIZE_BYTES - Static variable in class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
- defaultFactory() - Static method in interface org.apache.beam.sdk.io.aws2.common.ClientBuilderFactory
-
The default
ClientBuilderFactoryinstance. - defaultPublishResponse() - Static method in class org.apache.beam.sdk.io.aws2.sns.PublishResponseCoders
-
Deprecated.Returns a new SNS
PublishResponsecoder which by default serializes only the SNS messageId. - DefaultRateLimiter(BackOff, BackOff) - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
- DefaultRateLimiter(Duration, Duration, Duration) - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
- DefaultS3ClientBuilderFactory - Class in org.apache.beam.sdk.io.aws2.s3
-
Construct S3ClientBuilder with default values of S3 client properties like path style access, accelerated mode, etc.
- DefaultS3ClientBuilderFactory() - Constructor for class org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory
- DefaultS3FileSystemSchemeRegistrar - Class in org.apache.beam.sdk.io.aws2.s3
-
Registers the "s3" uri schema to be handled by
S3FileSystem. - DefaultS3FileSystemSchemeRegistrar() - Constructor for class org.apache.beam.sdk.io.aws2.s3.DefaultS3FileSystemSchemeRegistrar
- DelayIntervalRateLimiter() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
- DelayIntervalRateLimiter(Supplier<Duration>) - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
- deserializeAwsCredentialsProvider(String) - Static method in class org.apache.beam.sdk.io.aws2.options.AwsSerializableUtils
- DynamoDbClientProvider - Interface in org.apache.beam.sdk.io.aws2.dynamodb
-
Deprecated.Configure a custom
ClientBuilderFactoryusingAwsOptions.getClientBuilderFactory()instead. - DynamoDBIO - Class in org.apache.beam.sdk.io.aws2.dynamodb
-
IO to read from and write to DynamoDB tables.
- DynamoDBIO() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO
- DynamoDBIO.Read<T> - Class in org.apache.beam.sdk.io.aws2.dynamodb
-
Read data from DynamoDB using
DynamoDBIO.Read.getScanRequestFn()and emit an element of typeDynamoDBIO.Readfor eachScanResponseusing the mapping functionDynamoDBIO.Read.getScanResponseMapperFn(). - DynamoDBIO.RetryConfiguration - Class in org.apache.beam.sdk.io.aws2.dynamodb
-
Deprecated.Use
RetryConfigurationinstead to delegate retries to the AWS SDK. - DynamoDBIO.RetryConfiguration.Builder - Class in org.apache.beam.sdk.io.aws2.dynamodb
-
Deprecated.
- DynamoDBIO.Write<T> - Class in org.apache.beam.sdk.io.aws2.dynamodb
-
Write a PCollection
data into DynamoDB.
E
- encode(AttributeValue, OutputStream) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.AttributeValueCoder
- endpoint() - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration
-
Optional service endpoint to use AWS compatible services instead, e.g.
- endpoint(URI) - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration.Builder
-
Optional service endpoint to use AWS compatible services instead, e.g.
- equals(Object) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.BasicDynamoDbClientProvider
-
Deprecated.
- equals(Object) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- expand() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write.Result
- expand(PBegin) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
- expand(PBegin) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
- expand(PBegin) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
- expand(PCollection<SendMessageRequest>) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
- expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
- expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
- expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
- expand(PCollection<T>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
-
Deprecated.
- explicitRandomPartitioner(int) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.KinesisPartitioner
-
Explicit hash key partitioner that randomly returns one of x precalculated hash keys.
F
- fieldValueGetters(Class<?>, Schema) - Method in class org.apache.beam.sdk.io.aws2.schemas.AwsSchemaProvider
- fieldValueTypeInformations(Class<?>, Schema) - Method in class org.apache.beam.sdk.io.aws2.schemas.AwsSchemaProvider
- finishSpecifyingOutput(String, PInput, PTransform<?, ?>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write.Result
- fromOptions(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.s3.DefaultS3FileSystemSchemeRegistrar
- fromOptions(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemRegistrar
- fromOptions(PipelineOptions) - Method in interface org.apache.beam.sdk.io.aws2.s3.S3FileSystemSchemeRegistrar
-
Create zero or more
S3FileSystemConfigurationinstances from the givenPipelineOptions. - fromRowFunction(TypeDescriptor<T>) - Method in class org.apache.beam.sdk.io.aws2.schemas.AwsSchemaProvider
- fromS3Options(S3Options) - Static method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
- fullPublishResponse() - Static method in class org.apache.beam.sdk.io.aws2.sns.PublishResponseCoders
-
Deprecated.Returns a new SNS
PublishResponsecoder which serializesAwsResponseMetadataandSdkHttpResponse, including the HTTP response headers. - fullPublishResponseWithoutHeaders() - Static method in class org.apache.beam.sdk.io.aws2.sns.PublishResponseCoders
-
Deprecated.Returns a new SNS
PublishResponsecoder which serializesAwsResponseMetadataandSdkHttpResponse, but not including the HTTP response headers.
G
- get() - Method in class org.apache.beam.sdk.io.aws2.schemas.AwsBuilderFactory
- getAlgorithm() - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey
- getApproximateArrivalTimestamp() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getAwsCredentialsProvider() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
-
AwsCredentialsProviderused to configure AWS service clients. - getAwsRegion() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
-
Region used to configure AWS service clients.
- getBody() - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsMessage
-
Message body.
- getBucketKeyEnabled() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- getBucketKeyEnabled() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
Whether to use an S3 Bucket Key for object encryption with server-side encryption using AWS KMS (SSE-KMS) or not.
- getClientBuilderFactory() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
- getCloudWatchClient() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.AWSClientsProvider
-
Deprecated.
- getData() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getDataAsBytes() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getDynamoDbClient() - Method in class org.apache.beam.sdk.io.aws2.dynamodb.BasicDynamoDbClientProvider
-
Deprecated.
- getDynamoDbClient() - Method in interface org.apache.beam.sdk.io.aws2.dynamodb.DynamoDbClientProvider
-
Deprecated.
- getEndpoint() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
-
Endpoint used to configure AWS service clients.
- getExplicitHashKey(T) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.KinesisPartitioner.ExplicitPartitioner
-
Required hash value (128-bit integer) to determine explicitly the shard a record is assigned to based on the hash key range of each shard.
- getExplicitHashKey(T) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.KinesisPartitioner
-
Optional hash value (128-bit integer) to determine explicitly the shard a record is assigned to based on the hash key range of each shard.
- getExtendedSequenceNumber() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getFactory(AwsOptions) - Static method in interface org.apache.beam.sdk.io.aws2.common.ClientBuilderFactory
-
Get a
ClientBuilderFactoryinstance according toAwsOptions.getClientBuilderFactory(). - getHttpClientConfiguration() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
-
HttpClientConfigurationused to configure AWS service clients. - getKey() - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey
- getKinesisClient() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.AWSClientsProvider
-
Deprecated.
- getMD5() - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey
- getMessageId() - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsMessage
-
SQS message id.
- getPartitionKey() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getPartitionKey(T) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.KinesisPartitioner.ExplicitPartitioner
- getPartitionKey(T) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.KinesisPartitioner
-
Determines which shard in the stream the record is assigned to.
- getPipeline() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write.Result
- getPipelineOptions() - Method in class org.apache.beam.sdk.io.aws2.options.AwsPipelineOptionsRegistrar
- getProxyConfiguration() - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
-
ProxyConfigurationused to configure AWS service clients. - getRateLimitPolicy() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
- getReadTime() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getReceiptHandle() - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsMessage
-
SQS receipt handle.
- getRequestTimeStamp() - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsMessage
-
Timestamp the message was received at (in epoch millis).
- getS3ClientBuilder() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
Builder used to create the
S3Client. - getS3ClientFactoryClass() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- getS3StorageClass() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- getS3StorageClass() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
The AWS S3 storage class used for creating S3 objects.
- getS3ThreadPoolSize() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- getS3ThreadPoolSize() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
Thread pool size, limiting the max concurrent S3 operations.
- getS3UploadBufferSizeBytes() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- getS3UploadBufferSizeBytes() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
Size of S3 upload chnks.
- getSchemaProviders() - Method in class org.apache.beam.sdk.io.aws2.schemas.AwsSchemaRegistrar
- getScheme() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
The uri scheme used by resources on this filesystem.
- getSequenceNumber() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getShardId() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getSnsAsyncClient() - Method in interface org.apache.beam.sdk.io.aws2.sns.SnsAsyncClientProvider
- getSnsClient() - Method in interface org.apache.beam.sdk.io.aws2.sns.SnsClientProvider
-
Deprecated.
- getSqsClient() - Method in interface org.apache.beam.sdk.io.aws2.sqs.SqsClientProvider
-
Deprecated.
- getSSEAlgorithm() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- getSSEAlgorithm() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
Algorithm for SSE-S3 encryption, e.g.
- getSSECustomerKey() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- getSSECustomerKey() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
SSE key for SSE-C encryption, e.g.
- getSSEKMSKeyId() - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- getSSEKMSKeyId() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
KMS key id for SSE-KMS encyrption, e.g.
- getStreamName() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getSubSequenceNumber() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getTimeStamp() - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsMessage
-
Timestamp the message was sent at (in epoch millis).
- getUniqueId() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- getWatermark() - Method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicy
- getWatermark() - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy
- getWatermark() - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy
- getWatermark() - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
H
- hashCode() - Method in class org.apache.beam.sdk.io.aws2.dynamodb.BasicDynamoDbClientProvider
-
Deprecated.
- hashCode() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- HttpClientConfiguration - Class in org.apache.beam.sdk.io.aws2.common
-
HTTP client configuration for both, sync and async AWS clients.
- HttpClientConfiguration() - Constructor for class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
- HttpClientConfiguration.Builder - Class in org.apache.beam.sdk.io.aws2.common
I
- items() - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
K
- key(String) - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey.Builder
- KinesisClientThrottledException - Exception in org.apache.beam.sdk.io.aws2.kinesis
-
Thrown when the Kinesis client was throttled due to rate limits.
- KinesisClientThrottledException(String, KinesisException) - Constructor for exception org.apache.beam.sdk.io.aws2.kinesis.KinesisClientThrottledException
- KinesisIO - Class in org.apache.beam.sdk.io.aws2.kinesis
-
IO to read from Kinesis streams.
- KinesisIO() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO
- KinesisIO.Read - Class in org.apache.beam.sdk.io.aws2.kinesis
-
Implementation of
KinesisIO.read(). - KinesisIO.RecordAggregation - Class in org.apache.beam.sdk.io.aws2.kinesis
-
Configuration of Kinesis record aggregation.
- KinesisIO.RecordAggregation.Builder - Class in org.apache.beam.sdk.io.aws2.kinesis
- KinesisIO.Write<T> - Class in org.apache.beam.sdk.io.aws2.kinesis
-
Implementation of
KinesisIO.write(). - KinesisIO.Write.Result - Class in org.apache.beam.sdk.io.aws2.kinesis
-
Result of
KinesisIO.write(). - KinesisPartitioner<T> - Interface in org.apache.beam.sdk.io.aws2.kinesis
-
Kinesis interface for custom partitioner.
- KinesisPartitioner.ExplicitPartitioner<T> - Interface in org.apache.beam.sdk.io.aws2.kinesis
-
An explicit partitioner that always returns a
Nonnullexplicit hash key. - KinesisRecord - Class in org.apache.beam.sdk.io.aws2.kinesis
-
KinesisClientRecordenhanced with utility methods. - KinesisRecord(ByteBuffer, String, long, String, Instant, Instant, String, String) - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
- KinesisRecord(KinesisClientRecord, String, String) - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
M
- MAX_HASH_KEY - Static variable in interface org.apache.beam.sdk.io.aws2.kinesis.KinesisPartitioner
- maxBackoff() - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration
- maxBackoff(Duration) - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration.Builder
- maxBufferedTime(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.RecordAggregation.Builder
-
Buffer timeout for user records.
- maxBytes(int) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.RecordAggregation.Builder
-
Max bytes per aggregated record.
- maxConnections() - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
-
The maximum number of connections allowed in the connection pool.
- maxConnections(Integer) - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
-
The maximum number of connections allowed in the connection pool.
- md5(String) - Method in class org.apache.beam.sdk.io.aws2.s3.SSECustomerKey.Builder
- MIN_HASH_KEY - Static variable in interface org.apache.beam.sdk.io.aws2.kinesis.KinesisPartitioner
- MINIMUM_UPLOAD_BUFFER_SIZE_BYTES - Static variable in class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
- MINIMUM_UPLOAD_BUFFER_SIZE_BYTES - Static variable in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
N
- numRetries() - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration
- numRetries(int) - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration.Builder
O
- ObjectPool<KeyT extends @NonNull java.lang.Object,ObjectT extends @NonNull java.lang.Object> - Class in org.apache.beam.sdk.io.aws2.common
-
Reference counting object pool to easily share & destroy objects.
- ObjectPool(Function<KeyT, ObjectT>) - Constructor for class org.apache.beam.sdk.io.aws2.common.ObjectPool
- ObjectPool(Function<KeyT, ObjectT>, ThrowingConsumer<Exception, ObjectT>) - Constructor for class org.apache.beam.sdk.io.aws2.common.ObjectPool
- ObjectPool.ClientPool<ClientT extends software.amazon.awssdk.core.SdkClient> - Class in org.apache.beam.sdk.io.aws2.common
-
Client pool to easily share AWS clients per configuration.
- of() - Static method in class org.apache.beam.sdk.io.aws2.dynamodb.AttributeValueCoder
- onSuccess(List<KinesisRecord>) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicy
-
Called after Kinesis records are successfully retrieved.
- onSuccess(List<KinesisRecord>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
- onSuccess(List<KinesisRecord>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
- onThrottle(KinesisClientThrottledException) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicy
-
Called after the Kinesis client is throttled.
- onThrottle(KinesisClientThrottledException) - Method in class org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
- org.apache.beam.sdk.io.aws2.coders - package org.apache.beam.sdk.io.aws2.coders
-
Defines common coders for Amazon Web Services.
- org.apache.beam.sdk.io.aws2.common - package org.apache.beam.sdk.io.aws2.common
-
Common code for AWS sources and sinks such as retry configuration.
- org.apache.beam.sdk.io.aws2.dynamodb - package org.apache.beam.sdk.io.aws2.dynamodb
-
Defines IO connectors for Amazon Web Services DynamoDB.
- org.apache.beam.sdk.io.aws2.kinesis - package org.apache.beam.sdk.io.aws2.kinesis
-
Transforms for reading from Amazon Kinesis.
- org.apache.beam.sdk.io.aws2.options - package org.apache.beam.sdk.io.aws2.options
-
Defines
PipelineOptionsfor configuring pipeline execution for Amazon Web Services components. - org.apache.beam.sdk.io.aws2.s3 - package org.apache.beam.sdk.io.aws2.s3
-
Defines IO connectors for Amazon Web Services S3.
- org.apache.beam.sdk.io.aws2.schemas - package org.apache.beam.sdk.io.aws2.schemas
-
Schemas for AWS model classes.
- org.apache.beam.sdk.io.aws2.sns - package org.apache.beam.sdk.io.aws2.sns
-
Defines IO connectors for Amazon Web Services SNS.
- org.apache.beam.sdk.io.aws2.sqs - package org.apache.beam.sdk.io.aws2.sqs
-
Defines IO connectors for Amazon Web Services SQS.
P
- pooledClientFactory(BuilderT) - Static method in class org.apache.beam.sdk.io.aws2.common.ObjectPool
- ProcessingTimeWatermarkPolicy() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
- PublishResponseCoders - Class in org.apache.beam.sdk.io.aws2.sns
-
Deprecated.Schema based coder is inferred automatically.
R
- RateLimitPolicy - Interface in org.apache.beam.sdk.io.aws2.kinesis
- RateLimitPolicyFactory - Interface in org.apache.beam.sdk.io.aws2.kinesis
-
Implement this interface to create a
RateLimitPolicy. - RateLimitPolicyFactory.DefaultRateLimiter - Class in org.apache.beam.sdk.io.aws2.kinesis
-
Default rate limiter that throttles reading from a shard using an exponential backoff if the response is empty or if the consumer is throttled by AWS.
- RateLimitPolicyFactory.DelayIntervalRateLimiter - Class in org.apache.beam.sdk.io.aws2.kinesis
- read() - Static method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO
- read() - Static method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO
-
Returns a new
KinesisIO.Readtransform for reading from Kinesis. - read() - Static method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO
- Read() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
- Read() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
- Read() - Constructor for class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
- readTimeout() - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
-
Milliseconds to wait for a read on a socket before an exception is thrown.
- readTimeout(Integer) - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
-
Milliseconds to wait for a read on a socket before an exception is thrown.
- RecordAggregation() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.RecordAggregation
- region() - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration
-
Optional
Region. - region(Region) - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration.Builder
-
Optional
Region. - release(ObjectT) - Method in class org.apache.beam.sdk.io.aws2.common.ObjectPool
-
Release a reference to a shared client instance.
- releaseByKey(KeyT) - Method in class org.apache.beam.sdk.io.aws2.common.ObjectPool
-
Release a reference to a shared object instance using
ObjectPool. - REQUIRED_MEMORY_FOR_DEFAULT_BUFFER_BYTES - Static variable in class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
- retain(KeyT) - Method in class org.apache.beam.sdk.io.aws2.common.ObjectPool
-
Retain a reference to a shared client instance.
- retain(AwsOptions, ClientConfiguration) - Method in class org.apache.beam.sdk.io.aws2.common.ObjectPool.ClientPool
-
Retain a reference to a shared client instance.
- retry() - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration
-
Optional
RetryConfigurationfor AWS clients. - retry(Consumer<RetryConfiguration.Builder>) - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration.Builder
-
Optional
RetryConfigurationfor AWS clients. - retry(RetryConfiguration) - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration.Builder
-
Optional
RetryConfigurationfor AWS clients. - RetryConfiguration - Class in org.apache.beam.sdk.io.aws2.common
-
Configuration of the retry behavior for AWS SDK clients.
- RetryConfiguration() - Constructor for class org.apache.beam.sdk.io.aws2.common.RetryConfiguration
- RetryConfiguration() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration
-
Deprecated.
- RetryConfiguration() - Constructor for class org.apache.beam.sdk.io.aws2.sns.SnsIO.RetryConfiguration
-
Deprecated.
- RetryConfiguration.Builder - Class in org.apache.beam.sdk.io.aws2.common
S
- S3ClientBuilderFactory - Interface in org.apache.beam.sdk.io.aws2.options
-
Construct S3ClientBuilder from S3 pipeline options.
- S3FileSystemConfiguration - Class in org.apache.beam.sdk.io.aws2.s3
-
Object used to configure
S3FileSystem. - S3FileSystemConfiguration() - Constructor for class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
- S3FileSystemConfiguration.Builder - Class in org.apache.beam.sdk.io.aws2.s3
- S3FileSystemRegistrar - Class in org.apache.beam.sdk.io.aws2.s3
-
AutoServiceregistrar for theS3FileSystem. - S3FileSystemRegistrar() - Constructor for class org.apache.beam.sdk.io.aws2.s3.S3FileSystemRegistrar
- S3FileSystemSchemeRegistrar - Interface in org.apache.beam.sdk.io.aws2.s3
-
A registrar that creates
S3FileSystemConfigurationinstances fromPipelineOptions. - S3Options - Interface in org.apache.beam.sdk.io.aws2.options
-
Options used to configure Amazon Web Services S3.
- S3Options.S3UploadBufferSizeBytesFactory - Class in org.apache.beam.sdk.io.aws2.options
-
Provide the default s3 upload buffer size in bytes: 64MB if more than 512MB in RAM are available and 5MB otherwise.
- S3Options.SSECustomerKeyFactory - Class in org.apache.beam.sdk.io.aws2.options
- S3UploadBufferSizeBytesFactory() - Constructor for class org.apache.beam.sdk.io.aws2.options.S3Options.S3UploadBufferSizeBytesFactory
- schemaFor(TypeDescriptor<T>) - Method in class org.apache.beam.sdk.io.aws2.schemas.AwsSchemaProvider
- schemaTypeCreator(Class<?>, Schema) - Method in class org.apache.beam.sdk.io.aws2.schemas.AwsSchemaProvider
- sdkFields() - Method in class org.apache.beam.sdk.io.aws2.schemas.AwsBuilderFactory
- sdkHttpResponse() - Static method in class org.apache.beam.sdk.io.aws2.coders.AwsCoders
-
Deprecated.Returns a new coder for
SdkHttpResponse(HTTP status code and headers). - sdkHttpResponseWithoutHeaders() - Static method in class org.apache.beam.sdk.io.aws2.coders.AwsCoders
-
Deprecated.Returns a new coder for
SdkHttpResponse(HTTP status code only). - serializeAwsCredentialsProvider(AwsCredentialsProvider) - Static method in class org.apache.beam.sdk.io.aws2.options.AwsSerializableUtils
- setAwsCredentialsProvider(AwsCredentialsProvider) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
- setAwsRegion(Region) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
- setBucketKeyEnabled(boolean) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- setBucketKeyEnabled(boolean) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- setClientBuilderFactory(Class<? extends ClientBuilderFactory>) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
- setEndpoint(URI) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
- setHttpClientConfiguration(HttpClientConfiguration) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
- setMaxAttempts(int) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration.Builder
-
Deprecated.
- setMaxDuration(Duration) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.RetryConfiguration.Builder
-
Deprecated.Warning, max accumulative retry latency is silently ignored as it is not supported by the AWS SDK.
- setProxyConfiguration(ProxyConfiguration) - Method in interface org.apache.beam.sdk.io.aws2.options.AwsOptions
- setS3ClientBuilder(S3ClientBuilder) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- setS3ClientFactoryClass(Class<? extends S3ClientBuilderFactory>) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- setS3StorageClass(String) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- setS3StorageClass(String) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- setS3ThreadPoolSize(int) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- setS3ThreadPoolSize(int) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- setS3UploadBufferSizeBytes(int) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- setS3UploadBufferSizeBytes(Integer) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- setScheme(String) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- setSSEAlgorithm(String) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- setSSEAlgorithm(String) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- setSSECustomerKey(SSECustomerKey) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- setSSECustomerKey(SSECustomerKey) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- setSSEKMSKeyId(String) - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration.Builder
- setSSEKMSKeyId(String) - Method in interface org.apache.beam.sdk.io.aws2.options.S3Options
- setupModule(Module.SetupContext) - Method in class org.apache.beam.sdk.io.aws2.options.AwsModule
- shardRefreshInterval(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.RecordAggregation.Builder
-
Refresh interval for shards.
- SnsAsyncClientProvider - Interface in org.apache.beam.sdk.io.aws2.sns
-
Provides instances of Asynchronous SNS client.
- SnsClientProvider - Interface in org.apache.beam.sdk.io.aws2.sns
-
Deprecated.Configure a custom
ClientBuilderFactoryusingAwsOptions.getClientBuilderFactory()instead. - SnsIO - Class in org.apache.beam.sdk.io.aws2.sns
-
IO to send notifications via SNS.
- SnsIO() - Constructor for class org.apache.beam.sdk.io.aws2.sns.SnsIO
- SnsIO.RetryConfiguration - Class in org.apache.beam.sdk.io.aws2.sns
-
Deprecated.Use
RetryConfigurationinstead to delegate retries to the AWS SDK. - SnsIO.SnsWriteException - Exception in org.apache.beam.sdk.io.aws2.sns
-
Exception class for SNS write exceptions.
- SnsIO.Write<T> - Class in org.apache.beam.sdk.io.aws2.sns
-
Implementation of
SnsIO.write(). - SnsIO.WriteAsync<T> - Class in org.apache.beam.sdk.io.aws2.sns
-
Deprecated.Please use
SnsIO.write()to avoid the risk of data loss. - socketTimeout() - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
-
Milliseconds to wait for data to be transferred over an established, open connection before the connection is timed out.
- socketTimeout(Integer) - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
-
Milliseconds to wait for data to be transferred over an established, open connection before the connection is timed out.
- SqsClientProvider - Interface in org.apache.beam.sdk.io.aws2.sqs
-
Deprecated.Configure a custom
ClientBuilderFactoryusingAwsOptions.getClientBuilderFactory()instead. - SqsIO - Class in org.apache.beam.sdk.io.aws2.sqs
-
IO to read (unbounded) from and write to SQS queues.
- SqsIO.Read - Class in org.apache.beam.sdk.io.aws2.sqs
-
A
PTransformto read/receive messages from SQS. - SqsIO.Write - Class in org.apache.beam.sdk.io.aws2.sqs
-
A
PTransformto send messages to SQS. - SqsMessage - Class in org.apache.beam.sdk.io.aws2.sqs
- SqsMessage() - Constructor for class org.apache.beam.sdk.io.aws2.sqs.SqsMessage
- SSECustomerKey - Class in org.apache.beam.sdk.io.aws2.s3
-
Customer provided key for use with Amazon S3 server-side encryption.
- SSECustomerKey.Builder - Class in org.apache.beam.sdk.io.aws2.s3
- SSECustomerKeyFactory() - Constructor for class org.apache.beam.sdk.io.aws2.options.S3Options.SSECustomerKeyFactory
T
- throttledBaseBackoff() - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration
- throttledBaseBackoff(Duration) - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration.Builder
- TimeUtil - Class in org.apache.beam.sdk.io.aws2.kinesis
-
Time conversion utilities.
- toBuilder() - Method in class org.apache.beam.sdk.io.aws2.common.ClientConfiguration
- toBuilder() - Method in class org.apache.beam.sdk.io.aws2.common.RetryConfiguration
- toBuilder() - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
- toBuilder() - Method in class org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
-
Creates a new
S3FileSystemConfiguration.Builderwith values initialized by this instance's properties. - toJava(Instant) - Static method in class org.apache.beam.sdk.io.aws2.kinesis.TimeUtil
- toJoda(Instant) - Static method in class org.apache.beam.sdk.io.aws2.kinesis.TimeUtil
- toString() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisRecord
U
- update(KinesisRecord) - Method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicy
- update(KinesisRecord) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy
- update(KinesisRecord) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy
- update(KinesisRecord) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
V
- validate(AwsOptions, ClientConfiguration) - Static method in interface org.apache.beam.sdk.io.aws2.common.ClientBuilderFactory
-
Utility to validate if all necessary configuration is available to create clients using the
ClientBuilderFactoryconfigured inAwsOptions.
W
- WatermarkParameters - Class in org.apache.beam.sdk.io.aws2.kinesis
-
WatermarkParameterscontains the parameters used for watermark computation. - WatermarkParameters() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
- WatermarkPolicy - Interface in org.apache.beam.sdk.io.aws2.kinesis
-
Implement this interface to define a custom watermark calculation heuristic.
- WatermarkPolicyFactory - Interface in org.apache.beam.sdk.io.aws2.kinesis
-
Implement this interface to create a
WatermarkPolicy. - WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.aws2.kinesis
-
ArrivalTimeWatermarkPolicy uses
WatermarkPolicyFactory.CustomWatermarkPolicyfor watermark computation. - WatermarkPolicyFactory.CustomWatermarkPolicy - Class in org.apache.beam.sdk.io.aws2.kinesis
-
CustomWatermarkPolicy uses parameters defined in
WatermarkParametersto compute watermarks. - WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.aws2.kinesis
-
Watermark policy where the processing time is used as the event time.
- withArrivalTimePolicy() - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
-
Returns an ArrivalTimeWatermarkPolicy.
- withArrivalTimePolicy(Duration) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
-
Returns an ArrivalTimeWatermarkPolicy.
- withArrivalTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies the
WatermarkPolicyFactoryas ArrivalTimeWatermarkPolicyFactory. - withArrivalTimeWatermarkPolicy(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies the
WatermarkPolicyFactoryas ArrivalTimeWatermarkPolicyFactory. - withAWSClientsProvider(String, String, Region) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Deprecated.
- withAWSClientsProvider(String, String, Region, String) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Deprecated.
- withAWSClientsProvider(AWSClientsProvider) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Deprecated.Use
KinesisIO.Read.withClientConfiguration(ClientConfiguration)instead. Alternatively you can configure a customClientBuilderFactoryinAwsOptions. - withAWSClientsProvider(AwsCredentialsProvider, Region) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Deprecated.
- withAWSClientsProvider(AwsCredentialsProvider, Region, String) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Deprecated.
- withBatchMaxBytes(int) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Max.
- withBatchMaxRecords(int) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Max.
- withClientConfiguration(ClientConfiguration) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
-
Configuration of DynamoDB client.
- withClientConfiguration(ClientConfiguration) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
-
Configuration of DynamoDB client.
- withClientConfiguration(ClientConfiguration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Configuration of Kinesis & Cloudwatch clients.
- withClientConfiguration(ClientConfiguration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Configuration of Kinesis client.
- withClientConfiguration(ClientConfiguration) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Configuration of SNS client.
- withClientConfiguration(ClientConfiguration) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
-
Configuration of SQS client.
- withClientConfiguration(ClientConfiguration) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
-
Configuration of SQS client.
- withCoder(Coder<PublishResponse>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Deprecated.Explicit usage of coders is deprecated. Inferred schemas provided by
AwsSchemaProviderwill be used instead. - withCoder(Coder<T>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
- withCoder(Coder<T>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
-
Deprecated.Specify a Coder for SNS PublishRequest object.
- withConcurrentRequests(int) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Max number of concurrent batch write requests per bundle.
- withCustomRateLimitPolicy(RateLimitPolicyFactory) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies the
RateLimitPolicyFactoryfor a custom rate limiter. - withCustomWatermarkPolicy(WatermarkParameters) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
-
Returns an custom WatermarkPolicyFactory.
- withCustomWatermarkPolicy(WatermarkPolicyFactory) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies the
WatermarkPolicyFactoryas a custom watermarkPolicyFactory. - withDeduplicateKeys(List<String>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
- withDefaultRateLimiter() - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
- withDefaultRateLimiter(Duration, Duration, Duration) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
- withDelay(Supplier<Duration>) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
- withDynamicDelayRateLimitPolicy(Supplier<Duration>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies a dynamic delay rate limit policy with the given function being called at each polling interval to get the next delay value.
- withDynamoDbClientProvider(DynamoDbClientProvider) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
-
Deprecated.Use
DynamoDBIO.Read.withClientConfiguration(ClientConfiguration)instead. Alternatively you can configure a customClientBuilderFactoryinAwsOptions. - withDynamoDbClientProvider(DynamoDbClientProvider) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
-
Deprecated.Use
DynamoDBIO.Write.withClientConfiguration(ClientConfiguration)instead. Alternatively you can configure a customClientBuilderFactoryinAwsOptions. - withDynamoDbClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
-
Deprecated.
- withDynamoDbClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
-
Deprecated.
- withDynamoDbClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
-
Deprecated.
- withDynamoDbClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
-
Deprecated.
- withFixedDelay() - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
- withFixedDelay(Duration) - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
- withFixedDelayRateLimitPolicy() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies a fixed delay rate limit policy with the default delay of 1 second.
- withFixedDelayRateLimitPolicy(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies a fixed delay rate limit policy with the given delay.
- withFullPublishResponse() - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Deprecated.Writes fail exceptionally in case of errors, there is no need to check headers.
- withFullPublishResponseWithoutHeaders() - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Deprecated.Writes fail exceptionally in case of errors, there is no need to check headers.
- withInitialPositionInStream(InitialPositionInStream) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specify reading from some initial position in stream.
- withInitialTimestampInStream(Instant) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specify reading beginning at given
Instant. - withMaxCapacityPerShard(Integer) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies the maximum number of messages per one shard.
- withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies to read at most a given number of records.
- withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
-
Define the max number of records received by the
SqsIO.Read. - withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies to read records during
maxReadTime. - withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
-
Define the max read time (duration) while the
SqsIO.Readwill receive messages. - withoutLimiter() - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.RateLimitPolicyFactory
- withPartitioner(KinesisPartitioner<T>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Specify how to partition records among all stream shards (required).
- withProcessingTimePolicy() - Static method in interface org.apache.beam.sdk.io.aws2.kinesis.WatermarkPolicyFactory
-
Returns an ProcessingTimeWatermarkPolicy.
- withProcessingTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies the
WatermarkPolicyFactoryas ProcessingTimeWatermarkPolicyFactory. - withPublishRequestBuilder(SerializableFunction<T, PublishRequest.Builder>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Function to convert a message into a
PublishRequest.Builder(mandatory). - withPublishRequestFn(SerializableFunction<T, PublishRequest>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Deprecated.
- withPublishRequestFn(SerializableFunction<T, PublishRequest>) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
-
Deprecated.Specify a function for converting a message into PublishRequest object.
- withQueueUrl(String) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
-
Define the queueUrl used by the
SqsIO.Readto receive messages from SQS. - withRecordAggregation(Consumer<KinesisIO.RecordAggregation.Builder>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Enable record aggregation that is compatible with the KPL / KCL.
- withRecordAggregation(KinesisIO.RecordAggregation) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Enable record aggregation that is compatible with the KPL / KCL.
- withRecordAggregationDisabled() - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Disable KPL / KCL like record aggregation.
- withRequestRecordsLimit(int) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies the maximum number of records in GetRecordsResult returned by GetRecords call which is limited by 10K records.
- withRetryConfiguration(DynamoDBIO.RetryConfiguration) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
-
Deprecated.Use
DynamoDBIO.Write.withClientConfiguration(ClientConfiguration)withRetryConfigurationinstead to delegate retries to the AWS SDK. - withRetryConfiguration(SnsIO.RetryConfiguration) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Deprecated.Use
SnsIO.Write.withClientConfiguration(ClientConfiguration)withRetryConfigurationinstead to delegate retries to the AWS SDK. - withScanRequestFn(SerializableFunction<Void, ScanRequest>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
-
Can't pass ScanRequest object directly from client since this object is not full serializable.
- withScanResponseMapperFn(SerializableFunction<ScanResponse, T>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Read
- withSerializer(SerializableFunction<T, byte[]>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Specify how to serialize records to bytes on the stream (required).
- withSnsClientProvider(SnsAsyncClientProvider) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
-
Deprecated.Allows to specify custom
SnsAsyncClientProvider. - withSnsClientProvider(SnsClientProvider) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Deprecated.Use
SnsIO.Write.withClientConfiguration(ClientConfiguration)instead. Alternatively you can configure a customClientBuilderFactoryinAwsOptions. - withSnsClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Deprecated.
- withSnsClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
-
Deprecated.Specify credential details and region to be used to write to SNS.
- withSnsClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
Deprecated.
- withSnsClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
-
Deprecated.Specify credential details and region to be used to write to SNS.
- withSqsClientProvider(SqsClientProvider) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
-
Deprecated.Use
SqsIO.Read.withClientConfiguration(ClientConfiguration)instead. Alternatively you can configure a customClientBuilderFactoryinAwsOptions. - withSqsClientProvider(SqsClientProvider) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
-
Deprecated.Use
SqsIO.Write.withClientConfiguration(ClientConfiguration)instead. Alternatively you can configure a customClientBuilderFactoryinAwsOptions. - withSqsClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
-
Deprecated.
- withSqsClientProvider(AwsCredentialsProvider, String) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
-
Deprecated.
- withSqsClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Read
-
Deprecated.
- withSqsClientProvider(AwsCredentialsProvider, String, URI) - Method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
-
Deprecated.
- withStreamName(String) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specify reading from streamName.
- withStreamName(String) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
-
Kinesis stream name which will be used for writing (required).
- withTimestampFn(SerializableFunction<KinesisRecord, Instant>) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
-
Specify the
SerializableFunctionto extract the event time from aKinesisRecord. - withTopicArn(String) - Method in class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
-
SNS topic ARN used for publishing to SNS.
- withUpToDateThreshold(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Read
-
Specifies how late records consumed by this source can be to still be considered on time.
- withWatermarkIdleDurationThreshold(Duration) - Method in class org.apache.beam.sdk.io.aws2.kinesis.WatermarkParameters
-
Specify the watermark idle duration to consider before advancing the watermark.
- withWriteRequestMapperFn(SerializableFunction<T, KV<String, WriteRequest>>) - Method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
- write() - Static method in class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO
- write() - Static method in class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO
-
Returns a new
KinesisIO.Writetransform for writing to Kinesis. - write() - Static method in class org.apache.beam.sdk.io.aws2.sns.SnsIO
- write() - Static method in class org.apache.beam.sdk.io.aws2.sqs.SqsIO
- Write() - Constructor for class org.apache.beam.sdk.io.aws2.dynamodb.DynamoDBIO.Write
- Write() - Constructor for class org.apache.beam.sdk.io.aws2.kinesis.KinesisIO.Write
- Write() - Constructor for class org.apache.beam.sdk.io.aws2.sns.SnsIO.Write
- Write() - Constructor for class org.apache.beam.sdk.io.aws2.sqs.SqsIO.Write
- writeAsync() - Static method in class org.apache.beam.sdk.io.aws2.sns.SnsIO
-
Deprecated.Please use
SnsIO.write()to avoid the risk of data loss. - WriteAsync() - Constructor for class org.apache.beam.sdk.io.aws2.sns.SnsIO.WriteAsync
-
Deprecated.
- writeTimeout() - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration
-
Milliseconds to wait for a write on a socket before an exception is thrown.
- writeTimeout(Integer) - Method in class org.apache.beam.sdk.io.aws2.common.HttpClientConfiguration.Builder
-
Milliseconds to wait for a write on a socket before an exception is thrown.
All Classes All Packages