A B C D F G H I L M N O P Q R S T U V W

A

addPartitionsToTable(String, List<String>) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

ALL_PARTITIONS_READ_PARALLELISM - Static variable in class org.apache.hudi.config.GlueCatalogSyncClientConfig

AWS_ACCESS_KEY - Static variable in class org.apache.hudi.config.HoodieAWSConfig

AWS_ASSUME_ROLE_ARN - Static variable in class org.apache.hudi.config.HoodieAWSConfig

AWS_ASSUME_ROLE_EXTERNAL_ID - Static variable in class org.apache.hudi.config.HoodieAWSConfig

AWS_ASSUME_ROLE_SESSION_NAME - Static variable in class org.apache.hudi.config.HoodieAWSConfig

AWS_GLUE_ENDPOINT - Static variable in class org.apache.hudi.config.HoodieAWSConfig

AWS_GLUE_REGION - Static variable in class org.apache.hudi.config.HoodieAWSConfig

AWS_SECRET_KEY - Static variable in class org.apache.hudi.config.HoodieAWSConfig

AWS_SESSION_TOKEN - Static variable in class org.apache.hudi.config.HoodieAWSConfig

awsGlue - Variable in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

AWSGlueCatalogSyncClient - Class in org.apache.hudi.aws.sync

This class implements all the AWS APIs to enable syncing of a Hudi Table with the AWS Glue Data Catalog (https://docs.aws.amazon.com/glue/latest/dg/populate-data-catalog.html).

AWSGlueCatalogSyncClient(HiveSyncConfig) - Constructor for class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

AwsGlueCatalogSyncTool - Class in org.apache.hudi.aws.sync

Currently Experimental.

AwsGlueCatalogSyncTool(Properties, Configuration) - Constructor for class org.apache.hudi.aws.sync.AwsGlueCatalogSyncTool

B

build(Properties) - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter.Builder

build() - Method in class org.apache.hudi.config.DynamoDbBasedLockConfig.Builder

build() - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

Builder() - Constructor for class org.apache.hudi.config.DynamoDbBasedLockConfig.Builder

Builder() - Constructor for class org.apache.hudi.config.HoodieAWSConfig.Builder

C

CHANGED_PARTITIONS_READ_PARALLELISM - Static variable in class org.apache.hudi.config.GlueCatalogSyncClientConfig

close() - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

close() - Method in class org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider

CloudWatchReporter - Class in org.apache.hudi.aws.cloudwatch

A reporter for publishing metrics to Amazon CloudWatch.

CloudWatchReporter(MetricRegistry, CloudWatchAsyncClient, Clock, String, String, int, MetricFilter, TimeUnit, TimeUnit) - Constructor for class org.apache.hudi.aws.cloudwatch.CloudWatchReporter

CloudWatchReporter.Builder - Class in org.apache.hudi.aws.cloudwatch

convertDurationsTo(TimeUnit) - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter.Builder

convertRatesTo(TimeUnit) - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter.Builder

createDatabase(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

createOrReplaceTable(String, MessageType, String, String, String, Map<String, String>, Map<String, String>) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

createTable(String, MessageType, String, String, String, Map<String, String>, Map<String, String>) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

createTableIfNotExists(DynamoDbClient, CreateTableRequest) - Static method in class org.apache.hudi.aws.utils.DynamoTableUtils

Creates the table and ignores any errors if it already exists.

D

databaseExists(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

deleteLastReplicatedTimeStamp(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

deleteTableIfExists(DynamoDbClient, DeleteTableRequest) - Static method in class org.apache.hudi.aws.utils.DynamoTableUtils

Deletes the table and ignores any errors if it doesn't exist.

dropPartitions(String, List<String>) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

dropTable(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

DYNAMODB_BASED_LOCK_PROPERTY_PREFIX - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

DYNAMODB_ENDPOINT_URL - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

DYNAMODB_LOCK_BILLING_MODE - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

DYNAMODB_LOCK_PARTITION_KEY - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

DYNAMODB_LOCK_READ_CAPACITY - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

DYNAMODB_LOCK_REGION - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

DYNAMODB_LOCK_TABLE_CREATION_TIMEOUT - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

DYNAMODB_LOCK_TABLE_NAME - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

DYNAMODB_LOCK_WRITE_CAPACITY - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

DynamoDbBasedLockConfig - Class in org.apache.hudi.config

Hoodie Configs for Locks.

DynamoDbBasedLockConfig() - Constructor for class org.apache.hudi.config.DynamoDbBasedLockConfig

DynamoDbBasedLockConfig.Builder - Class in org.apache.hudi.config

Builder for DynamoDbBasedLockConfig.

DynamoDBBasedLockProvider - Class in org.apache.hudi.aws.transaction.lock

A DynamoDB based lock.

DynamoDBBasedLockProvider(LockConfiguration, StorageConfiguration<?>) - Constructor for class org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider

DynamoDBBasedLockProvider(LockConfiguration, StorageConfiguration<?>, DynamoDbClient) - Constructor for class org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider

dynamoDBLockConfiguration - Variable in class org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider

DynamoTableUtils - Class in org.apache.hudi.aws.utils

Reused code from https://github.com/aws/aws-sdk-java-v2/blob/master/services/dynamodb/src/test/java/utils/test/util/TableUtils.java Utility methods for working with DynamoDB tables.

DynamoTableUtils() - Constructor for class org.apache.hudi.aws.utils.DynamoTableUtils

DynamoTableUtils.TableNeverTransitionedToStateException - Exception in org.apache.hudi.aws.utils

Thrown by DynamoTableUtils when a table never reaches a desired state

F

filter(MetricFilter) - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter.Builder

forRegistry(MetricRegistry) - Static method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter

fromFile(File) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

fromProperties(TypedProperties) - Method in class org.apache.hudi.config.DynamoDbBasedLockConfig.Builder

fromProperties(Properties) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

G

generateFilterString(Expression) - Method in class org.apache.hudi.aws.sync.util.GluePartitionFilterGenerator

generateLogStatement(LockState, String) - Method in class org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider

generatePushDownFilter(List<String>, List<FieldSchema>) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

getAllPartitions(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

getAWSAccessKey() - Method in class org.apache.hudi.config.HoodieAWSConfig

getAWSAssumeRoleARN() - Method in class org.apache.hudi.config.HoodieAWSConfig

getAWSAssumeRoleExternalID() - Method in class org.apache.hudi.config.HoodieAWSConfig

getAWSAssumeRoleSessionName() - Method in class org.apache.hudi.config.HoodieAWSConfig

getAwsCredentialsProvider(Properties) - Static method in class org.apache.hudi.aws.credentials.HoodieAWSCredentialsProviderFactory

getAWSSecretKey() - Method in class org.apache.hudi.config.HoodieAWSConfig

getAWSSessionToken() - Method in class org.apache.hudi.config.HoodieAWSConfig

getLastCommitTimeSynced(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

getLastReplicatedTime(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

getLock() - Method in class org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider

getMetastoreFieldSchemas(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

getMetastoreSchema(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

getPartitionIndexEnable(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

getPartitionsFromList(String, List<String>) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

getStorageFieldSchemas() - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

getTableLocation(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

GLUE_CLIENT_PROPERTY_PREFIX - Static variable in class org.apache.hudi.config.GlueCatalogSyncClientConfig

GLUE_METADATA_FILE_LISTING - Static variable in class org.apache.hudi.config.GlueCatalogSyncClientConfig

GLUE_SKIP_TABLE_ARCHIVE - Static variable in class org.apache.hudi.config.GlueCatalogSyncClientConfig

GlueCatalogSyncClientConfig - Class in org.apache.hudi.config

Hoodie Configs for Glue.

GlueCatalogSyncClientConfig() - Constructor for class org.apache.hudi.config.GlueCatalogSyncClientConfig

GlueFilterGenVisitor - Class in org.apache.hudi.aws.sync.util

GlueFilterGenVisitor() - Constructor for class org.apache.hudi.aws.sync.util.GlueFilterGenVisitor

GluePartitionFilterGenerator - Class in org.apache.hudi.aws.sync.util

GluePartitionFilterGenerator() - Constructor for class org.apache.hudi.aws.sync.util.GluePartitionFilterGenerator

H

HoodieAWSConfig - Class in org.apache.hudi.config

Configurations used by the AWS credentials and AWS DynamoDB based lock.

HoodieAWSConfig.Builder - Class in org.apache.hudi.config

HoodieAWSCredentialsProviderFactory - Class in org.apache.hudi.aws.credentials

Factory class for Hoodie AWSCredentialsProvider.

HoodieAWSCredentialsProviderFactory() - Constructor for class org.apache.hudi.aws.credentials.HoodieAWSCredentialsProviderFactory

HoodieConfigAWSAssumedRoleCredentialsProvider - Class in org.apache.hudi.aws.credentials

Credentials provider which assumes AWS role from Hoodie config and fetches its credentials.

HoodieConfigAWSAssumedRoleCredentialsProvider(Properties) - Constructor for class org.apache.hudi.aws.credentials.HoodieConfigAWSAssumedRoleCredentialsProvider

HoodieConfigAWSCredentialsProvider - Class in org.apache.hudi.aws.credentials

Credentials provider which fetches AWS access key from Hoodie config.

HoodieConfigAWSCredentialsProvider(Properties) - Constructor for class org.apache.hudi.aws.credentials.HoodieConfigAWSCredentialsProvider

HoodieGlueSyncException - Exception in org.apache.hudi.aws.sync

HoodieGlueSyncException(String) - Constructor for exception org.apache.hudi.aws.sync.HoodieGlueSyncException

HoodieGlueSyncException(String, Throwable) - Constructor for exception org.apache.hudi.aws.sync.HoodieGlueSyncException

I

initSyncClient(HiveSyncConfig) - Method in class org.apache.hudi.aws.sync.AwsGlueCatalogSyncTool

L

LOCK_ACQUIRE_WAIT_TIMEOUT_MS_PROP_KEY - Static variable in class org.apache.hudi.config.DynamoDbBasedLockConfig

M

main(String[]) - Static method in class org.apache.hudi.aws.sync.AwsGlueCatalogSyncTool

managePartitionIndexes(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

This will manage partitions indexes.

maxDatumsPerRequest(int) - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter.Builder

META_SYNC_PARTITION_INDEX_FIELDS - Static variable in class org.apache.hudi.config.GlueCatalogSyncClientConfig

META_SYNC_PARTITION_INDEX_FIELDS_ENABLE - Static variable in class org.apache.hudi.config.GlueCatalogSyncClientConfig

N

namespace(String) - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter.Builder

newBuilder() - Static method in class org.apache.hudi.config.DynamoDbBasedLockConfig

newBuilder() - Static method in class org.apache.hudi.config.HoodieAWSConfig

O

org.apache.hudi.aws.cloudwatch - package org.apache.hudi.aws.cloudwatch

org.apache.hudi.aws.credentials - package org.apache.hudi.aws.credentials

org.apache.hudi.aws.sync - package org.apache.hudi.aws.sync

org.apache.hudi.aws.sync.util - package org.apache.hudi.aws.sync.util

org.apache.hudi.aws.transaction.lock - package org.apache.hudi.aws.transaction.lock

org.apache.hudi.aws.utils - package org.apache.hudi.aws.utils

org.apache.hudi.config - package org.apache.hudi.config

P

parsePartitionsIndexConfig() - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

PARTITION_CHANGE_PARALLELISM - Static variable in class org.apache.hudi.config.GlueCatalogSyncClientConfig

prefixedWith(String) - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter.Builder

Q

quoteStringLiteral(String) - Method in class org.apache.hudi.aws.sync.util.GlueFilterGenVisitor

R

RECREATE_GLUE_TABLE_ON_ERROR - Static variable in class org.apache.hudi.config.GlueCatalogSyncClientConfig

report(SortedMap<String, Gauge>, SortedMap<String, Counter>, SortedMap<String, Histogram>, SortedMap<String, Meter>, SortedMap<String, Timer>) - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter

resolveCredentials() - Method in class org.apache.hudi.aws.credentials.HoodieConfigAWSAssumedRoleCredentialsProvider

resolveCredentials() - Method in class org.apache.hudi.aws.credentials.HoodieConfigAWSCredentialsProvider

S

s3aToS3(String) - Static method in class org.apache.hudi.aws.utils.S3Utils

S3Utils - Class in org.apache.hudi.aws.utils

S3Utils() - Constructor for class org.apache.hudi.aws.utils.S3Utils

shouldRecreateAndSyncTable() - Method in class org.apache.hudi.aws.sync.AwsGlueCatalogSyncTool

stop() - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter

T

tableExists(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

TableNeverTransitionedToStateException(String, TableStatus) - Constructor for exception org.apache.hudi.aws.utils.DynamoTableUtils.TableNeverTransitionedToStateException

tryLock(long, TimeUnit) - Method in class org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider

U

unlock() - Method in class org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider

updateLastCommitTimeSynced(String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

updateLastReplicatedTimeStamp(String, String) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

updatePartitionIndexEnable(String, Boolean) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

updatePartitionsToTable(String, List<String>) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

updateSerdeProperties(String, Map<String, String>, boolean) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

updateTableComments(String, List<FieldSchema>, List<FieldSchema>) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

updateTableProperties(String, Map<String, String>) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

updateTableSchema(String, MessageType) - Method in class org.apache.hudi.aws.sync.AWSGlueCatalogSyncClient

V

validConf(Properties) - Static method in class org.apache.hudi.aws.credentials.HoodieConfigAWSAssumedRoleCredentialsProvider

W

waitUntilActive(DynamoDbClient, String) - Static method in class org.apache.hudi.aws.utils.DynamoTableUtils

Waits up to 10 minutes for a specified DynamoDB table to move into the ACTIVE state.

waitUntilActive(DynamoDbClient, String, int, int) - Static method in class org.apache.hudi.aws.utils.DynamoTableUtils

Waits up to a specified amount of time for a specified DynamoDB table to move into the ACTIVE state.

waitUntilExists(DynamoDbClient, String) - Static method in class org.apache.hudi.aws.utils.DynamoTableUtils

Waits up to 10 minutes for a specified DynamoDB table to resolve, indicating that it exists.

waitUntilExists(DynamoDbClient, String, int, int) - Static method in class org.apache.hudi.aws.utils.DynamoTableUtils

Waits up to a specified amount of time for a specified DynamoDB table to resolve, indicating that it exists.

withAccessKey(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withAssumeRoleARN(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withAssumeRoleExternalID(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withAssumeRoleSessionName(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withClock(Clock) - Method in class org.apache.hudi.aws.cloudwatch.CloudWatchReporter.Builder

withDynamoDBBillingMode(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withDynamoDBPartitionKey(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withDynamoDBReadCapacity(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withDynamoDBRegion(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withDynamoDBTable(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withDynamoDBWriteCapacity(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withGlueSkipTableArchive(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withSecretKey(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

withSessionToken(String) - Method in class org.apache.hudi.config.HoodieAWSConfig.Builder

A B C D F G H I L M N O P Q R S T U V W