Skip navigation links
A B C D E F G H I J K L M N O P Q R S T U V W 

A

abortInstant(String) - Method in class org.apache.hudi.sink.meta.CkpMetadata
Add an aborted checkpoint message.
AbstractStreamWriteFunction<I> - Class in org.apache.hudi.sink.common
Base infrastructures for streaming writer function.
AbstractStreamWriteFunction(Configuration) - Constructor for class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Constructs a StreamWriteFunctionBase.
AbstractWriteFunction<I> - Class in org.apache.hudi.sink.common
Base class for write function.
AbstractWriteFunction() - Constructor for class org.apache.hudi.sink.common.AbstractWriteFunction
 
AbstractWriteOperator<I> - Class in org.apache.hudi.sink.common
Base class for write operator.
AbstractWriteOperator(AbstractWriteFunction<I>) - Constructor for class org.apache.hudi.sink.common.AbstractWriteOperator
 
acceptFile(FileStatus) - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
A simple hook to filter files and directories from the input.
action(String) - Method in class org.apache.hudi.sink.utils.TimeWait.Builder
 
actionType - Variable in class org.apache.hudi.metrics.FlinkWriteMetrics
 
add(Integer, BootstrapAccumulator) - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAggFunction
 
addInsert(String) - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
 
addMetadataFields(RowType, boolean) - Static method in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
Adds the Hoodie metadata fields to the given row type.
addUpdate(String, String) - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
 
ALL - Static variable in interface org.apache.hudi.sink.compact.strategy.CompactionPlanStrategy
 
allOptions() - Static method in class org.apache.hudi.configuration.FlinkOptions
Returns all the config options.
allOptions(Class<?>) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns all the config options with the given class clazz.
allOptions() - Static method in class org.apache.hudi.table.catalog.CatalogOptions
Returns all the config options.
allowCommitOnEmptyBatch(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether to commit even when current batch has no data, for flink defaults false
alterDatabase(String, CatalogDatabase, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
alterDatabase(String, CatalogDatabase, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
alterFunction(ObjectPath, CatalogFunction, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
alterFunction(ObjectPath, CatalogFunction, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
alterPartition(ObjectPath, CatalogPartitionSpec, CatalogPartition, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
alterPartition(ObjectPath, CatalogPartitionSpec, CatalogPartition, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
alterPartitionColumnStatistics(ObjectPath, CatalogPartitionSpec, CatalogColumnStatistics, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
alterPartitionColumnStatistics(ObjectPath, CatalogPartitionSpec, CatalogColumnStatistics, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
alterPartitionStatistics(ObjectPath, CatalogPartitionSpec, CatalogTableStatistics, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
alterPartitionStatistics(ObjectPath, CatalogPartitionSpec, CatalogTableStatistics, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
alterTable(ObjectPath, CatalogBaseTable, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
alterTable(ObjectPath, CatalogBaseTable, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
alterTableColumnStatistics(ObjectPath, CatalogColumnStatistics, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
alterTableColumnStatistics(ObjectPath, CatalogColumnStatistics, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
alterTableStatistics(ObjectPath, CatalogTableStatistics, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
alterTableStatistics(ObjectPath, CatalogTableStatistics, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
AlwaysFalse() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.AlwaysFalse
 
AlwaysNull() - Constructor for class org.apache.hudi.source.ExpressionPredicates.AlwaysNull
 
And() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.And
 
And() - Constructor for class org.apache.hudi.source.ExpressionPredicates.And
 
append(Configuration, RowType, DataStream<RowData>) - Static method in class org.apache.hudi.sink.utils.Pipelines
Insert the dataset with append mode(no upsert or deduplication).
appendKafkaProps(FlinkStreamerConfig) - Static method in class org.apache.hudi.util.StreamerUtil
 
AppendWriteFunction<I> - Class in org.apache.hudi.sink.append
Sink function to write the data to the underneath filesystem.
AppendWriteFunction(Configuration, RowType) - Constructor for class org.apache.hudi.sink.append.AppendWriteFunction
Constructs an AppendWriteFunction.
AppendWriteOperator<I> - Class in org.apache.hudi.sink.append
Operator for AppendWriteFunction.
AppendWriteOperator(Configuration, RowType) - Constructor for class org.apache.hudi.sink.append.AppendWriteOperator
 
apply(DataStream<RowData>) - Method in class org.apache.hudi.sink.transform.ChainedTransformer
 
apply(DataStream<RowData>) - Method in interface org.apache.hudi.sink.transform.Transformer
Transform source DataStream to target DataStream.
apply(String, Throwable) - Method in interface org.apache.hudi.sink.utils.NonThrownExecutor.ExceptionHook
 
applyFilters(List<ResolvedExpression>) - Method in class org.apache.hudi.table.HoodieTableSource
 
applyLimit(long) - Method in class org.apache.hudi.table.HoodieTableSource
 
applyOverwrite(boolean) - Method in class org.apache.hudi.table.HoodieTableSink
 
applyProjection(int[][]) - Method in class org.apache.hudi.table.HoodieTableSource
 
applyRowLevelDelete() - Method in class org.apache.hudi.table.HoodieTableSink
 
applyRowLevelUpdate(List<Column>) - Method in class org.apache.hudi.table.HoodieTableSink
 
applyStaticPartition(Map<String, String>) - Method in class org.apache.hudi.table.HoodieTableSink
 
ARCHIVE_MAX_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
ARCHIVE_MIN_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
archiveMaxCommits - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
archiveMaxCommits - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
archiveMaxCommits - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
archiveMinCommits - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
archiveMinCommits - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
archiveMinCommits - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
asSummaryString() - Method in class org.apache.hudi.table.HoodieTableSink
 
asSummaryString() - Method in class org.apache.hudi.table.HoodieTableSource
 
AsyncClusteringService(FlinkClusteringConfig, Configuration) - Constructor for class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob.AsyncClusteringService
 
AsyncCompactionService(FlinkCompactionConfig, Configuration) - Constructor for class org.apache.hudi.sink.compact.HoodieFlinkCompactor.AsyncCompactionService
 
AutoRowDataKeyGen - Class in org.apache.hudi.sink.bulk
Key generator for RowData that use an auto key generator.
AutoRowDataKeyGen(int, String, String, RowType, boolean, boolean) - Constructor for class org.apache.hudi.sink.bulk.AutoRowDataKeyGen
 
AvroSchemaConverter - Class in org.apache.hudi.util
Converts an Avro schema into Flink's type information.
AvroSchemaConverter() - Constructor for class org.apache.hudi.util.AvroSchemaConverter
 
AvroToRowDataConverters - Class in org.apache.hudi.util
Tool class used to convert from Avro GenericRecord to RowData.
AvroToRowDataConverters() - Constructor for class org.apache.hudi.util.AvroToRowDataConverters
 
AvroToRowDataConverters.AvroToRowDataConverter - Interface in org.apache.hudi.util
Runtime converter that converts Avro data structures into objects of Flink Table & SQL internal data structures.

B

basePath(String) - Method in class org.apache.hudi.util.ClientIds.Builder
 
BatchBootstrapOperator<I,O extends HoodieRecord<?>> - Class in org.apache.hudi.sink.bootstrap.batch
The operator to load index from existing hoodieTable.
BatchBootstrapOperator(Configuration) - Constructor for class org.apache.hudi.sink.bootstrap.batch.BatchBootstrapOperator
 
bindEvaluator(ExpressionEvaluators.Evaluator...) - Method in class org.apache.hudi.source.ExpressionEvaluators.And
 
bindEvaluator(ExpressionEvaluators.Evaluator) - Method in class org.apache.hudi.source.ExpressionEvaluators.Not
 
bindEvaluator(ExpressionEvaluators.Evaluator...) - Method in class org.apache.hudi.source.ExpressionEvaluators.Or
 
bindFieldReference(FieldReferenceExpression) - Method in class org.apache.hudi.source.ExpressionEvaluators.LeafEvaluator
 
bindFieldReference(FieldReferenceExpression) - Method in class org.apache.hudi.source.ExpressionPredicates.ColumnPredicate
Binds field reference to create a column predicate.
bindPredicate(ExpressionPredicates.Predicate) - Method in class org.apache.hudi.source.ExpressionPredicates.Not
Binds predicate to create a NOT predicate.
bindPredicates(ExpressionPredicates.Predicate...) - Method in class org.apache.hudi.source.ExpressionPredicates.And
Binds predicates to create an AND predicate.
bindPredicates(ExpressionPredicates.Predicate...) - Method in class org.apache.hudi.source.ExpressionPredicates.Or
Binds predicates to create an OR predicate.
bindVal(ValueLiteralExpression) - Method in class org.apache.hudi.source.ExpressionEvaluators.NullFalseEvaluator
 
bindVals(Object...) - Method in class org.apache.hudi.source.ExpressionEvaluators.In
 
bindValueLiteral(ValueLiteralExpression) - Method in class org.apache.hudi.source.ExpressionPredicates.ColumnPredicate
Binds value literal to create a column predicate.
bindValueLiterals(List<ValueLiteralExpression>) - Method in class org.apache.hudi.source.ExpressionPredicates.In
Binds value literals to create an IN predicate.
bootstrap(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
 
bootstrap() - Method in class org.apache.hudi.sink.meta.CkpMetadata
Initialize the message bus, would clean all the messages
bootstrap(Configuration, RowType, DataStream<RowData>) - Static method in class org.apache.hudi.sink.utils.Pipelines
Constructs bootstrap pipeline as streaming.
bootstrap(Configuration, RowType, DataStream<RowData>, boolean, boolean) - Static method in class org.apache.hudi.sink.utils.Pipelines
Constructs bootstrap pipeline.
BOOTSTRAP_INSTANT - Static variable in class org.apache.hudi.sink.event.WriteMetadataEvent
 
BootstrapAccumulator - Class in org.apache.hudi.sink.bootstrap.aggregate
Bootstrap ready task id accumulator.
BootstrapAccumulator() - Constructor for class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAccumulator
 
BootstrapAggFunction - Class in org.apache.hudi.sink.bootstrap.aggregate
Aggregate function that accumulates the loaded task number of function BootstrapOperator.
BootstrapAggFunction() - Constructor for class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAggFunction
 
BootstrapOperator<I,O extends HoodieRecord<?>> - Class in org.apache.hudi.sink.bootstrap
The operator to load index from existing hoodieTable.
BootstrapOperator(Configuration) - Constructor for class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
BoundedMemoryRecords(MergeOnReadInputSplit, Schema, InternalSchema, Configuration, Configuration) - Constructor for class org.apache.hudi.table.format.FormatUtils.BoundedMemoryRecords
 
BUCKET_ASSIGN_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
BUCKET_ID_NO_PRUNING - Static variable in class org.apache.hudi.source.prune.PrimaryKeyPruners
 
BUCKET_INDEX_ENGINE_TYPE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
BUCKET_INDEX_NUM_BUCKETS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
BucketAssigner - Class in org.apache.hudi.sink.partitioner
Bucket assigner that assigns the data buffer of one checkpoint into buckets.
BucketAssigner(int, int, int, WriteProfile, HoodieWriteConfig) - Constructor for class org.apache.hudi.sink.partitioner.BucketAssigner
 
BucketAssigners - Class in org.apache.hudi.sink.partitioner
Utilities for BucketAssigner.
BucketAssignFunction<K,I,O extends HoodieRecord<?>> - Class in org.apache.hudi.sink.partitioner
The function to build the write profile incrementally for records within a checkpoint, it then assigns the bucket with ID using the BucketAssigner.
BucketAssignFunction(Configuration) - Constructor for class org.apache.hudi.sink.partitioner.BucketAssignFunction
 
bucketAssignNum - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
BucketBulkInsertWriterHelper - Class in org.apache.hudi.sink.bucket
Helper class for bucket index bulk insert used by Flink.
BucketBulkInsertWriterHelper(Configuration, HoodieTable<?, ?, ?, ?>, HoodieWriteConfig, String, int, long, long, RowType) - Constructor for class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
 
BucketIndexPartitioner<T extends HoodieKey> - Class in org.apache.hudi.sink.partitioner
Bucket index input partitioner.
BucketIndexPartitioner(int, String) - Constructor for class org.apache.hudi.sink.partitioner.BucketIndexPartitioner
 
BucketStreamWriteFunction<I> - Class in org.apache.hudi.sink.bucket
A stream write function with simple bucket hash index.
BucketStreamWriteFunction(Configuration) - Constructor for class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
Constructs a BucketStreamWriteFunction.
BucketStreamWriteOperator<I> - Class in org.apache.hudi.sink.bucket
BucketStreamWriteOperator(Configuration) - Constructor for class org.apache.hudi.sink.bucket.BucketStreamWriteOperator
 
bufferRecord(HoodieRecord<?>) - Method in class org.apache.hudi.sink.StreamWriteFunction
Buffers the given record.
build() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
 
build() - Method in class org.apache.hudi.sink.utils.NonThrownExecutor.Builder
 
build() - Method in class org.apache.hudi.sink.utils.TimeWait.Builder
 
build() - Method in class org.apache.hudi.source.FileIndex.Builder
 
build() - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
 
build() - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.Builder
 
build() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
build() - Method in class org.apache.hudi.util.ClientIds.Builder
 
buildAvroRecordBySchema(IndexedRecord, Schema, int[], GenericRecordBuilder) - Static method in class org.apache.hudi.table.format.FormatUtils
 
builder() - Static method in class org.apache.hudi.sink.event.WriteMetadataEvent
Returns the builder for WriteMetadataEvent.
Builder() - Constructor for class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
 
builder(Logger) - Static method in class org.apache.hudi.sink.utils.NonThrownExecutor
 
builder() - Static method in class org.apache.hudi.sink.utils.TimeWait
 
builder() - Static method in class org.apache.hudi.source.FileIndex
Returns the builder.
builder() - Static method in class org.apache.hudi.source.IncrementalInputSplits
Returns the builder.
Builder() - Constructor for class org.apache.hudi.source.IncrementalInputSplits.Builder
 
builder() - Static method in class org.apache.hudi.table.format.cdc.CdcInputFormat
Returns the builder for MergeOnReadInputFormat.
Builder() - Constructor for class org.apache.hudi.table.format.cdc.CdcInputFormat.Builder
 
builder() - Static method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
Returns the builder for MergeOnReadInputFormat.
Builder() - Constructor for class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
builder() - Static method in class org.apache.hudi.util.ClientIds
Returns the builder.
Builder() - Constructor for class org.apache.hudi.util.ClientIds.Builder
 
builder(String) - Static method in class org.apache.hudi.util.HoodiePipeline
Returns the builder for hoodie pipeline construction.
buildProperties(List<String>) - Static method in class org.apache.hudi.util.StreamerUtil
 
buildSyncConfig(Configuration) - Static method in class org.apache.hudi.sink.utils.HiveSyncContext
 
bulkInsert(Configuration, RowType, DataStream<RowData>) - Static method in class org.apache.hudi.sink.utils.Pipelines
Bulk insert the input dataset at once.
BulkInsertWriteFunction<I> - Class in org.apache.hudi.sink.bulk
Sink function to write the data to the underneath filesystem.
BulkInsertWriteFunction(Configuration, RowType) - Constructor for class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
Constructs a StreamingSinkFunction.
BulkInsertWriteOperator<I> - Class in org.apache.hudi.sink.bulk
Operator for bulk insert mode sink.
BulkInsertWriteOperator(Configuration, RowType) - Constructor for class org.apache.hudi.sink.bulk.BulkInsertWriteOperator
 
BulkInsertWriterHelper - Class in org.apache.hudi.sink.bulk
Helper class for bulk insert used by Flink.
BulkInsertWriterHelper(Configuration, HoodieTable, HoodieWriteConfig, String, int, long, long, RowType) - Constructor for class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
BulkInsertWriterHelper(Configuration, HoodieTable, HoodieWriteConfig, String, int, long, long, RowType, boolean) - Constructor for class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
BytesArrayInputView(byte[]) - Constructor for class org.apache.hudi.table.format.cdc.CdcInputFormat.BytesArrayInputView
 
BytesArrayOutputView(ByteArrayOutputStream) - Constructor for class org.apache.hudi.table.format.cdc.CdcInputFormat.BytesArrayOutputView
 

C

cancel() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
 
cancel() - Method in class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
 
cancel() - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
 
castIfNeeded(int, Object) - Method in class org.apache.hudi.table.format.CastMap
 
CastMap - Class in org.apache.hudi.table.format
CastMap is responsible for conversion of flink types when full schema evolution enabled.
CastMap() - Constructor for class org.apache.hudi.table.format.CastMap
 
CATALOG_PATH - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
 
CatalogOptions - Class in org.apache.hudi.table.catalog
Hoodie catalog options.
CatalogOptions() - Constructor for class org.apache.hudi.table.catalog.CatalogOptions
 
CDC_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CdcInputFormat - Class in org.apache.hudi.table.format.cdc
The base InputFormat class to read Hoodie data set as change logs.
CdcInputFormat.Builder - Class in org.apache.hudi.table.format.cdc
Builder for CdcInputFormat.
CdcInputFormat.BytesArrayInputView - Class in org.apache.hudi.table.format.cdc
 
CdcInputFormat.BytesArrayOutputView - Class in org.apache.hudi.table.format.cdc
 
CdcInputSplit - Class in org.apache.hudi.table.format.cdc
Represents an input split of source, actually a data bucket.
CdcInputSplit(int, String, long, String, HoodieCDCFileSplit[]) - Constructor for class org.apache.hudi.table.format.cdc.CdcInputSplit
 
ChainedTransformer - Class in org.apache.hudi.sink.transform
A Transformer to chain other Transformers and apply sequentially.
ChainedTransformer(List<Transformer>) - Constructor for class org.apache.hudi.sink.transform.ChainedTransformer
 
CHANGELOG_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
ChangelogModes - Class in org.apache.hudi.util
Utilities for all kinds of common ChangelogModes.
checkpointCoordinator(long, CompletableFuture<byte[]>) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
checkpointInterval - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
Flink checkpoint interval.
CkpMessage - Class in org.apache.hudi.sink.meta
A checkpoint message.
CkpMessage(String, String) - Constructor for class org.apache.hudi.sink.meta.CkpMessage
 
CkpMessage(FileStatus) - Constructor for class org.apache.hudi.sink.meta.CkpMessage
 
CkpMessage.State - Enum in org.apache.hudi.sink.meta
Instant State.
CkpMetadata - Class in org.apache.hudi.sink.meta
The checkpoint metadata for bookkeeping the checkpoint messages.
ckpMetaPath(String, String) - Static method in class org.apache.hudi.sink.meta.CkpMetadata
 
clean(String) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
 
clean(Configuration, DataStream<Object>) - Static method in class org.apache.hudi.sink.utils.Pipelines
 
CLEAN_ASYNC_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLEAN_POLICY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLEAN_RETAIN_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLEAN_RETAIN_FILE_VERSIONS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLEAN_RETAIN_HOURS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
cleanAsyncEnable - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
cleanAsyncEnable - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
cleanAsyncEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
CleanFunction<T> - Class in org.apache.hudi.sink
Sink function that cleans the old commits.
CleanFunction(Configuration) - Constructor for class org.apache.hudi.sink.CleanFunction
 
cleanPolicy - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
cleanPolicy - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
cleanPolicy - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
cleanRetainCommits - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
cleanRetainCommits - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
cleanRetainCommits - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
cleanRetainFileVersions - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
cleanRetainFileVersions - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
cleanRetainFileVersions - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
cleanRetainHours - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
cleanRetainHours - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
cleanRetainHours - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
clientId(String) - Method in class org.apache.hudi.util.ClientIds.Builder
 
ClientIds - Class in org.apache.hudi.util
This class creates a client id heartbeat for a new driver.
ClientIds.Builder - Class in org.apache.hudi.util
Builder for ClientIds.
close() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
 
close() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
close() - Method in class org.apache.hudi.sink.bulk.sort.SortOperator
 
close() - Method in class org.apache.hudi.sink.CleanFunction
 
close() - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
 
close() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
 
close() - Method in class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
 
close() - Method in class org.apache.hudi.sink.compact.CompactOperator
 
close() - Method in class org.apache.hudi.sink.meta.CkpMetadata
 
close() - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
 
close() - Method in class org.apache.hudi.sink.partitioner.BucketAssignFunction
 
close() - Method in class org.apache.hudi.sink.StreamWriteFunction
 
close() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
close() - Method in class org.apache.hudi.sink.utils.NonThrownExecutor
 
close() - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
 
close() - Method in class org.apache.hudi.source.StreamReadOperator
 
close() - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
close() - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
close() - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
 
close() - Method in class org.apache.hudi.table.format.FormatUtils.BoundedMemoryRecords
 
close() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
close() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.LogFileOnlyIterator
 
close() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.MergeIterator
 
close() - Method in class org.apache.hudi.table.format.ParquetSplitRecordIterator
 
close() - Method in class org.apache.hudi.table.format.SchemaEvolvedRecordIterator
 
close() - Method in class org.apache.hudi.util.ClientIds
 
cluster(Configuration, RowType, DataStream<Object>) - Static method in class org.apache.hudi.sink.utils.Pipelines
The clustering tasks pipeline.
clusterBeginPartition - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
clusterBeginPartition - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
clusterEndPartition - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
clusterEndPartition - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
CLUSTERING_ASYNC_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_DELTA_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_MAX_NUM_GROUPS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_PLAN_PARTITION_FILTER_MODE_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_PLAN_STRATEGY_CLASS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_PLAN_STRATEGY_CLUSTER_BEGIN_PARTITION - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_PLAN_STRATEGY_CLUSTER_END_PARTITION - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_PLAN_STRATEGY_PARTITION_REGEX_PATTERN - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_PLAN_STRATEGY_PARTITION_SELECTED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_PLAN_STRATEGY_SKIP_PARTITIONS_FROM_LATEST - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_PLAN_STRATEGY_SMALL_FILE_LIMIT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_PLAN_STRATEGY_TARGET_FILE_MAX_BYTES - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_SCHEDULE_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_SORT_COLUMNS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_TARGET_PARTITIONS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
CLUSTERING_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
clusteringAsyncEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
ClusteringCommitEvent - Class in org.apache.hudi.sink.clustering
Represents a commit event from the clustering task ClusteringOperator.
ClusteringCommitEvent() - Constructor for class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
ClusteringCommitEvent(String, String, int) - Constructor for class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
ClusteringCommitEvent(String, String, List<WriteStatus>, int) - Constructor for class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
ClusteringCommitSink - Class in org.apache.hudi.sink.clustering
Function to check and commit the clustering action.
ClusteringCommitSink(Configuration) - Constructor for class org.apache.hudi.sink.clustering.ClusteringCommitSink
 
clusteringDeltaCommits - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
clusteringDeltaCommits - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
clusteringInstantTime - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
ClusteringOperator - Class in org.apache.hudi.sink.clustering
Operator to execute the actual clustering task assigned by the clustering plan task.
ClusteringOperator(Configuration, RowType) - Constructor for class org.apache.hudi.sink.clustering.ClusteringOperator
 
ClusteringPlanEvent - Class in org.apache.hudi.sink.clustering
Represents a cluster command from the clustering plan task ClusteringPlanSourceFunction.
ClusteringPlanEvent() - Constructor for class org.apache.hudi.sink.clustering.ClusteringPlanEvent
 
ClusteringPlanEvent(String, ClusteringGroupInfo, Map<String, String>) - Constructor for class org.apache.hudi.sink.clustering.ClusteringPlanEvent
 
ClusteringPlanOperator - Class in org.apache.hudi.sink.clustering
Operator that generates the clustering plan with pluggable strategies on finished checkpoints.
ClusteringPlanOperator(Configuration) - Constructor for class org.apache.hudi.sink.clustering.ClusteringPlanOperator
 
ClusteringPlanSourceFunction - Class in org.apache.hudi.sink.clustering
Flink hudi clustering source function.
ClusteringPlanSourceFunction(String, HoodieClusteringPlan, Configuration) - Constructor for class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
 
clusteringSeq - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
clusteringTasks - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
clusteringTasks - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
ClusteringUtil - Class in org.apache.hudi.util
Utilities for flink hudi clustering.
ClusteringUtil() - Constructor for class org.apache.hudi.util.ClusteringUtil
 
column(String) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
Add a table column definition.
columnName - Variable in class org.apache.hudi.source.ExpressionPredicates.ColumnPredicate
 
ColumnPredicate() - Constructor for class org.apache.hudi.source.ExpressionPredicates.ColumnPredicate
 
ColumnStats - Class in org.apache.hudi.source.stats
Column statistics.
ColumnStats(Object, Object, long) - Constructor for class org.apache.hudi.source.stats.ColumnStats
 
ColumnStatsIndices - Class in org.apache.hudi.source.stats
Utilities for abstracting away heavy-lifting of interactions with Metadata Table's Column Stats Index, providing convenient interfaces to read it, transpose, etc.
COMMENT - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
 
CommitAckEvent - Class in org.apache.hudi.sink.event
An operator event to mark successful instant commit.
CommitAckEvent(long) - Constructor for class org.apache.hudi.sink.event.CommitAckEvent
 
CommitAckEvent() - Constructor for class org.apache.hudi.sink.event.CommitAckEvent
 
commitInstant(String) - Method in class org.apache.hudi.sink.meta.CkpMetadata
Add a checkpoint commit message.
commitOnErrors - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
compact(Configuration, DataStream<Object>) - Static method in class org.apache.hudi.sink.utils.Pipelines
The compaction tasks pipeline.
COMPACTION_ASYNC_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
COMPACTION_DELTA_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
COMPACTION_DELTA_SECONDS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
COMPACTION_MAX_MEMORY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
COMPACTION_SCHEDULE_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
COMPACTION_TARGET_IO - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
COMPACTION_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
COMPACTION_TIMEOUT_SECONDS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
COMPACTION_TRIGGER_STRATEGY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
compactionAsyncEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
CompactionCommitEvent - Class in org.apache.hudi.sink.compact
Represents a commit event from the compaction task CompactOperator.
CompactionCommitEvent() - Constructor for class org.apache.hudi.sink.compact.CompactionCommitEvent
 
CompactionCommitEvent(String, String, int) - Constructor for class org.apache.hudi.sink.compact.CompactionCommitEvent
An event with NULL write statuses that represents a failed compaction.
CompactionCommitEvent(String, String, List<WriteStatus>, int) - Constructor for class org.apache.hudi.sink.compact.CompactionCommitEvent
 
CompactionCommitSink - Class in org.apache.hudi.sink.compact
Function to check and commit the compaction action.
CompactionCommitSink(Configuration) - Constructor for class org.apache.hudi.sink.compact.CompactionCommitSink
 
compactionDeltaCommits - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
compactionDeltaCommits - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
compactionDeltaSeconds - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
compactionDeltaSeconds - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
compactionMaxMemory - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
compactionMaxMemory - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
CompactionPlanEvent - Class in org.apache.hudi.sink.compact
Represents a compact command from the compaction plan task CompactionPlanOperator.
CompactionPlanEvent() - Constructor for class org.apache.hudi.sink.compact.CompactionPlanEvent
 
CompactionPlanEvent(String, CompactionOperation) - Constructor for class org.apache.hudi.sink.compact.CompactionPlanEvent
 
compactionPlanInstant - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
CompactionPlanOperator - Class in org.apache.hudi.sink.compact
Operator that generates the compaction plan with pluggable strategies on finished checkpoints.
CompactionPlanOperator(Configuration) - Constructor for class org.apache.hudi.sink.compact.CompactionPlanOperator
 
compactionPlanSelectStrategy - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
CompactionPlanSourceFunction - Class in org.apache.hudi.sink.compact
Flink hudi compaction source function.
CompactionPlanSourceFunction(List<Pair<String, HoodieCompactionPlan>>, Configuration) - Constructor for class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
 
CompactionPlanStrategies - Class in org.apache.hudi.sink.compact.strategy
Factory clazz for CompactionPlanStrategy.
CompactionPlanStrategy - Interface in org.apache.hudi.sink.compact.strategy
Compaction plan selection strategy.
compactionSeq - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
compactionTargetIo - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
compactionTargetIo - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
compactionTasks - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
compactionTasks - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
compactionTriggerStrategy - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
compactionTriggerStrategy - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
CompactionUtil - Class in org.apache.hudi.util
Utilities for flink hudi compaction.
CompactionUtil() - Constructor for class org.apache.hudi.util.CompactionUtil
 
CompactOperator - Class in org.apache.hudi.sink.compact
Operator to execute the actual compaction task assigned by the compaction plan task.
CompactOperator(Configuration) - Constructor for class org.apache.hudi.sink.compact.CompactOperator
 
COMPARATOR - Static variable in class org.apache.hudi.sink.meta.CkpMessage
 
compareTo(CkpMessage) - Method in class org.apache.hudi.sink.meta.CkpMessage
 
conf - Variable in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
conf(Configuration) - Method in class org.apache.hudi.source.FileIndex.Builder
 
conf(Configuration) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
 
conf - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
conf - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
conf(Configuration) - Method in class org.apache.hudi.util.ClientIds.Builder
 
Config() - Constructor for class org.apache.hudi.schema.FilebasedSchemaProvider.Config
 
Config() - Constructor for class org.apache.hudi.schema.SchemaRegistryProvider.Config
 
config - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Config options.
config - Variable in class org.apache.hudi.sink.partitioner.BucketAssigner
The write config.
config - Variable in class org.apache.hudi.sink.partitioner.profile.WriteProfile
The write config.
config(Configuration) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.Builder
 
config(Configuration) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
configs - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
configs - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
configs - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
configure(Configuration) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
confirming - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Flag saying whether the write task is waiting for the checkpoint success notification after it finished a checkpoint.
ConsistentBucketAssignFunction - Class in org.apache.hudi.sink.bucket
The function to tag each incoming record with a location of a file based on consistent bucket index.
ConsistentBucketAssignFunction(Configuration) - Constructor for class org.apache.hudi.sink.bucket.ConsistentBucketAssignFunction
 
ConsistentBucketStreamWriteFunction<I> - Class in org.apache.hudi.sink.bucket
A stream write function with consistent bucket hash index.
ConsistentBucketStreamWriteFunction(Configuration) - Constructor for class org.apache.hudi.sink.bucket.ConsistentBucketStreamWriteFunction
Constructs a ConsistentBucketStreamWriteFunction.
consume() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
convert(Object) - Method in interface org.apache.hudi.table.format.TypeConverters.TypeConverter
 
convert(Object) - Method in interface org.apache.hudi.util.AvroToRowDataConverters.AvroToRowDataConverter
 
convert(String) - Method in class org.apache.hudi.util.FlinkStateBackendConverter
 
convert(Schema, Object) - Method in interface org.apache.hudi.util.RowDataToAvroConverters.RowDataToAvroConverter
 
convert(String[]) - Method in class org.apache.hudi.util.StringToRowDataConverter
 
convertColumnStats(RowData, RowType.RowField[]) - Static method in class org.apache.hudi.source.prune.DataPruner
 
convertLogFilesSizeToExpectedParquetSize(List<HoodieLogFile>) - Method in class org.apache.hudi.sink.partitioner.profile.DeltaWriteProfile
 
convertTableSchema(Table) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
 
convertToDataType(Schema) - Static method in class org.apache.hudi.util.AvroSchemaConverter
Converts an Avro schema schema into a nested row structure with deterministic field order and data types that are compatible with Flink's Table & SQL API.
convertToSchema(LogicalType) - Static method in class org.apache.hudi.util.AvroSchemaConverter
Converts Flink SQL LogicalType (can be nested) into an Avro schema.
convertToSchema(LogicalType, String) - Static method in class org.apache.hudi.util.AvroSchemaConverter
Converts Flink SQL LogicalType (can be nested) into an Avro schema.
copy() - Method in class org.apache.hudi.table.HoodieTableSink
 
copy() - Method in class org.apache.hudi.table.HoodieTableSource
 
CopyOnWriteInputFormat - Class in org.apache.hudi.table.format.cow
An implementation of FileInputFormat to read RowData records from Parquet files.
CopyOnWriteInputFormat(Path[], String[], DataType[], int[], String, String, boolean, List<ExpressionPredicates.Predicate>, long, Configuration, boolean, InternalSchemaManager) - Constructor for class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
 
create(int, int, int, boolean, HoodieTableType, HoodieFlinkEngineContext, HoodieWriteConfig) - Static method in class org.apache.hudi.sink.partitioner.BucketAssigners
Creates a BucketAssigner.
create(OperatorCoordinator.Context) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator.Provider
 
create(RowType, Configuration) - Static method in class org.apache.hudi.sink.transform.RowDataToHoodieFunctions
Creates a RowDataToHoodieFunction instance based on the given configuration.
create(Configuration, SerializableConfiguration) - Static method in class org.apache.hudi.sink.utils.HiveSyncContext
 
createAccumulator() - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAggFunction
 
createCatalog(CatalogFactory.Context) - Method in class org.apache.hudi.table.catalog.HoodieCatalogFactory
 
createConverter(LogicalType) - Static method in class org.apache.hudi.util.AvroToRowDataConverters
Creates a runtime converter which assuming input object is not null.
createConverter(LogicalType) - Static method in class org.apache.hudi.util.RowDataToAvroConverters
Creates a runtime converter according to the given logical type that converts objects of Flink Table & SQL internal data structures to corresponding Avro data structures.
createDatabase(String, CatalogDatabase, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
createDatabase(String, CatalogDatabase, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
createDeletePayload(BaseAvroPayload) - Method in class org.apache.hudi.sink.utils.PayloadCreation
 
createDynamicTableSink(DynamicTableFactory.Context) - Method in class org.apache.hudi.table.HoodieTableFactory
 
createDynamicTableSource(DynamicTableFactory.Context) - Method in class org.apache.hudi.table.HoodieTableFactory
 
createFileIdOfThisTask() - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
 
createFunction(ObjectPath, CatalogFunction, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
createFunction(ObjectPath, CatalogFunction, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
createHiveConf(String) - Static method in class org.apache.hudi.table.catalog.HoodieCatalogUtil
Returns a new HiveConf.
createInputSplits(int) - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
 
createInputSplits(int) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
createMetaClient(String, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Creates the meta client.
createMetaClient(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Creates the meta client.
createPartition(ObjectPath, CatalogPartitionSpec, CatalogPartition, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
createPartition(ObjectPath, CatalogPartitionSpec, CatalogPartition, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
createPayload(GenericRecord) - Method in class org.apache.hudi.sink.utils.PayloadCreation
 
createProperties(String, Configuration, Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
Initialize the TableOptionProperties.FILE_NAME meta file.
createProperties(String, FileSystemViewStorageConfig, Configuration) - Static method in class org.apache.hudi.util.ViewStorageProperties
Initialize the ViewStorageProperties.FILE_NAME meta file.
createRowConverter(RowType) - Static method in class org.apache.hudi.util.AvroToRowDataConverters
 
createSortCodeGenerator() - Method in class org.apache.hudi.sink.bulk.sort.SortOperatorGen
 
createSortOperator(Configuration) - Method in class org.apache.hudi.sink.bulk.sort.SortOperatorGen
 
createStreamOperator(StreamOperatorParameters<Object>) - Method in class org.apache.hudi.sink.common.WriteOperatorFactory
 
createTable(ObjectPath, CatalogBaseTable, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
createTable(ObjectPath, CatalogBaseTable, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
createTable(Configuration, RuntimeContext) - Static method in class org.apache.hudi.util.FlinkTables
Creates the hoodie flink table.
createTable(HoodieWriteConfig, Configuration, RuntimeContext) - Static method in class org.apache.hudi.util.FlinkTables
Creates the hoodie flink table.
createTable(Configuration) - Static method in class org.apache.hudi.util.FlinkTables
Creates the hoodie flink table.
createTransformer(List<String>) - Static method in class org.apache.hudi.util.StreamerUtil
 
createWriteClient(Configuration) - Static method in class org.apache.hudi.util.FlinkWriteClients
Creates the Flink write client.
createWriteClient(Configuration, RuntimeContext) - Static method in class org.apache.hudi.util.FlinkWriteClients
Creates the Flink write client.
createWriteClient(Configuration, RuntimeContext, boolean) - Static method in class org.apache.hudi.util.FlinkWriteClients
Creates the Flink write client.
createWriteClientV2(Configuration) - Static method in class org.apache.hudi.util.FlinkWriteClients
Creates the Flink write client.
currentInstant - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
The REQUESTED instant we write the data.

D

DATABASE_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
databaseExists(String) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
databaseExists(String) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
dataBucket(int) - Method in class org.apache.hudi.source.FileIndex.Builder
 
DataModificationInfos - Class in org.apache.hudi.util
Utilities for all kinds of data modification infos.
DataModificationInfos() - Constructor for class org.apache.hudi.util.DataModificationInfos
 
dataPruner(DataPruner) - Method in class org.apache.hudi.source.FileIndex.Builder
 
DataPruner - Class in org.apache.hudi.source.prune
Utility to do data skipping.
DataTypeUtils - Class in org.apache.hudi.util
Utilities for DataType.
DataTypeUtils() - Constructor for class org.apache.hudi.util.DataTypeUtils
 
DEFAULT_DATABASE - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
 
DEFAULT_DB - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
 
DEFAULT_DELETE_INFO - Static variable in class org.apache.hudi.util.DataModificationInfos
 
DEFAULT_HEARTBEAT_INTERVAL_IN_MS - Static variable in class org.apache.hudi.util.ClientIds
 
DEFAULT_NUM_TOLERABLE_HEARTBEAT_MISSES - Static variable in class org.apache.hudi.util.ClientIds
 
DEFAULT_SPARK_VERSION - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
 
DEFAULT_UPDATE_INFO - Static variable in class org.apache.hudi.util.DataModificationInfos
 
defaultMethod(LogicalType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
defaultPartName(String) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.Builder
 
defaultPartName - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
defaultPartName(String) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
DeltaWriteProfile - Class in org.apache.hudi.sink.partitioner.profile
WriteProfile for MERGE_ON_READ table type, this allows auto correction of small parquet files to larger ones without the need for an index in the logFile.
DeltaWriteProfile(HoodieWriteConfig, HoodieFlinkEngineContext) - Constructor for class org.apache.hudi.sink.partitioner.profile.DeltaWriteProfile
 
DISABLED - Static variable in class org.apache.hudi.table.format.InternalSchemaManager
 
doSyncHive() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
Sync hoodie table metadata to Hive metastore.
dropDatabase(String, boolean, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
dropDatabase(String, boolean, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
dropFunction(ObjectPath, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
dropFunction(ObjectPath, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
dropPartition(ObjectPath, CatalogPartitionSpec, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
dropPartition(ObjectPath, CatalogPartitionSpec, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
dropTable(ObjectPath, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
dropTable(ObjectPath, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
dummySink(DataStream<Object>) - Static method in class org.apache.hudi.sink.utils.Pipelines
 
DummySink() - Constructor for class org.apache.hudi.sink.utils.Pipelines.DummySink
 

E

emitChangelog(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the source should emit changelog.
emitDelete(boolean) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.Builder
 
emitDelete - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
emitDelete(boolean) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
EMPTY - Static variable in class org.apache.hudi.source.IncrementalInputSplits.Result
 
EMPTY_INPUT_FORMAT - Static variable in class org.apache.hudi.util.InputFormats
 
emptyBootstrap(int) - Static method in class org.apache.hudi.sink.event.WriteMetadataEvent
Creates empty bootstrap event for task taskId.
EmptyWriteProfile - Class in org.apache.hudi.sink.partitioner.profile
WriteProfile that always return empty small files.
EmptyWriteProfile(HoodieWriteConfig, HoodieFlinkEngineContext) - Constructor for class org.apache.hudi.sink.partitioner.profile.EmptyWriteProfile
 
endCompaction() - Method in class org.apache.hudi.metrics.FlinkCompactionMetrics
 
endInput() - Method in class org.apache.hudi.sink.append.AppendWriteFunction
End input action for batch source.
endInput() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
End input action for batch source.
endInput() - Method in class org.apache.hudi.sink.bulk.sort.SortOperator
 
endInput() - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
End input action for batch source.
endInput() - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
 
endInput() - Method in class org.apache.hudi.sink.common.AbstractWriteFunction
Invoked when bounded source ends up.
endInput() - Method in class org.apache.hudi.sink.common.AbstractWriteOperator
 
endInput() - Method in class org.apache.hudi.sink.compact.CompactionPlanOperator
 
endInput(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
 
endInput() - Method in class org.apache.hudi.sink.StreamWriteFunction
End input action for batch source.
ensureColumnsAsNonNullable(DataType, List<String>) - Static method in class org.apache.hudi.util.DataTypeUtils
Ensures the give columns of the row data type are not nullable(for example, the primary keys).
Equals() - Constructor for class org.apache.hudi.source.ExpressionPredicates.Equals
 
equals(Object) - Method in class org.apache.hudi.source.stats.ColumnStats
 
EqualTo() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.EqualTo
 
eval(Map<String, ColumnStats>) - Method in class org.apache.hudi.source.ExpressionEvaluators.AlwaysFalse
 
eval(Map<String, ColumnStats>) - Method in class org.apache.hudi.source.ExpressionEvaluators.And
 
eval(Object, ColumnStats, LogicalType) - Method in class org.apache.hudi.source.ExpressionEvaluators.EqualTo
 
eval(Map<String, ColumnStats>) - Method in interface org.apache.hudi.source.ExpressionEvaluators.Evaluator
Evaluates whether it's possible to match based on the column stats.
eval(Object, ColumnStats, LogicalType) - Method in class org.apache.hudi.source.ExpressionEvaluators.GreaterThan
 
eval(Object, ColumnStats, LogicalType) - Method in class org.apache.hudi.source.ExpressionEvaluators.GreaterThanOrEqual
 
eval(Map<String, ColumnStats>) - Method in class org.apache.hudi.source.ExpressionEvaluators.In
 
eval(Map<String, ColumnStats>) - Method in class org.apache.hudi.source.ExpressionEvaluators.IsNotNull
 
eval(Map<String, ColumnStats>) - Method in class org.apache.hudi.source.ExpressionEvaluators.IsNull
 
eval(Object, ColumnStats, LogicalType) - Method in class org.apache.hudi.source.ExpressionEvaluators.LessThan
 
eval(Object, ColumnStats, LogicalType) - Method in class org.apache.hudi.source.ExpressionEvaluators.LessThanOrEqual
 
eval(Map<String, ColumnStats>) - Method in class org.apache.hudi.source.ExpressionEvaluators.Not
 
eval(Object, ColumnStats, LogicalType) - Method in class org.apache.hudi.source.ExpressionEvaluators.NotEqualTo
 
eval(Map<String, ColumnStats>) - Method in class org.apache.hudi.source.ExpressionEvaluators.NullFalseEvaluator
 
eval(Object, ColumnStats, LogicalType) - Method in class org.apache.hudi.source.ExpressionEvaluators.NullFalseEvaluator
 
eval(Map<String, ColumnStats>) - Method in class org.apache.hudi.source.ExpressionEvaluators.Or
 
eventGateway - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Gateway to send operator events to the operator coordinator.
exceptionHook(NonThrownExecutor.ExceptionHook) - Method in class org.apache.hudi.sink.utils.NonThrownExecutor.Builder
 
exceptionHook - Variable in class org.apache.hudi.sink.utils.NonThrownExecutor
Exception hook for post-exception handling.
execute(ThrowingRunnable<Throwable>, String, Object...) - Method in class org.apache.hudi.sink.utils.NonThrownExecutor
Run the action in a loop.
execute(ThrowingRunnable<Throwable>, NonThrownExecutor.ExceptionHook, String, Object...) - Method in class org.apache.hudi.sink.utils.NonThrownExecutor
Run the action in a loop.
executeSync(ThrowingRunnable<Throwable>, String, Object...) - Method in class org.apache.hudi.sink.utils.NonThrownExecutor
Run the action in a loop and wait for completion.
ExpressionEvaluators - Class in org.apache.hudi.source
Tool to evaluate the ResolvedExpressions.
ExpressionEvaluators() - Constructor for class org.apache.hudi.source.ExpressionEvaluators
 
ExpressionEvaluators.AlwaysFalse - Class in org.apache.hudi.source
A special evaluator which is not possible to match any condition.
ExpressionEvaluators.And - Class in org.apache.hudi.source
To evaluate AND expr.
ExpressionEvaluators.EqualTo - Class in org.apache.hudi.source
To evaluate = expr.
ExpressionEvaluators.Evaluator - Interface in org.apache.hudi.source
Decides whether it's possible to match based on the column values and column stats.
ExpressionEvaluators.GreaterThan - Class in org.apache.hudi.source
To evaluate > expr.
ExpressionEvaluators.GreaterThanOrEqual - Class in org.apache.hudi.source
To evaluate >= expr.
ExpressionEvaluators.In - Class in org.apache.hudi.source
To evaluate IN expr.
ExpressionEvaluators.IsNotNull - Class in org.apache.hudi.source
To evaluate IS NOT NULL expr.
ExpressionEvaluators.IsNull - Class in org.apache.hudi.source
To evaluate IS NULL expr.
ExpressionEvaluators.LeafEvaluator - Class in org.apache.hudi.source
Leaf evaluator which depends on the given field.
ExpressionEvaluators.LessThan - Class in org.apache.hudi.source
To evaluate < expr.
ExpressionEvaluators.LessThanOrEqual - Class in org.apache.hudi.source
To evaluate <= expr.
ExpressionEvaluators.Not - Class in org.apache.hudi.source
To evaluate NOT expr.
ExpressionEvaluators.NotEqualTo - Class in org.apache.hudi.source
To evaluate <> expr.
ExpressionEvaluators.NullFalseEvaluator - Class in org.apache.hudi.source
Leaf evaluator which compares the field value with literal values.
ExpressionEvaluators.Or - Class in org.apache.hudi.source
To evaluate OR expr.
ExpressionPredicates - Class in org.apache.hudi.source
Tool to predicate the ResolvedExpressions.
ExpressionPredicates() - Constructor for class org.apache.hudi.source.ExpressionPredicates
 
ExpressionPredicates.AlwaysNull - Class in org.apache.hudi.source
A special predicate which is not possible to match any condition.
ExpressionPredicates.And - Class in org.apache.hudi.source
An AND predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.ColumnPredicate - Class in org.apache.hudi.source
Column predicate which depends on the given field.
ExpressionPredicates.Equals - Class in org.apache.hudi.source
An EQUALS predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.GreaterThan - Class in org.apache.hudi.source
A GREATER_THAN predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.GreaterThanOrEqual - Class in org.apache.hudi.source
A GREATER_THAN_OR_EQUAL predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.In - Class in org.apache.hudi.source
An IN predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.LessThan - Class in org.apache.hudi.source
A LESS_THAN predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.LessThanOrEqual - Class in org.apache.hudi.source
A LESS_THAN_OR_EQUAL predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.Not - Class in org.apache.hudi.source
A NOT predicate to negate a predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.NotEquals - Class in org.apache.hudi.source
A NOT_EQUALS predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.Or - Class in org.apache.hudi.source
An OR predicate that can be evaluated by the FileInputFormat.
ExpressionPredicates.Predicate - Interface in org.apache.hudi.source
A filter predicate that can be evaluated by the FileInputFormat.
ExpressionUtils - Class in org.apache.hudi.util
Utilities for expression resolving.
ExpressionUtils() - Constructor for class org.apache.hudi.util.ExpressionUtils
 
extractHivePartitionFields(Configuration) - Static method in class org.apache.hudi.table.format.FilePathUtils
Extracts the hive sync partition fields with given configuration.
extractPartitionKeys(Configuration) - Static method in class org.apache.hudi.table.format.FilePathUtils
Extracts the partition keys with given configuration.
extractPartitionKeyValues(Path, boolean, String[]) - Static method in class org.apache.hudi.table.format.FilePathUtils
Generates partition key value mapping from path.
extractValueTypeToAvroMap(LogicalType) - Static method in class org.apache.hudi.util.AvroSchemaConverter
 

F

factory(MergeOnReadInputFormat) - Static method in class org.apache.hudi.source.StreamReadOperator
 
FACTORY_ID - Static variable in class org.apache.hudi.table.HoodieTableFactory
 
factoryIdentifier() - Method in class org.apache.hudi.table.catalog.HoodieCatalogFactory
 
factoryIdentifier() - Method in class org.apache.hudi.table.HoodieTableFactory
 
fetchSchemaFromRegistry(String) - Method in class org.apache.hudi.schema.SchemaRegistryProvider
The method takes the provided url registryUrl and gets the schema from the schema registry using that url.
fieldTypes(List<DataType>) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.Builder
 
fieldTypes - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
fieldTypes(List<DataType>) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
FILE_GROUP_META_FIELD - Static variable in class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
 
FilebasedSchemaProvider - Class in org.apache.hudi.schema
A simple schema provider, that reads off files on DFS.
FilebasedSchemaProvider(TypedProperties) - Constructor for class org.apache.hudi.schema.FilebasedSchemaProvider
Deprecated.
FilebasedSchemaProvider(Configuration) - Constructor for class org.apache.hudi.schema.FilebasedSchemaProvider
 
FilebasedSchemaProvider.Config - Class in org.apache.hudi.schema
Configs supported.
fileExists(FileSystem, Path) - Static method in class org.apache.hudi.util.StreamerUtil
 
fileId - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
FileIndex - Class in org.apache.hudi.source
A file index which supports listing files efficiently through metadata table.
FileIndex.Builder - Class in org.apache.hudi.source
Builder for FileIndex.
FilePathUtils - Class in org.apache.hudi.table.format
Reference the Flink PartitionPathUtils but supports simple partition path besides the Hive style.
FilePathUtils() - Constructor for class org.apache.hudi.table.format.FilePathUtils
 
fileSlice2Split(String, FileSlice, long) - Static method in class org.apache.hudi.table.format.cdc.CdcInputFormat
 
filter() - Method in class org.apache.hudi.source.ExpressionPredicates.AlwaysNull
 
filter() - Method in class org.apache.hudi.source.ExpressionPredicates.And
 
filter() - Method in class org.apache.hudi.source.ExpressionPredicates.ColumnPredicate
 
filter() - Method in class org.apache.hudi.source.ExpressionPredicates.In
 
filter() - Method in class org.apache.hudi.source.ExpressionPredicates.Not
 
filter() - Method in class org.apache.hudi.source.ExpressionPredicates.Or
 
filter() - Method in interface org.apache.hudi.source.ExpressionPredicates.Predicate
Predicates the criteria for which records to keep when loading data from a parquet file.
filter(Collection<String>) - Method in class org.apache.hudi.source.prune.PartitionPruners.DynamicPartitionPruner
 
filter(Collection<String>) - Method in interface org.apache.hudi.source.prune.PartitionPruners.PartitionPruner
Applies partition pruning on the given partition list, return remained partitions.
filter(Collection<String>) - Method in class org.apache.hudi.source.prune.PartitionPruners.StaticPartitionPruner
 
filterInstantsAsPerUserConfigs(HoodieTimeline) - Method in class org.apache.hudi.source.IncrementalInputSplits
Filters out the unnecessary instants as per user specified configs.
filterInstantsWithRange(HoodieTimeline, String) - Method in class org.apache.hudi.source.IncrementalInputSplits
Returns the instants with a given issuedInstant to start from.
filterSimpleCallExpression(List<ResolvedExpression>) - Static method in class org.apache.hudi.util.ExpressionUtils
 
finish() - Method in class org.apache.hudi.source.StreamReadOperator
 
flatOptions(Configuration) - Static method in class org.apache.hudi.configuration.FlinkOptions
Collects all the config options, the 'properties.' prefix would be removed if the option key starts with it.
flinkCheckPointPath - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
FlinkClusteringConfig - Class in org.apache.hudi.sink.clustering
Configurations for Hoodie Flink clustering.
FlinkClusteringConfig() - Constructor for class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
FlinkCompactionConfig - Class in org.apache.hudi.sink.compact
Configurations for Hoodie Flink compaction.
FlinkCompactionConfig() - Constructor for class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
FlinkCompactionMetrics - Class in org.apache.hudi.metrics
Metrics for flink compaction.
FlinkCompactionMetrics(MetricGroup) - Constructor for class org.apache.hudi.metrics.FlinkCompactionMetrics
 
flinkConf2TypedProperties(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Converts the give Configuration to TypedProperties.
FlinkConsistentBucketUpdateStrategy<T extends HoodieRecordPayload> - Class in org.apache.hudi.sink.clustering.update.strategy
Update strategy for consistent hashing bucket index.
FlinkConsistentBucketUpdateStrategy(HoodieFlinkWriteClient, List<String>) - Constructor for class org.apache.hudi.sink.clustering.update.strategy.FlinkConsistentBucketUpdateStrategy
 
FlinkOptions - Class in org.apache.hudi.configuration
Hoodie Flink config options.
FlinkStateBackendConverter - Class in org.apache.hudi.util
Converter that converts a string into Flink StateBackend.
FlinkStateBackendConverter() - Constructor for class org.apache.hudi.util.FlinkStateBackendConverter
 
FlinkStreamerConfig - Class in org.apache.hudi.streamer
Configurations for Hoodie Flink streamer.
FlinkStreamerConfig() - Constructor for class org.apache.hudi.streamer.FlinkStreamerConfig
 
FlinkStreamReadMetrics - Class in org.apache.hudi.metrics
Metrics for flink stream read.
FlinkStreamReadMetrics(MetricGroup) - Constructor for class org.apache.hudi.metrics.FlinkStreamReadMetrics
 
FlinkTables - Class in org.apache.hudi.util
Utilities for HoodieFlinkTable.
FlinkWriteClients - Class in org.apache.hudi.util
Utilities for HoodieFlinkWriteClient.
FlinkWriteClients() - Constructor for class org.apache.hudi.util.FlinkWriteClients
 
FlinkWriteMetrics - Class in org.apache.hudi.metrics
Common flink write commit metadata metrics.
FlinkWriteMetrics(MetricGroup, String) - Constructor for class org.apache.hudi.metrics.FlinkWriteMetrics
 
FormatUtils - Class in org.apache.hudi.table.format
Utilities for format.
FormatUtils.BoundedMemoryRecords - Class in org.apache.hudi.table.format
Utility to read and buffer the records in the unMerged log record scanner.
fromExpression(List<ResolvedExpression>) - Static method in class org.apache.hudi.source.ExpressionEvaluators
Converts specific call expression list to the evaluator list.
fromExpression(CallExpression) - Static method in class org.apache.hudi.source.ExpressionEvaluators
Converts specific call expression to the evaluator.
fromExpression(List<ResolvedExpression>) - Static method in class org.apache.hudi.source.ExpressionPredicates
Converts specific call expression list to the predicate list.
fromExpression(CallExpression) - Static method in class org.apache.hudi.source.ExpressionPredicates
Converts specific call expression to the predicate.
fromMap(Map<String, String>) - Static method in class org.apache.hudi.configuration.FlinkOptions
Creates a new configuration that is initialized with the options of the given map.
fs(FileSystem) - Method in class org.apache.hudi.util.ClientIds.Builder
 
fsView - Variable in class org.apache.hudi.sink.partitioner.profile.WriteProfile
The file system view cache for one checkpoint interval.
FULL - Static variable in class org.apache.hudi.util.ChangelogModes
 
functionExists(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
functionExists(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 

G

generateBucketKey(String, String) - Static method in class org.apache.hudi.util.StreamerUtil
Generates the bucket ID using format {partition path}_{fileID}.
generateHoodieRecord(HoodieKey, FileSlice) - Static method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
generatePartitionPath(LinkedHashMap<String, String>, boolean, boolean) - Static method in class org.apache.hudi.table.format.FilePathUtils
Make partition path from partition spec.
generatePartitionSpecs(String, List<String>, List<DataType>, String, String, boolean) - Static method in class org.apache.hudi.table.format.FilePathUtils
Generates partition key value mapping from path with special cases processing: - for date time type partition field - for field that does not exist in schema Common method for usage in both COW and MOR tables.
get(Configuration, HoodieTableMetaClient) - Static method in class org.apache.hudi.table.format.InternalSchemaManager
 
getAllFileNames(String) - Static method in class org.apache.hudi.sink.meta.CkpMessage
 
getAvgSize() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
 
getAvroSchema() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
 
getBaseFileIterator(String) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
getBaseFileIteratorWithMetadata(String) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
getBasePath() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getBucketEngineType(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
 
getBucketId(List<ResolvedExpression>, Configuration) - Static method in class org.apache.hudi.source.prune.PrimaryKeyPruners
 
getCDCSupplementalLoggingMode(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns the supplemental logging mode.
getChangelogMode(ChangelogMode) - Method in class org.apache.hudi.table.HoodieTableSink
 
getChangelogMode() - Method in class org.apache.hudi.table.HoodieTableSource
 
getChanges() - Method in class org.apache.hudi.table.format.cdc.CdcInputSplit
 
getCheckpointId() - Method in class org.apache.hudi.sink.event.CommitAckEvent
 
getClient() - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getClusteringGroupInfo() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
 
getClusteringInstantTime() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
 
getColumnStats(Map<String, ColumnStats>) - Method in class org.apache.hudi.source.ExpressionEvaluators.LeafEvaluator
 
getComment(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
 
getCommitMetadata(String, Path, HoodieInstant, HoodieTimeline) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
Returns the commit metadata of the given instant.
getCommitMetadataSafely(String, Path, HoodieInstant, HoodieTimeline) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
Returns the commit metadata of the given instant safely.
getCompactionInstantTime() - Method in class org.apache.hudi.sink.compact.CompactionPlanEvent
 
getCompactionInstantTime(HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
Gets compaction Instant time.
getConf() - Method in class org.apache.hudi.table.HoodieTableSink
 
getConf() - Method in class org.apache.hudi.table.HoodieTableSource
 
getConflictResolutionStrategy(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns the conflict resolution strategy.
getConsumed() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getContext() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
getCoordinatorProvider(String, OperatorID) - Method in class org.apache.hudi.sink.common.WriteOperatorFactory
 
getDatabase(String) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
getDatabase(String) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getDataBucket() - Method in class org.apache.hudi.table.HoodieTableSource
 
getDataBuffer() - Method in class org.apache.hudi.sink.StreamWriteFunction
 
getDataPruner() - Method in class org.apache.hudi.table.HoodieTableSource
 
getDefaultPlanStrategyClassName(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns the default plan strategy class.
getEndInstant() - Method in class org.apache.hudi.source.IncrementalInputSplits.Result
 
getEventBuffer() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
getFactory(Configuration, RowType) - Static method in class org.apache.hudi.sink.append.AppendWriteOperator
 
getFactory(Configuration) - Static method in class org.apache.hudi.sink.bucket.BucketStreamWriteOperator
 
getFactory(Configuration, RowType) - Static method in class org.apache.hudi.sink.bulk.BulkInsertWriteOperator
 
getFactory(Configuration) - Static method in class org.apache.hudi.sink.StreamWriteOperator
 
getFieldNames(List<FieldSchema>) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
Get field names from field schemas.
getFileFieldTypes() - Method in class org.apache.hudi.table.format.CastMap
 
getFileId() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
 
getFileId() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getFileIds() - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
getFileIdSorterGen(RowType) - Static method in class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
 
getFileName(String, CkpMessage.State) - Static method in class org.apache.hudi.sink.meta.CkpMessage
 
getFilesFromMetadata(Path, Configuration, List<HoodieCommitMetadata>, HoodieTableType) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
Returns all the incremental write file statuses with the given commits metadata.
getFilesFromMetadata(Path, Configuration, List<HoodieCommitMetadata>, HoodieTableType, boolean) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
Returns all the incremental write file statuses with the given commits metadata.
getFilesInPartitions() - Method in class org.apache.hudi.source.FileIndex
Returns all the file statuses under the table base path.
getFileStatusRecursively(Path, int, Configuration) - Static method in class org.apache.hudi.table.format.FilePathUtils
 
getFileStatusRecursively(Path, int, FileSystem) - Static method in class org.apache.hudi.table.format.FilePathUtils
 
getFileSystemView() - Method in class org.apache.hudi.sink.partitioner.profile.DeltaWriteProfile
 
getFileSystemView() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
 
getFlinkClusteringConfig(String[]) - Static method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob
 
getFlinkCompactionConfig(String[]) - Static method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor
 
getFullLogFileIterator(MergeOnReadInputSplit) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
getFunction(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
getFunction(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getFunctionDefinition() - Method in class org.apache.hudi.source.ExpressionPredicates.ColumnPredicate
Returns function definition of predicate.
getFunctionDefinition() - Method in class org.apache.hudi.source.ExpressionPredicates.Equals
 
getFunctionDefinition() - Method in class org.apache.hudi.source.ExpressionPredicates.GreaterThan
 
getFunctionDefinition() - Method in class org.apache.hudi.source.ExpressionPredicates.GreaterThanOrEqual
 
getFunctionDefinition() - Method in class org.apache.hudi.source.ExpressionPredicates.LessThan
 
getFunctionDefinition() - Method in class org.apache.hudi.source.ExpressionPredicates.LessThanOrEqual
 
getFunctionDefinition() - Method in class org.apache.hudi.source.ExpressionPredicates.NotEquals
 
getHadoopConf(Configuration) - Static method in class org.apache.hudi.configuration.HadoopConfigurations
Creates a new hadoop configuration that is initialized with the given flink configuration.
getHiveConf(Configuration) - Static method in class org.apache.hudi.configuration.HadoopConfigurations
Creates a Hive configuration with configured dir path or empty if no Hive conf dir is set.
getHiveConf() - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getHiveTable(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getHoodieClientConfig(Configuration) - Static method in class org.apache.hudi.util.FlinkWriteClients
Mainly used for tests.
getHoodieClientConfig(Configuration, boolean) - Static method in class org.apache.hudi.util.FlinkWriteClients
 
getHoodieClientConfig(Configuration, boolean, boolean) - Static method in class org.apache.hudi.util.FlinkWriteClients
 
getHoodieKey(RowData) - Method in class org.apache.hudi.sink.bulk.RowDataKeyGen
 
getIndexConfig(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Returns the index config with given configuration.
getIndexKeyField(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns the index key field.
getIndexKeys(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns the index key field values.
getIndexType(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns the index type.
getInputFormat() - Method in class org.apache.hudi.table.HoodieTableSource
 
getInputFormat(boolean) - Method in class org.apache.hudi.table.HoodieTableSource
 
getInputSplitAssigner(MergeOnReadInputSplit[]) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
getInputSplits() - Method in class org.apache.hudi.source.IncrementalInputSplits.Result
 
getInputSplits() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
 
getInstance(long) - Static method in class org.apache.hudi.sink.event.CommitAckEvent
 
getInstance(Configuration) - Static method in class org.apache.hudi.sink.meta.CkpMetadata
 
getInstance(HoodieTableMetaClient, String) - Static method in class org.apache.hudi.sink.meta.CkpMetadata
 
getInstance(FileSystem, String, String) - Static method in class org.apache.hudi.sink.meta.CkpMetadata
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.AlwaysFalse
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.And
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.EqualTo
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.GreaterThan
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.GreaterThanOrEqual
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.In
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.IsNotNull
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.IsNull
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.LessThan
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.LessThanOrEqual
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.Not
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.NotEqualTo
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionEvaluators.Or
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.AlwaysNull
 
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.And
Returns an AND predicate.
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.Equals
Returns a EQUALS predicate.
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.GreaterThan
Returns a GREATER_THAN predicate.
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.GreaterThanOrEqual
Returns a GREATER_THAN_OR_EQUAL predicate.
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.In
Returns an IN predicate.
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.LessThan
Returns a LESS_THAN predicate.
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.LessThanOrEqual
Returns a LESS_THAN_OR_EQUAL predicate.
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.Not
Returns a NOT predicate.
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.NotEquals
Returns a NOT_EQUALS predicate.
getInstance() - Static method in class org.apache.hudi.source.ExpressionPredicates.Or
Returns an OR predicate.
getInstance(List<ExpressionEvaluators.Evaluator>, List<String>, List<DataType>, String, boolean) - Static method in class org.apache.hudi.source.prune.PartitionPruners
 
getInstance(Collection<String>) - Static method in class org.apache.hudi.source.prune.PartitionPruners
 
getInstance(String...) - Static method in class org.apache.hudi.source.prune.PartitionPruners
 
getInstance(LogicalType, LogicalType) - Static method in class org.apache.hudi.table.format.TypeConverters
 
getInstance(Configuration) - Static method in class org.apache.hudi.util.JsonDeserializationFunction
 
getInstance(RowType) - Static method in class org.apache.hudi.util.JsonDeserializationFunction
 
getInstant() - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
getInstant() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
 
getInstant() - Method in class org.apache.hudi.sink.meta.CkpMessage
 
getInstant() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
getInstantCache() - Method in class org.apache.hudi.sink.meta.CkpMetadata
 
getInstantRange() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getInstantTime() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
Returns the write instant time.
getInstantTime() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
getKeyFromLiteral(ValueLiteralExpression, boolean) - Static method in class org.apache.hudi.util.ExpressionUtils
Returns the field as part of a hoodie key with given value literal expression.
getLastCompletedInstant(HoodieTableMetaClient) - Static method in class org.apache.hudi.util.StreamerUtil
 
getLastPendingInstant(HoodieTableMetaClient) - Static method in class org.apache.hudi.util.StreamerUtil
 
getLastPendingInstant(HoodieTableMetaClient, boolean) - Static method in class org.apache.hudi.util.StreamerUtil
 
getLatestCommit() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getLatestTableSchema(String, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
 
getLogPaths() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getMaxCompactionMemoryInBytes() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getMaxCompactionMemoryInBytes(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Returns the max compaction memory in bytes with given conf.
getMaxVal() - Method in class org.apache.hudi.source.stats.ColumnStats
 
getMergeType() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getMessages() - Method in class org.apache.hudi.sink.meta.CkpMetadata
 
getMetaClient() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
 
getMetaClient() - Method in class org.apache.hudi.table.HoodieTableSource
 
getMetadataCache() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
 
getMetricsName(String, String) - Method in class org.apache.hudi.metrics.FlinkWriteMetrics
 
getMinVal() - Method in class org.apache.hudi.source.stats.ColumnStats
 
getNullCnt() - Method in class org.apache.hudi.source.stats.ColumnStats
 
getOffset() - Method in class org.apache.hudi.source.IncrementalInputSplits.Result
 
getOperation() - Method in class org.apache.hudi.sink.compact.CompactionPlanEvent
 
getOperationPos() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
 
getOperatorId() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator.Provider
 
getOrBuildPartitionPaths() - Method in class org.apache.hudi.source.FileIndex
Returns all the relative partition paths.
getOrderedPartitionValues(String, HiveConf, CatalogPartitionSpec, List<String>, ObjectPath) - Static method in class org.apache.hudi.table.catalog.HoodieCatalogUtil
Returns a list of ordered partition values by re-arranging them based on the given list of partition keys.
getParquetConf(Configuration, Configuration) - Static method in class org.apache.hudi.configuration.HadoopConfigurations
Creates a merged hadoop configuration with given flink configuration and hadoop configuration.
getParquetRecordIterator(InternalSchemaManager, boolean, boolean, Configuration, String[], DataType[], Map<String, Object>, int[], int, Path, long, long, List<ExpressionPredicates.Predicate>) - Static method in class org.apache.hudi.table.format.RecordIterators
 
getPartition(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
getPartition(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getPartitionColumns(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
 
getPartitionColumnStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
getPartitionColumnStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getPartitionKeys(CatalogTable) - Static method in class org.apache.hudi.table.catalog.HoodieCatalogUtil
Returns the partition key list with given table.
getPartitionPath(RowData) - Method in class org.apache.hudi.sink.bulk.RowDataKeyGen
 
getPartitionPath(Object, String, boolean, boolean, Option<TimestampBasedAvroKeyGenerator>) - Static method in class org.apache.hudi.sink.bulk.RowDataKeyGen
 
getPartitions(List<String>, String, boolean) - Method in class org.apache.hudi.source.FileIndex
Returns the partition path key and values as a list of map, each map item in the list is a mapping of the partition key name to its actual partition value.
getPartitions(Path, Configuration, List<String>, String, boolean) - Static method in class org.apache.hudi.table.format.FilePathUtils
Returns the partition path key and values as a list of map, each map item in the list is a mapping of the partition key name to its actual partition value.
getPartitionStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
getPartitionStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getPayloadConfig(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Returns the payload config with given configuration.
getPkColumns(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
 
getPkConstraintName(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
 
getPkOffsetsInRequired() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
Get the primary key positions in required row type.
getPkTypes(int[]) - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
Returns the primary key fields logical type with given offsets.
getPreCombineField(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns the preCombine field or null if the value is set as FlinkOptions.NO_PRE_COMBINE.
getPredicates() - Method in class org.apache.hudi.table.HoodieTableSource
 
getPropertiesWithPrefix(Map<String, String>, String) - Static method in class org.apache.hudi.configuration.FlinkOptions
Collects the config options that start with specified prefix prefix into a 'key'='value' list.
getProps(FlinkClusteringConfig) - Static method in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
getProps(FlinkCompactionConfig) - Static method in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
getProps(FlinkStreamerConfig) - Static method in class org.apache.hudi.util.StreamerUtil
 
getQuerySchema() - Method in class org.apache.hudi.table.format.InternalSchemaManager
 
getReadFiles() - Method in class org.apache.hudi.table.HoodieTableSource
Get the reader paths with partition path expanded.
getReadPaths(Path, Configuration, Configuration, List<String>) - Static method in class org.apache.hudi.table.format.FilePathUtils
Returns all the file paths that is the parents of the data files.
getRecordKey(RowData) - Method in class org.apache.hudi.sink.bulk.AutoRowDataKeyGen
 
getRecordKey(RowData) - Method in class org.apache.hudi.sink.bulk.RowDataKeyGen
 
getRecordKey(Object, String, boolean) - Static method in class org.apache.hudi.sink.bulk.RowDataKeyGen
 
getRecordsIterator() - Method in class org.apache.hudi.table.format.FormatUtils.BoundedMemoryRecords
 
getRecordsPerBucket() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
 
getReferencedCols() - Method in class org.apache.hudi.source.prune.DataPruner
 
getRequiredAvroSchema() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
 
getRequiredPositions() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
 
getRequiredRowType() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
 
getResolvedCatalogTable() - Method in class org.apache.hudi.util.HoodiePipeline.TableDescriptor
 
getResult(BootstrapAccumulator) - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAggFunction
 
getRowKindSafely(IndexedRecord, int) - Static method in class org.apache.hudi.table.format.FormatUtils
Returns the RowKind of the given record, never null.
getRowType() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
 
getScanRuntimeProvider(ScanTableSource.ScanContext) - Method in class org.apache.hudi.table.HoodieTableSource
 
getSinkRuntimeProvider(DynamicTableSink.Context) - Method in class org.apache.hudi.table.HoodieTableSink
 
getSmallFiles(String) - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
Returns a list of small files in the given partition path.
getSourceSchema() - Method in class org.apache.hudi.schema.FilebasedSchemaProvider
 
getSourceSchema() - Method in class org.apache.hudi.schema.SchemaProvider
 
getSourceSchema() - Method in class org.apache.hudi.schema.SchemaRegistryProvider
 
getSourceSchema(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
 
getSplitNumber() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getState() - Method in class org.apache.hudi.sink.meta.CkpMessage
 
getStatistics(BaseStatistics) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
getStrategy(FlinkCompactionConfig) - Static method in class org.apache.hudi.sink.compact.strategy.CompactionPlanStrategies
 
getStrategyParams() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
 
getStream(HttpURLConnection) - Method in class org.apache.hudi.schema.SchemaRegistryProvider
 
getTable() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
 
getTable(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
getTable(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getTableAvroSchema() - Method in class org.apache.hudi.table.HoodieTableSource
 
getTableAvroSchema(HoodieTableMetaClient, boolean) - Static method in class org.apache.hudi.util.StreamerUtil
 
getTableColumnStatistics(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
getTableColumnStatistics(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getTableConfig(String, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Returns the table config or empty if the table does not exist.
getTableDescriptor() - Method in class org.apache.hudi.util.HoodiePipeline.Builder
 
getTableId() - Method in class org.apache.hudi.util.HoodiePipeline.TableDescriptor
 
getTableOptions(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
 
getTablePath(Configuration) - Static method in class org.apache.hudi.sink.utils.Pipelines
 
getTablePath() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
getTableStatistics(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
getTableStatistics(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
getTargetSchema() - Method in class org.apache.hudi.schema.FilebasedSchemaProvider
 
getTargetSchema() - Method in class org.apache.hudi.schema.SchemaProvider
 
getTargetSchema() - Method in class org.apache.hudi.schema.SchemaRegistryProvider
 
getTaskID() - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
getTaskID() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
 
getTaskID() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
getTransformersNames() - Method in class org.apache.hudi.sink.transform.ChainedTransformer
 
getVal(int, Object) - Method in class org.apache.hudi.util.RowDataCastProjection
 
getVal(int, Object) - Method in class org.apache.hudi.util.RowDataProjection
 
getValueFromLiteral(ValueLiteralExpression) - Static method in class org.apache.hudi.util.ExpressionUtils
Returns the value with given value literal expression.
getWriteClient() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
getWriterHelper() - Method in class org.apache.hudi.sink.append.AppendWriteFunction
 
getWriterHelper(Configuration, HoodieTable<?, ?, ?, ?>, HoodieWriteConfig, String, int, long, long, RowType) - Static method in class org.apache.hudi.sink.bulk.WriterHelpers
 
getWriteStatuses(int) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
getWriteStatuses() - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
getWriteStatuses() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
 
getWriteStatuses() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
GreaterThan() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.GreaterThan
 
GreaterThan() - Constructor for class org.apache.hudi.source.ExpressionPredicates.GreaterThan
 
GreaterThanOrEqual() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.GreaterThanOrEqual
 
GreaterThanOrEqual() - Constructor for class org.apache.hudi.source.ExpressionPredicates.GreaterThanOrEqual
 

H

hadoopConf - Variable in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
hadoopConf - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
HadoopConfigurations - Class in org.apache.hudi.configuration
Utilities for fetching hadoop configurations.
HadoopConfigurations() - Constructor for class org.apache.hudi.configuration.HadoopConfigurations
 
handle - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
handleEventFromOperator(int, OperatorEvent) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
 
handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteOperator
 
handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
 
handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.common.AbstractWriteFunction
Handles the operator event sent by the coordinator.
handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.common.AbstractWriteOperator
 
handles - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
handleUpdate(List<Pair<List<HoodieRecord>, String>>) - Method in class org.apache.hudi.sink.clustering.update.strategy.FlinkConsistentBucketUpdateStrategy
 
hashCode() - Method in class org.apache.hudi.source.stats.ColumnStats
 
hasNext() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.LogFileOnlyIterator
 
hasNext() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.MergeIterator
 
hasNext() - Method in class org.apache.hudi.table.format.ParquetSplitRecordIterator
 
hasNext() - Method in class org.apache.hudi.table.format.SchemaEvolvedRecordIterator
 
hasNoSpecificReadCommits(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns true if there are no explicit start and end commits.
haveSuccessfulCommits(HoodieTableMetaClient) - Static method in class org.apache.hudi.util.StreamerUtil
Returns whether there are successful commits on the timeline.
heartbeatIntervalInMs(long) - Method in class org.apache.hudi.util.ClientIds.Builder
 
help - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
help - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
help - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
HIVE_CONF_DIR - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
 
HIVE_SITE_FILE - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
 
HIVE_STYLE_PARTITIONING - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_ASSUME_DATE_PARTITION - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_AUTO_CREATE_DB - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_CONF_DIR - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_DB - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_FILE_FORMAT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_IGNORE_EXCEPTIONS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_JDBC_URL - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_METASTORE_URIS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_MODE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_PARTITION_EXTRACTOR_CLASS_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_PARTITION_FIELDS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_PASSWORD - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_SKIP_RO_SUFFIX - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_SUPPORT_TIMESTAMP - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_TABLE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_TABLE_PROPERTIES - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_TABLE_SERDE_PROPERTIES - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_TABLE_STRATEGY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_USE_JDBC - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HIVE_SYNC_USERNAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
HiveSchemaUtils - Class in org.apache.hudi.table.catalog
Utilities for Hive field schema.
HiveSchemaUtils() - Constructor for class org.apache.hudi.table.catalog.HiveSchemaUtils
 
hiveStylePartitioning - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncAssumeDatePartition - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncAutoCreateDb - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
HiveSyncContext - Class in org.apache.hudi.sink.utils
Hive synchronization context.
hiveSyncDb - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncFileFormat - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncIgnoreExceptions - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncJdbcUrl - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncMetastoreUri - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncMode - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncPartitionExtractorClass - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncPartitionFields - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncPassword - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncSkipRoSuffix - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncSupportTimestamp - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncTable - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncTool() - Method in class org.apache.hudi.sink.utils.HiveSyncContext
 
hiveSyncUseJdbc - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
hiveSyncUsername - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
HoodieCatalog - Class in org.apache.hudi.table.catalog
Catalog that can set up common options for underneath table.
HoodieCatalog(String, Configuration) - Constructor for class org.apache.hudi.table.catalog.HoodieCatalog
 
HoodieCatalogFactory - Class in org.apache.hudi.table.catalog
A catalog factory impl that creates HoodieCatalog.
HoodieCatalogFactory() - Constructor for class org.apache.hudi.table.catalog.HoodieCatalogFactory
 
HoodieCatalogUtil - Class in org.apache.hudi.table.catalog
Utilities for Hoodie Catalog.
HoodieCatalogUtil() - Constructor for class org.apache.hudi.table.catalog.HoodieCatalogUtil
 
HoodieFlinkClusteringJob - Class in org.apache.hudi.sink.clustering
Flink hudi clustering program that can be executed manually.
HoodieFlinkClusteringJob(HoodieFlinkClusteringJob.AsyncClusteringService) - Constructor for class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob
 
HoodieFlinkClusteringJob.AsyncClusteringService - Class in org.apache.hudi.sink.clustering
Schedules clustering in service.
HoodieFlinkCompactor - Class in org.apache.hudi.sink.compact
Flink hudi compaction program that can be executed manually.
HoodieFlinkCompactor(HoodieFlinkCompactor.AsyncCompactionService) - Constructor for class org.apache.hudi.sink.compact.HoodieFlinkCompactor
 
HoodieFlinkCompactor.AsyncCompactionService - Class in org.apache.hudi.sink.compact
Schedules compaction in service.
HoodieFlinkMetrics - Class in org.apache.hudi.metrics
Base class for flink read/write metrics.
HoodieFlinkMetrics(MetricGroup) - Constructor for class org.apache.hudi.metrics.HoodieFlinkMetrics
 
HoodieFlinkStreamer - Class in org.apache.hudi.streamer
A utility which can incrementally consume data from Kafka and apply it to the target table.
HoodieFlinkStreamer() - Constructor for class org.apache.hudi.streamer.HoodieFlinkStreamer
 
HoodieHiveCatalog - Class in org.apache.hudi.table.catalog
A catalog implementation for Hoodie based on MetaStore.
HoodieHiveCatalog(String, Configuration) - Constructor for class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
HoodieHiveCatalog(String, Configuration, HiveConf, boolean) - Constructor for class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
HoodiePipeline - Class in org.apache.hudi.util
A tool class to construct hoodie flink pipeline.
HoodiePipeline() - Constructor for class org.apache.hudi.util.HoodiePipeline
 
HoodiePipeline.Builder - Class in org.apache.hudi.util
Builder for hudi source/sink pipeline construction.
HoodiePipeline.TableDescriptor - Class in org.apache.hudi.util
A POJO that contains tableId and resolvedCatalogTable.
hoodieStreamWrite(Configuration, DataStream<HoodieRecord>) - Static method in class org.apache.hudi.sink.utils.Pipelines
The streaming write pipeline.
hoodieTable - Variable in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
hoodieTable - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
HoodieTableFactory - Class in org.apache.hudi.table
Hoodie data source/sink factory.
HoodieTableFactory() - Constructor for class org.apache.hudi.table.HoodieTableFactory
 
HoodieTableSink - Class in org.apache.hudi.table
Hoodie table sink.
HoodieTableSink(Configuration, ResolvedSchema) - Constructor for class org.apache.hudi.table.HoodieTableSink
 
HoodieTableSink(Configuration, ResolvedSchema, boolean) - Constructor for class org.apache.hudi.table.HoodieTableSink
 
HoodieTableSource - Class in org.apache.hudi.table
Hoodie batch table source that always read the latest snapshot of the underneath table.
HoodieTableSource(ResolvedSchema, Path, List<String>, String, Configuration) - Constructor for class org.apache.hudi.table.HoodieTableSource
 
HoodieTableSource(ResolvedSchema, Path, List<String>, String, Configuration, List<ExpressionPredicates.Predicate>, DataPruner, PartitionPruners.PartitionPruner, int, int[], Long, HoodieTableMetaClient, InternalSchemaManager) - Constructor for class org.apache.hudi.table.HoodieTableSource
 

I

IDENTIFIER - Static variable in class org.apache.hudi.table.catalog.HoodieCatalogFactory
 
IGNORE_FAILED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
In() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.In
 
In() - Constructor for class org.apache.hudi.source.ExpressionPredicates.In
 
IncrementalInputSplits - Class in org.apache.hudi.source
Utilities to generate incremental input splits MergeOnReadInputSplit.
IncrementalInputSplits.Builder - Class in org.apache.hudi.source
IncrementalInputSplits.Result - Class in org.apache.hudi.source
index - Variable in class org.apache.hudi.source.ExpressionEvaluators.LeafEvaluator
 
INDEX_BOOTSTRAP_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
INDEX_BOOTSTRAP_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
INDEX_GLOBAL_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
INDEX_KEY_FIELD - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
INDEX_PARTITION_REGEX - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
INDEX_STATE_TTL - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
INDEX_TYPE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
indexBootstrapEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
indexBootstrapNum - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
indexGlobalEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
indexPartitionRegex - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
IndexRecord<T extends HoodieRecordPayload> - Class in org.apache.hudi.sink.bootstrap
The index record.
IndexRecord(HoodieRecord<T>) - Constructor for class org.apache.hudi.sink.bootstrap.IndexRecord
 
indexStateTtl - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
inferChangelogMode(Configuration, HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
Infers the changelog mode based on the data file schema(including metadata fields).
inferMetadataConf(Configuration, HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
Infers the metadata config based on the existence of metadata folder.
inferPartitionPath(boolean, CatalogPartitionSpec) - Static method in class org.apache.hudi.table.catalog.HoodieCatalogUtil
Returns the partition path with given CatalogPartitionSpec.
inferTablePath(String, ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
inferTablePath(ObjectPath, CatalogBaseTable) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
INIT_CLIENT_ID - Static variable in class org.apache.hudi.util.ClientIds
 
initialize(HoodieFlinkWriteClient) - Method in class org.apache.hudi.sink.clustering.update.strategy.FlinkConsistentBucketUpdateStrategy
 
initializeState(StateInitializationContext) - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
 
initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.sink.bucket.ConsistentBucketAssignFunction
 
initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.sink.CleanFunction
 
initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
 
initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.sink.partitioner.BucketAssignFunction
 
initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
 
initializeState(StateInitializationContext) - Method in class org.apache.hudi.source.StreamReadOperator
 
initIterator(MergeOnReadInputSplit) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat
 
initIterator(MergeOnReadInputSplit) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
initTableIfNotExists(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Initialize the table if it does not exist.
initTableIfNotExists(Configuration, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Initialize the table if it does not exist.
InputFormats - Class in org.apache.hudi.util
Utilities for all kinds of InputFormats.
InputFormats() - Constructor for class org.apache.hudi.util.InputFormats
 
inputSplits(HoodieTableMetaClient, boolean) - Method in class org.apache.hudi.source.IncrementalInputSplits
Returns the incremental input splits.
inputSplits(HoodieTableMetaClient, String, String, boolean) - Method in class org.apache.hudi.source.IncrementalInputSplits
Returns the incremental input splits.
INSERT_CLUSTER - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
insertCluster - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
insertClustering(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether insert clustering is allowed with given configuration conf.
instance(Configuration, RowType, int, String) - Static method in class org.apache.hudi.sink.bulk.AutoRowDataKeyGen
 
instance(Configuration, RowType) - Static method in class org.apache.hudi.sink.bulk.RowDataKeyGen
 
instance(Configuration, RowType, int, String) - Static method in class org.apache.hudi.sink.bulk.RowDataKeyGens
Creates a RowDataKeyGen with given configuration.
instance(Configuration, AbstractWriteOperator<I>) - Static method in class org.apache.hudi.sink.common.WriteOperatorFactory
 
instance(Configuration) - Static method in class org.apache.hudi.sink.utils.PayloadCreation
 
INSTANCE - Static variable in class org.apache.hudi.sink.utils.Pipelines.DummySink
 
instance(List<MergeOnReadInputSplit>, String) - Static method in class org.apache.hudi.source.IncrementalInputSplits.Result
 
instance(List<MergeOnReadInputSplit>, String, String) - Static method in class org.apache.hudi.source.IncrementalInputSplits.Result
 
instance(RowType, int[]) - Static method in class org.apache.hudi.util.RowDataProjection
 
instance(LogicalType[], int[]) - Static method in class org.apache.hudi.util.RowDataProjection
 
instanceV2(RowType, int[]) - Static method in class org.apache.hudi.util.RowDataProjection
 
instantRetryInterval - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
instantRetryTimes - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
INSTANTS - Static variable in interface org.apache.hudi.sink.compact.strategy.CompactionPlanStrategy
 
instantTime - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
instantTime(String) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
 
instantTimeDiffSeconds(String, String) - Static method in class org.apache.hudi.util.StreamerUtil
Returns the time interval in seconds between the given instant time.
instantToWrite(boolean) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Prepares the instant time to write with for next checkpoint.
InternalSchemaManager - Class in org.apache.hudi.table.format
This class is responsible for calculating names and types of fields that are actual at a certain point in time.
InternalSchemaManager(Configuration, InternalSchema, String, String) - Constructor for class org.apache.hudi.table.format.InternalSchemaManager
 
internalSchemaManager - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
internalSchemaManager(InternalSchemaManager) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
interval(long) - Method in class org.apache.hudi.sink.utils.TimeWait.Builder
 
invoke(ClusteringCommitEvent, SinkFunction.Context) - Method in class org.apache.hudi.sink.clustering.ClusteringCommitSink
 
invoke(CompactionCommitEvent, SinkFunction.Context) - Method in class org.apache.hudi.sink.compact.CompactionCommitSink
 
isAborted() - Method in class org.apache.hudi.sink.meta.CkpMessage
 
isAborted(String) - Method in class org.apache.hudi.sink.meta.CkpMetadata
 
isAlreadyBootstrap() - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
isAppendMode(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the insert is clustering disabled with given configuration conf.
isBootstrap() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
isBucketIndexType(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
 
isBucketToLoad(int, String) - Method in class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
Determine whether the current fileID belongs to the current task.
isBulkInsertOperation(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the table operation is 'bulk_insert'.
isCleaning - Variable in class org.apache.hudi.sink.CleanFunction
 
isClosed() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
isClusteringInstant(HoodieInstant, HoodieTimeline) - Static method in class org.apache.hudi.util.ClusteringUtil
Returns whether the given instant instant is with clustering operation.
isComplete() - Method in class org.apache.hudi.sink.meta.CkpMessage
 
isConfirming() - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
 
isConsistentHashingBucketIndexType(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the table index is consistent bucket index.
isConsistentLogicalTimestampEnabled(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether consistent value will be generated for a logical timestamp type column.
isConsumed() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
isCowTable(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether it is a COPY_ON_WRITE table.
isDatetimeType(DataType) - Static method in class org.apache.hudi.util.DataTypeUtils
Returns whether the given type is DATETIME type.
isDateType(DataType) - Static method in class org.apache.hudi.util.DataTypeUtils
Returns whether the given type is DATE type.
isDefaultHoodieRecordPayloadClazz(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the payload clazz is DefaultHoodieRecordPayload.
isDefaultValueDefined(Configuration, ConfigOption<T>) - Static method in class org.apache.hudi.configuration.FlinkOptions
Returns whether the given conf defines default value for the option option.
isDeltaTimeCompaction(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the compaction strategy is based on elapsed delta time.
isEmbeddedMetastore(HiveConf) - Static method in class org.apache.hudi.table.catalog.HoodieCatalogUtil
Check whether the hive.metastore.uris is empty
isEmitDelete(boolean) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
isEmpty() - Method in class org.apache.hudi.source.IncrementalInputSplits.Result
 
isEndInput() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
isEqualsLitExpr(ResolvedExpression, Set<String>) - Static method in class org.apache.hudi.util.ExpressionUtils
Returns whether the given expression resolvedExpr is a literal equivalence predicate within the fields fields.
isFailed() - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
isFailed() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
 
isFamily(LogicalType, LogicalTypeFamily) - Static method in class org.apache.hudi.util.DataTypeUtils
Returns whether the given logical type belongs to the family.
isFilteringByAllFields(List<ResolvedExpression>, Set<String>) - Static method in class org.apache.hudi.util.ExpressionUtils
Returns whether all the fields fields are involved in the filtering predicates.
isHeartbeatExpired(FileSystem, Path, long) - Static method in class org.apache.hudi.util.ClientIds
 
isHiveStylePartitioning(String) - Static method in class org.apache.hudi.table.format.FilePathUtils
 
isIncrementalQuery(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the query is incremental.
isInflight() - Method in class org.apache.hudi.sink.meta.CkpMessage
 
isInputSorted - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
isInsertOperation(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the table operation is 'insert'.
isInsertOverwrite(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the operation is INSERT OVERWRITE (table or partition).
isLastBatch() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
isLazyFailedWritesCleanPolicy(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
 
isLIFO(String) - Static method in class org.apache.hudi.util.CompactionUtil
Returns whether the execution sequence is LIFO.
isLockRequired(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the writer txn should be guarded by lock.
isMorTable(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether it is a MERGE_ON_READ table.
isMorTable(Map<String, String>) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether it is a MERGE_ON_READ table.
IsNotNull() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.IsNotNull
 
IsNull() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.IsNull
 
isOptimisticConcurrencyControl(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether OCC is enabled.
isPartitionedTable(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the table is partitioned.
isReadByTxnCompletionTime(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether to read the instants using completion time.
isReady(String) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
Returns whether the event is ready to commit.
isSchemaEvolutionEnabled(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether comprehensive schema evolution enabled.
isSimpleCallExpression(Expression) - Static method in class org.apache.hudi.util.ExpressionUtils
Returns whether the given expression is simple call expression: a binary call with one operand as field reference and another operand as literal.
isSpecificStartCommit(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the read start commit is specific commit timestamp.
isTimestampType(DataType) - Static method in class org.apache.hudi.util.DataTypeUtils
Returns whether the given type is TIMESTAMP type.
isValidFile(FileStatus) - Static method in class org.apache.hudi.util.StreamerUtil
Returns whether the give file is in valid hoodie format.
isWriteCommit(HoodieTableType, HoodieInstant, HoodieTimeline) - Static method in class org.apache.hudi.util.StreamerUtil
Returns whether the given instant is a data writing commit.

J

JsonDeserializationFunction - Class in org.apache.hudi.util
Wrapper function that manages the lifecycle of the JSON deserialization schema.
JsonDeserializationFunction(JsonRowDataDeserializationSchema) - Constructor for class org.apache.hudi.util.JsonDeserializationFunction
 

K

kafkaBootstrapServers - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
kafkaGroupId - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
kafkaTopic - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
keyGen - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
KEYGEN_CLASS_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
KEYGEN_TYPE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
keygenClass - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
keygenType - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 

L

lastBatch(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
 
lastPendingInstant() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
Returns the last pending instant time.
lastPendingInstant() - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Returns the last pending instant time.
lastPendingInstant() - Method in class org.apache.hudi.sink.meta.CkpMetadata
 
LeafEvaluator() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.LeafEvaluator
 
LessThan() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.LessThan
 
LessThan() - Constructor for class org.apache.hudi.source.ExpressionPredicates.LessThan
 
LessThanOrEqual() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.LessThanOrEqual
 
LessThanOrEqual() - Constructor for class org.apache.hudi.source.ExpressionPredicates.LessThanOrEqual
 
limit(long) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.Builder
 
limit - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
limit(long) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
listDatabases() - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
listDatabases() - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
listFunctions(String) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
listFunctions(String) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
listPartitions(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
listPartitions(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
listPartitions(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
listPartitions(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
listPartitionsByFilter(ObjectPath, List<Expression>) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
listPartitionsByFilter(ObjectPath, List<Expression>) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
listTables(String) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
listTables(String) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
listViews(String) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
listViews(String) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
literal - Variable in class org.apache.hudi.source.ExpressionPredicates.ColumnPredicate
 
literals - Variable in class org.apache.hudi.source.ExpressionPredicates.In
 
literalType - Variable in class org.apache.hudi.source.ExpressionPredicates.ColumnPredicate
 
loadFromProperties(String, Configuration) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
Read table options map from the given table base path.
loadFromProperties(String, Configuration) - Static method in class org.apache.hudi.util.ViewStorageProperties
Read the FileSystemViewStorageConfig with given table base path.
loadRecords(String) - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
Loads all the indices of give partition path into the backup state.
LOG - Static variable in class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
 
LOG - Static variable in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob
 
LOG - Static variable in class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
 
LOG - Static variable in class org.apache.hudi.sink.compact.HoodieFlinkCompactor
 
LogFileOnlyIterator(ClosableIterator<RowData>) - Constructor for class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.LogFileOnlyIterator
 
logScanner(MergeOnReadInputSplit, Schema, InternalSchema, Configuration, Configuration) - Static method in class org.apache.hudi.table.format.FormatUtils
 
logScanner(List<String>, Schema, String, HoodieWriteConfig, Configuration) - Static method in class org.apache.hudi.table.format.FormatUtils
 

M

main(String[]) - Static method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob
 
main(String[]) - Static method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor
 
main(String[]) - Static method in class org.apache.hudi.streamer.HoodieFlinkStreamer
 
map(I) - Method in class org.apache.hudi.sink.transform.RowDataToHoodieFunction
 
map(I) - Method in class org.apache.hudi.sink.transform.RowDataToHoodieFunctionWithRateLimit
 
map(String) - Method in class org.apache.hudi.util.JsonDeserializationFunction
 
maxCompactionMemoryInBytes(long) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
 
maxNumCompactionPlans - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
maxNumGroups - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
maxNumGroups - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
medianInstantTime(String, String) - Static method in class org.apache.hudi.util.StreamerUtil
Returns the median instant time between the given two instant time.
merge(BootstrapAccumulator) - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAccumulator
 
merge(BootstrapAccumulator, BootstrapAccumulator) - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAggFunction
 
MERGE_TYPE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
MergeIterator(Configuration, Configuration, MergeOnReadInputSplit, RowType, RowType, Schema, Schema, InternalSchema, int[], boolean, int, ClosableIterator<RowData>) - Constructor for class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.MergeIterator
 
MergeIterator(Configuration, Configuration, MergeOnReadInputSplit, RowType, RowType, Schema, InternalSchema, Option<RowDataProjection>, Option<Function<IndexedRecord, GenericRecord>>, boolean, int, ClosableIterator<RowData>) - Constructor for class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.MergeIterator
 
MergeOnReadInputFormat - Class in org.apache.hudi.table.format.mor
The base InputFormat class to read from Hoodie data + log files.
MergeOnReadInputFormat(Configuration, MergeOnReadTableState, List<DataType>, String, List<ExpressionPredicates.Predicate>, long, boolean, InternalSchemaManager) - Constructor for class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
MergeOnReadInputFormat.Builder - Class in org.apache.hudi.table.format.mor
MergeOnReadInputFormat.LogFileOnlyIterator - Class in org.apache.hudi.table.format.mor
 
MergeOnReadInputFormat.MergeIterator - Class in org.apache.hudi.table.format.mor
 
MergeOnReadInputSplit - Class in org.apache.hudi.table.format.mor
Represents an input split of source, actually a data bucket.
MergeOnReadInputSplit(int, String, Option<List<String>>, String, String, long, String, InstantRange, String) - Constructor for class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
MergeOnReadTableState - Class in org.apache.hudi.table.format.mor
Statistics for merge on read table source.
MergeOnReadTableState(RowType, RowType, String, String, List<MergeOnReadInputSplit>, String[]) - Constructor for class org.apache.hudi.table.format.mor.MergeOnReadTableState
 
mergeWith(WriteMetadataEvent) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
Merges this event with given WriteMetadataEvent other.
metaClient - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Meta Client.
metaClient - Variable in class org.apache.hudi.sink.partitioner.profile.WriteProfile
The meta client.
metaClientForReader(Configuration, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Creates the meta client for reader.
METADATA_COMPACTION_DELTA_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
METADATA_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
metadataCompactionDeltaCommits - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
metadataConfig(Configuration) - Static method in class org.apache.hudi.source.FileIndex
 
metadataEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
metricGroup - Variable in class org.apache.hudi.metrics.HoodieFlinkMetrics
 
minClusteringIntervalSeconds - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
minCompactionIntervalSeconds - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
MODE - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
 
monitorDirAndForwardSplits(SourceFunction.SourceContext<MergeOnReadInputSplit>) - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
 

N

NAME - Static variable in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAggFunction
 
name - Variable in class org.apache.hudi.source.ExpressionEvaluators.LeafEvaluator
 
needsAsyncClustering(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether there is need to schedule the async clustering.
needsAsyncCompaction(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether there is need to schedule the async compaction.
needsScheduleClustering(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether there is need to schedule the clustering plan.
needsScheduleCompaction(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether there is need to schedule the compaction plan.
newInstance() - Method in class org.apache.hudi.sink.bootstrap.IndexRecord
 
newInstance(List<ResolvedExpression>) - Static method in class org.apache.hudi.source.prune.DataPruner
 
next() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.LogFileOnlyIterator
 
next() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.MergeIterator
 
next() - Method in class org.apache.hudi.table.format.ParquetSplitRecordIterator
 
next() - Method in class org.apache.hudi.table.format.SchemaEvolvedRecordIterator
 
nextId(Configuration) - Method in class org.apache.hudi.util.ClientIds
 
nextRecord(RowData) - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
 
nextRecord(RowData) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
NO_PRE_COMBINE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
NON_OPTION_KEYS - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
 
NonThrownExecutor - Class in org.apache.hudi.sink.utils
An executor service that catches all the throwable with logging.
NonThrownExecutor(Logger, NonThrownExecutor.ExceptionHook, boolean) - Constructor for class org.apache.hudi.sink.utils.NonThrownExecutor
 
NonThrownExecutor.Builder - Class in org.apache.hudi.sink.utils
Builder for NonThrownExecutor.
NonThrownExecutor.ExceptionHook - Interface in org.apache.hudi.sink.utils
The exception hook.
Not() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.Not
 
Not() - Constructor for class org.apache.hudi.source.ExpressionPredicates.Not
 
NotEquals() - Constructor for class org.apache.hudi.source.ExpressionPredicates.NotEquals
 
NotEqualTo() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.NotEqualTo
 
notifyCheckpointComplete(long) - Method in class org.apache.hudi.sink.CleanFunction
 
notifyCheckpointComplete(long) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanOperator
 
notifyCheckpointComplete(long) - Method in class org.apache.hudi.sink.compact.CompactionPlanOperator
 
notifyCheckpointComplete(long) - Method in class org.apache.hudi.sink.partitioner.BucketAssignFunction
 
notifyCheckpointComplete(long) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
NullFalseEvaluator() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.NullFalseEvaluator
 
NUM_AND_TIME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
NUM_AND_TIME - Static variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
NUM_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
NUM_COMMITS - Static variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
NUM_INSTANTS - Static variable in interface org.apache.hudi.sink.compact.strategy.CompactionPlanStrategy
 
NUM_OR_TIME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
NUM_OR_TIME - Static variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
numTolerableHeartbeatMisses(int) - Method in class org.apache.hudi.util.ClientIds.Builder
 

O

open() - Method in class org.apache.hudi.sink.bootstrap.batch.BatchBootstrapOperator
 
open(Configuration) - Method in class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
 
open(Configuration) - Method in class org.apache.hudi.sink.bucket.ConsistentBucketAssignFunction
 
open(Configuration) - Method in class org.apache.hudi.sink.bucket.ConsistentBucketStreamWriteFunction
 
open(Configuration) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
 
open() - Method in class org.apache.hudi.sink.bulk.sort.SortOperator
 
open(Configuration) - Method in class org.apache.hudi.sink.CleanFunction
 
open(Configuration) - Method in class org.apache.hudi.sink.clustering.ClusteringCommitSink
 
open() - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
 
open() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanOperator
 
open(Configuration) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
 
open(Configuration) - Method in class org.apache.hudi.sink.compact.CompactionCommitSink
 
open() - Method in class org.apache.hudi.sink.compact.CompactionPlanOperator
 
open(Configuration) - Method in class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
 
open() - Method in class org.apache.hudi.sink.compact.CompactOperator
 
open(Configuration) - Method in class org.apache.hudi.sink.partitioner.BucketAssignFunction
 
open(Configuration) - Method in class org.apache.hudi.sink.StreamWriteFunction
 
open(Configuration) - Method in class org.apache.hudi.sink.transform.RowDataToHoodieFunction
 
open(Configuration) - Method in class org.apache.hudi.sink.transform.RowDataToHoodieFunctionWithRateLimit
 
open() - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
open() - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
open(FileInputSplit) - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
 
open(MergeOnReadInputSplit) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
open(Configuration) - Method in class org.apache.hudi.util.JsonDeserializationFunction
 
OPERATION - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
operation - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
opName(String, Configuration) - Static method in class org.apache.hudi.sink.utils.Pipelines
 
option(ConfigOption<?>, Object) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
Add a config option.
option(String, Object) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
 
optionalOptions() - Static method in class org.apache.hudi.configuration.FlinkOptions
Returns all the optional config options.
optionalOptions() - Method in class org.apache.hudi.table.catalog.HoodieCatalogFactory
 
optionalOptions() - Method in class org.apache.hudi.table.HoodieTableFactory
 
options(Map<String, String>) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
 
OptionsInference - Class in org.apache.hudi.configuration
Tool helping to infer the flink options FlinkOptions.
OptionsInference() - Constructor for class org.apache.hudi.configuration.OptionsInference
 
OptionsResolver - Class in org.apache.hudi.configuration
Tool helping to resolve the flink options FlinkOptions.
OptionsResolver() - Constructor for class org.apache.hudi.configuration.OptionsResolver
 
opUID(String, Configuration) - Static method in class org.apache.hudi.sink.utils.Pipelines
 
Or() - Constructor for class org.apache.hudi.source.ExpressionEvaluators.Or
 
Or() - Constructor for class org.apache.hudi.source.ExpressionPredicates.Or
 
org.apache.hudi.configuration - package org.apache.hudi.configuration
 
org.apache.hudi.metrics - package org.apache.hudi.metrics
 
org.apache.hudi.schema - package org.apache.hudi.schema
 
org.apache.hudi.sink - package org.apache.hudi.sink
 
org.apache.hudi.sink.append - package org.apache.hudi.sink.append
 
org.apache.hudi.sink.bootstrap - package org.apache.hudi.sink.bootstrap
 
org.apache.hudi.sink.bootstrap.aggregate - package org.apache.hudi.sink.bootstrap.aggregate
 
org.apache.hudi.sink.bootstrap.batch - package org.apache.hudi.sink.bootstrap.batch
 
org.apache.hudi.sink.bucket - package org.apache.hudi.sink.bucket
 
org.apache.hudi.sink.bulk - package org.apache.hudi.sink.bulk
 
org.apache.hudi.sink.bulk.sort - package org.apache.hudi.sink.bulk.sort
 
org.apache.hudi.sink.clustering - package org.apache.hudi.sink.clustering
 
org.apache.hudi.sink.clustering.update.strategy - package org.apache.hudi.sink.clustering.update.strategy
 
org.apache.hudi.sink.common - package org.apache.hudi.sink.common
 
org.apache.hudi.sink.compact - package org.apache.hudi.sink.compact
 
org.apache.hudi.sink.compact.strategy - package org.apache.hudi.sink.compact.strategy
 
org.apache.hudi.sink.event - package org.apache.hudi.sink.event
 
org.apache.hudi.sink.meta - package org.apache.hudi.sink.meta
 
org.apache.hudi.sink.overwrite - package org.apache.hudi.sink.overwrite
 
org.apache.hudi.sink.partitioner - package org.apache.hudi.sink.partitioner
 
org.apache.hudi.sink.partitioner.profile - package org.apache.hudi.sink.partitioner.profile
 
org.apache.hudi.sink.transform - package org.apache.hudi.sink.transform
 
org.apache.hudi.sink.utils - package org.apache.hudi.sink.utils
 
org.apache.hudi.source - package org.apache.hudi.source
 
org.apache.hudi.source.prune - package org.apache.hudi.source.prune
 
org.apache.hudi.source.stats - package org.apache.hudi.source.stats
 
org.apache.hudi.streamer - package org.apache.hudi.streamer
 
org.apache.hudi.table - package org.apache.hudi.table
 
org.apache.hudi.table.catalog - package org.apache.hudi.table.catalog
 
org.apache.hudi.table.format - package org.apache.hudi.table.format
 
org.apache.hudi.table.format.cdc - package org.apache.hudi.table.format.cdc
 
org.apache.hudi.table.format.cow - package org.apache.hudi.table.format.cow
 
org.apache.hudi.table.format.mor - package org.apache.hudi.table.format.mor
 
org.apache.hudi.util - package org.apache.hudi.util
 
overwriteDynamicPartition(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the operation is INSERT OVERWRITE dynamic partition.

P

parquetPageSize - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
ParquetSplitRecordIterator - Class in org.apache.hudi.table.format
Hoodie wrapper for flink parquet reader.
ParquetSplitRecordIterator(ParquetColumnarRowSplitReader) - Constructor for class org.apache.hudi.table.format.ParquetSplitRecordIterator
 
partition(HoodieKey, int) - Method in class org.apache.hudi.sink.partitioner.BucketIndexPartitioner
 
partition(String...) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
Add partition fields.
PARTITION_COLUMNS - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
 
PARTITION_DEFAULT_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
PARTITION_FORMAT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
PARTITION_FORMAT_DASHED_DAY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
PARTITION_FORMAT_DAY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
PARTITION_FORMAT_HOUR - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
PARTITION_PATH_FIELD - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
partitionDefaultName - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
partitionExists(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
partitionExists(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
partitionExists(String, String, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Returns whether the hoodie partition exists under given table path tablePath and partition path partitionPath.
PartitionOverwriteMode - Enum in org.apache.hudi.sink.overwrite
Mode of INSERT OVERWRITE partitioned table.
partitionPath2ReadPath(Path, List<String>, List<Map<String, String>>, boolean) - Static method in class org.apache.hudi.table.format.FilePathUtils
Transforms the given partition key value mapping to read paths.
partitionPathField - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
partitionPruner(PartitionPruners.PartitionPruner) - Method in class org.apache.hudi.source.FileIndex.Builder
 
partitionPruner(PartitionPruners.PartitionPruner) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
 
PartitionPruners - Class in org.apache.hudi.source.prune
Tools to prune partitions.
PartitionPruners() - Constructor for class org.apache.hudi.source.prune.PartitionPruners
 
PartitionPruners.DynamicPartitionPruner - Class in org.apache.hudi.source.prune
Dynamic partition pruner for hoodie table source which partitions list is available in runtime phase.
PartitionPruners.PartitionPruner - Interface in org.apache.hudi.source.prune
 
PartitionPruners.StaticPartitionPruner - Class in org.apache.hudi.source.prune
Static partition pruner for hoodie table source which partitions list is available in compile phase.
partitionRegexPattern - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
partitionRegexPattern - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
partitionSelected - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
partitionSelected - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
PATH - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
path - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
path - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
path - Variable in class org.apache.hudi.sink.meta.CkpMetadata
 
path(Path) - Method in class org.apache.hudi.source.FileIndex.Builder
 
path(Path) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
 
PAYLOAD_CLASS_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
payloadClassName - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
PayloadCreation - Class in org.apache.hudi.sink.utils
Util to create hoodie pay load instance.
Pipelines - Class in org.apache.hudi.sink.utils
Utilities to generate all kinds of sub-pipelines.
Pipelines() - Constructor for class org.apache.hudi.sink.utils.Pipelines
 
Pipelines.DummySink - Class in org.apache.hudi.sink.utils
Dummy sink that does nothing.
pk(String...) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
Add primary keys.
PK_COLUMNS - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
 
PK_CONSTRAINT_NAME - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
 
planPartitionFilterMode - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
planPartitionFilterMode - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
planStrategyClass - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
planStrategyClass - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
PRE_COMBINE - Static variable in class org.apache.hudi.configuration.FlinkOptions
Flag to indicate whether to drop duplicates before insert/upsert.
precision(LogicalType) - Static method in class org.apache.hudi.util.DataTypeUtils
Returns the precision of the given TIMESTAMP type.
preCombine - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
PRECOMBINE_FIELD - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
predicates(List<ExpressionPredicates.Predicate>) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.Builder
 
predicates - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
predicates(List<ExpressionPredicates.Predicate>) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
preLoadIndexRecords() - Method in class org.apache.hudi.sink.bootstrap.batch.BatchBootstrapOperator
 
preLoadIndexRecords() - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
preserveHoodieMetadata - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
preWrite(List<HoodieRecord>) - Method in class org.apache.hudi.sink.StreamWriteFunction.DataBucket
Sets up before flush: patch up the first record with correct partition path and fileID.
PrimaryKeyPruners - Class in org.apache.hudi.source.prune
Utilities for primary key based file pruning.
PrimaryKeyPruners() - Constructor for class org.apache.hudi.source.prune.PrimaryKeyPruners
 
processElement(I, ProcessFunction<I, Object>.Context, Collector<Object>) - Method in class org.apache.hudi.sink.append.AppendWriteFunction
 
processElement(StreamRecord<I>) - Method in class org.apache.hudi.sink.bootstrap.batch.BatchBootstrapOperator
 
processElement(StreamRecord<I>) - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
processElement(I, ProcessFunction<I, Object>.Context, Collector<Object>) - Method in class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
 
processElement(HoodieRecord, ProcessFunction<HoodieRecord, HoodieRecord>.Context, Collector<HoodieRecord>) - Method in class org.apache.hudi.sink.bucket.ConsistentBucketAssignFunction
 
processElement(I, ProcessFunction<I, Object>.Context, Collector<Object>) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
 
processElement(StreamRecord<RowData>) - Method in class org.apache.hudi.sink.bulk.sort.SortOperator
 
processElement(StreamRecord<ClusteringPlanEvent>) - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
 
processElement(StreamRecord<Object>) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanOperator
 
processElement(StreamRecord<Object>) - Method in class org.apache.hudi.sink.compact.CompactionPlanOperator
 
processElement(StreamRecord<CompactionPlanEvent>) - Method in class org.apache.hudi.sink.compact.CompactOperator
 
processElement(I, KeyedProcessFunction<K, I, O>.Context, Collector<O>) - Method in class org.apache.hudi.sink.partitioner.BucketAssignFunction
 
processElement(I, ProcessFunction<I, Object>.Context, Collector<Object>) - Method in class org.apache.hudi.sink.StreamWriteFunction
 
processElement(StreamRecord<MergeOnReadInputSplit>) - Method in class org.apache.hudi.source.StreamReadOperator
 
processWatermark(Watermark) - Method in class org.apache.hudi.source.StreamReadOperator
 
project(RowData) - Method in class org.apache.hudi.util.RowDataProjection
Returns the projected row data.
projectAsValues(RowData) - Method in class org.apache.hudi.util.RowDataProjection
Returns the projected values array.
projectRowFields(RowType, String[]) - Static method in class org.apache.hudi.util.DataTypeUtils
Projects the row fields with given names.
propsFilePath - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
propsFilePath - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
propsFilePath - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
Provider(OperatorID, Configuration) - Constructor for class org.apache.hudi.sink.StreamWriteOperatorCoordinator.Provider
 

Q

QUERY_TYPE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
QUERY_TYPE_INCREMENTAL - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
QUERY_TYPE_READ_OPTIMIZED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
QUERY_TYPE_SNAPSHOT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 

R

reachedEnd() - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
 
reachedEnd() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
READ_AS_STREAMING - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
READ_DATA_SKIPPING_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
READ_END_COMMIT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
READ_START_COMMIT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
READ_STREAMING_CHECK_INTERVAL - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
READ_STREAMING_SKIP_CLUSTERING - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
READ_STREAMING_SKIP_COMPACT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
READ_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
readColumnStatsIndex(String, HoodieMetadataConfig, String[]) - Static method in class org.apache.hudi.source.stats.ColumnStatsIndices
 
readConfig(Configuration, Path, List<String>) - Static method in class org.apache.hudi.util.StreamerUtil
Read config from properties file (`--props` option) and cmd line (`--hoodie-conf` option).
readyTaskNum() - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAccumulator
 
REALTIME_PAYLOAD_COMBINE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
REALTIME_SKIP_MERGE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
RECORD_KEY_FIELD - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
RECORD_MERGER_IMPLS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
RECORD_MERGER_STRATEGY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
RecordIterators - Class in org.apache.hudi.table.format
Factory clazz for record iterators.
RecordIterators() - Constructor for class org.apache.hudi.table.format.RecordIterators
 
recordKeyField - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
recordMergerImpls - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
recordMergerStrategy - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
referencedColumns(List<ResolvedExpression>) - Static method in class org.apache.hudi.util.ExpressionUtils
Collect the referenced columns with given expressions, only simple call expression is supported.
registerMetrics() - Method in class org.apache.hudi.metrics.FlinkCompactionMetrics
 
registerMetrics() - Method in class org.apache.hudi.metrics.FlinkStreamReadMetrics
 
registerMetrics() - Method in class org.apache.hudi.metrics.FlinkWriteMetrics
 
registerMetrics() - Method in class org.apache.hudi.metrics.HoodieFlinkMetrics
 
reload(long) - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
Refresh the table state like TableFileSystemView and HoodieTimeline.
reload(long) - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
Reload the write profile, should do once for each checkpoint.
renameTable(ObjectPath, String, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
renameTable(ObjectPath, String, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
requiredOptions() - Method in class org.apache.hudi.table.catalog.HoodieCatalogFactory
 
requiredOptions() - Method in class org.apache.hudi.table.HoodieTableFactory
 
reset() - Method in class org.apache.hudi.sink.clustering.update.strategy.FlinkConsistentBucketUpdateStrategy
 
reset() - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
Reset the states of this assigner, should do once for each checkpoint, all the states are accumulated within one checkpoint interval.
reset() - Method in class org.apache.hudi.sink.StreamWriteFunction.DataBucket
 
reset() - Method in class org.apache.hudi.source.FileIndex
Reset the state of the file index.
reset() - Method in class org.apache.hudi.table.HoodieTableSource
Reset the state of the table source.
resetToCheckpoint(long, byte[]) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
resolvePartition(String, DataType) - Static method in class org.apache.hudi.util.DataTypeUtils
Resolves the partition path string into value obj with given data type.
RETRY_INTERVAL_MS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
RETRY_TIMES - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
rollbackClustering(HoodieFlinkTable<?>, HoodieFlinkWriteClient) - Static method in class org.apache.hudi.util.ClusteringUtil
Force rolls back all the inflight clustering instants, especially for job failover restart.
rollbackClustering(HoodieFlinkTable<?>, HoodieFlinkWriteClient<?>, String) - Static method in class org.apache.hudi.util.ClusteringUtil
Force rolls back the inflight clustering instant, for handling failure case.
rollbackCompaction(HoodieFlinkTable<?>, String) - Static method in class org.apache.hudi.util.CompactionUtil
 
rollbackCompaction(HoodieFlinkTable<?>) - Static method in class org.apache.hudi.util.CompactionUtil
Force rolls back all the inflight compaction instants, especially for job failover restart.
rollbackEarliestCompaction(HoodieFlinkTable<?>, Configuration) - Static method in class org.apache.hudi.util.CompactionUtil
Rolls back the earliest compaction if there exists.
RowDataCastProjection - Class in org.apache.hudi.util
This class is responsible to project row as well as RowDataProjection.
RowDataCastProjection(LogicalType[], CastMap) - Constructor for class org.apache.hudi.util.RowDataCastProjection
 
RowDataKeyGen - Class in org.apache.hudi.sink.bulk
Key generator for RowData.
RowDataKeyGen(Option<String>, String, RowType, boolean, boolean, boolean, Option<TimestampBasedAvroKeyGenerator>) - Constructor for class org.apache.hudi.sink.bulk.RowDataKeyGen
 
RowDataKeyGens - Class in org.apache.hudi.sink.bulk
Factory class for all kinds of RowDataKeyGen.
RowDataKeyGens() - Constructor for class org.apache.hudi.sink.bulk.RowDataKeyGens
 
RowDataProjection - Class in org.apache.hudi.util
Utilities to project the row data with given positions.
RowDataProjection(LogicalType[], int[]) - Constructor for class org.apache.hudi.util.RowDataProjection
 
RowDataToAvroConverters - Class in org.apache.hudi.util
Tool class used to convert from RowData to Avro GenericRecord.
RowDataToAvroConverters() - Constructor for class org.apache.hudi.util.RowDataToAvroConverters
 
RowDataToAvroConverters.RowDataToAvroConverter - Interface in org.apache.hudi.util
Runtime converter that converts objects of Flink Table & SQL internal data structures to corresponding Avro data structures.
RowDataToHoodieFunction<I extends org.apache.flink.table.data.RowData,O extends HoodieRecord> - Class in org.apache.hudi.sink.transform
Function that transforms RowData to HoodieRecord.
RowDataToHoodieFunction(RowType, Configuration) - Constructor for class org.apache.hudi.sink.transform.RowDataToHoodieFunction
 
RowDataToHoodieFunctions - Class in org.apache.hudi.sink.transform
RowDataToHoodieFunctionWithRateLimit<I extends org.apache.flink.table.data.RowData,O extends HoodieRecord> - Class in org.apache.hudi.sink.transform
Function that transforms RowData to a HoodieRecord with RateLimit.
RowDataToHoodieFunctionWithRateLimit(RowType, Configuration) - Constructor for class org.apache.hudi.sink.transform.RowDataToHoodieFunctionWithRateLimit
 
rowDataToHoodieRecord(Configuration, RowType, DataStream<RowData>) - Static method in class org.apache.hudi.sink.utils.Pipelines
Transforms the row data to hoodie records.
rowType - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
rowType(RowType) - Method in class org.apache.hudi.source.FileIndex.Builder
 
rowType(RowType) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
 
rowTypeWithFileId(RowType) - Static method in class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
 
rowWithFileId(Map<String, String>, RowDataKeyGen, RowData, String, int) - Static method in class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
 
run(SourceFunction.SourceContext<ClusteringPlanEvent>) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
 
run(SourceFunction.SourceContext) - Method in class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
 
run(SourceFunction.SourceContext<MergeOnReadInputSplit>) - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
 

S

schedule - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
schedule - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
scheduleClustering(Configuration, HoodieFlinkWriteClient, boolean) - Static method in class org.apache.hudi.util.ClusteringUtil
Schedules clustering plan by condition.
scheduleCompaction(HoodieTableMetaClient, HoodieFlinkWriteClient<?>, boolean, boolean) - Static method in class org.apache.hudi.util.CompactionUtil
Schedules a new compaction instant.
schema(Schema) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
Add table schema.
SchemaEvolvedRecordIterator - Class in org.apache.hudi.table.format
Decorates origin record iterator with cast projection.
SchemaEvolvedRecordIterator(ClosableIterator<RowData>, RowDataProjection) - Constructor for class org.apache.hudi.table.format.SchemaEvolvedRecordIterator
 
SchemaProvider - Class in org.apache.hudi.schema
Class to provide schema for reading data and also writing into a Hoodie table.
SchemaProvider() - Constructor for class org.apache.hudi.schema.SchemaProvider
 
SchemaRegistryProvider - Class in org.apache.hudi.schema
Obtains latest schema from the Confluent/Kafka schema-registry.
SchemaRegistryProvider(TypedProperties) - Constructor for class org.apache.hudi.schema.SchemaRegistryProvider
 
SchemaRegistryProvider.Config - Class in org.apache.hudi.schema
Configs supported.
searchPartKeyValueAndPaths(FileSystem, Path, boolean, String[]) - Static method in class org.apache.hudi.table.format.FilePathUtils
Search all partitions in this path.
select(HoodieTimeline) - Method in interface org.apache.hudi.sink.compact.strategy.CompactionPlanStrategy
Define how to select compaction plan to compact.
sendBootstrapEvent() - Method in class org.apache.hudi.sink.append.AppendWriteFunction
 
sendBootstrapEvent() - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
 
SEQ_FIFO - Static variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
SEQ_FIFO - Static variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
SEQ_LIFO - Static variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
SEQ_LIFO - Static variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
serviceMode - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
serviceMode - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
setAuthorizationHeader(String, HttpURLConnection) - Method in class org.apache.hudi.schema.SchemaRegistryProvider
 
setAvroSchema(Configuration, HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
Sets up the avro schema string into the give configuration conf through reading from the hoodie table metadata.
setAvroSchema(HoodieWriteConfig, HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
Sets up the avro schema string into the HoodieWriteConfig HoodieWriteConfig through reading from the hoodie table metadata.
setBootstrap(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
setChanges(HoodieCDCFileSplit[]) - Method in class org.apache.hudi.table.format.cdc.CdcInputSplit
 
setCheckpointId(long) - Method in class org.apache.hudi.sink.event.CommitAckEvent
 
setClusteringGroupInfo(ClusteringGroupInfo) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
 
setClusteringInstantTime(String) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
 
setCompactionInstantTime(String) - Method in class org.apache.hudi.sink.compact.CompactionPlanEvent
 
setEndInput(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
setExecutor(NonThrownExecutor) - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
 
setExecutor(NonThrownExecutor) - Method in class org.apache.hudi.sink.compact.CompactOperator
 
setExecutor(NonThrownExecutor) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
setFileFieldTypes(DataType[]) - Method in class org.apache.hudi.table.format.CastMap
 
setFileId(String) - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
 
setFileId(String) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
setFilesFilter(FilePathFilter) - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
 
setFirstPendingCompactionInstant(Option<HoodieInstant>) - Method in class org.apache.hudi.metrics.FlinkCompactionMetrics
 
setInstant(String) - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
setInstant(String) - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
 
setInstantTime(String) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
setIssuedInstant(String) - Method in class org.apache.hudi.metrics.FlinkStreamReadMetrics
 
setLastBatch(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
setOperation(CompactionOperation) - Method in class org.apache.hudi.sink.compact.CompactionPlanEvent
 
setOperatorEventGateway(OperatorEventGateway) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
 
setOperatorEventGateway(OperatorEventGateway) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
 
setOperatorEventGateway(OperatorEventGateway) - Method in class org.apache.hudi.sink.common.AbstractWriteFunction
Sets up the event gateway.
setOperatorEventGateway(OperatorEventGateway) - Method in class org.apache.hudi.sink.common.AbstractWriteOperator
 
setOutput(Output<StreamRecord<ClusteringCommitEvent>>) - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
 
setOutput(Output<StreamRecord<ClusteringPlanEvent>>) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanOperator
 
setOutput(Output<StreamRecord<CompactionPlanEvent>>) - Method in class org.apache.hudi.sink.compact.CompactionPlanOperator
 
setPendingCompactionCount(int) - Method in class org.apache.hudi.metrics.FlinkCompactionMetrics
 
setPreCombineField(Configuration, HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
Sets up the preCombine field into the given configuration conf through reading from the hoodie table metadata.
setRowKind(RowData, IndexedRecord, int) - Static method in class org.apache.hudi.table.format.FormatUtils
Sets up the row kind to the row data rowData from the resolved operation.
setSplitLatestCommit(String) - Method in class org.apache.hudi.metrics.FlinkStreamReadMetrics
 
setStrategyParams(Map<String, String>) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
 
setTaskID(int) - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
setTaskID(int) - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
 
setTaskID(int) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
setup(StreamTask<?, ?>, StreamConfig, Output<StreamRecord<ClusteringCommitEvent>>) - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
 
setup(StreamTask<?, ?>, StreamConfig, Output<StreamRecord<CompactionCommitEvent>>) - Method in class org.apache.hudi.sink.compact.CompactOperator
 
setupClientId(Configuration) - Static method in class org.apache.hudi.configuration.OptionsInference
Utilities that help to auto generate the client id for multi-writer scenarios.
setupSinkTasks(Configuration, int) - Static method in class org.apache.hudi.configuration.OptionsInference
Sets up the default sink tasks parallelism if it is not specified.
setupSourceTasks(Configuration, int) - Static method in class org.apache.hudi.configuration.OptionsInference
Sets up the default source task parallelism if it is not specified.
setupTimestampKeygenOptions(Configuration, DataType) - Static method in class org.apache.hudi.table.HoodieTableFactory
Sets up the keygen options when the partition path is datetime type.
setWriteStatuses(List<WriteStatus>) - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
 
setWriteStatuses(List<WriteStatus>) - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
 
setWriteStatuses(List<WriteStatus>) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
shouldLoadFile(String, int, int, int) - Method in class org.apache.hudi.sink.bootstrap.batch.BatchBootstrapOperator
 
shouldLoadFile(String, int, int, int) - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
shutDown() - Method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob.AsyncClusteringService
 
shutDown() - Method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor.AsyncCompactionService
 
shutdownAsyncService(boolean) - Method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob.AsyncClusteringService
Shutdown async services like compaction/clustering as DeltaSync is shutdown.
shutdownAsyncService(boolean) - Method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor.AsyncCompactionService
Shutdown async services like compaction/clustering as DeltaSync is shutdown.
singleton(boolean, boolean, HoodieWriteConfig, HoodieFlinkEngineContext) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
 
sink(DataStream<RowData>, boolean) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
 
skipBytesToRead(int) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.BytesArrayInputView
 
skipBytesToWrite(int) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.BytesArrayOutputView
 
skipClustering(boolean) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
 
skipCompaction(boolean) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
 
skipFromLatestPartitions - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
skipFromLatestPartitions - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
smallFileLimit - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
smallFileLimit - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
smallFilesOfThisTask(List<SmallFile>) - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
 
smallFilesProfile(String) - Method in class org.apache.hudi.sink.partitioner.profile.DeltaWriteProfile
 
smallFilesProfile(String) - Method in class org.apache.hudi.sink.partitioner.profile.EmptyWriteProfile
 
smallFilesProfile(String) - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
Returns a list of small files in the given partition path from the latest filesystem view.
snapshotState() - Method in class org.apache.hudi.sink.append.AppendWriteFunction
 
snapshotState(StateSnapshotContext) - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
snapshotState() - Method in class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
 
snapshotState(FunctionSnapshotContext) - Method in class org.apache.hudi.sink.bucket.ConsistentBucketAssignFunction
 
snapshotState() - Method in class org.apache.hudi.sink.bucket.ConsistentBucketStreamWriteFunction
 
snapshotState(FunctionSnapshotContext) - Method in class org.apache.hudi.sink.CleanFunction
 
snapshotState(FunctionSnapshotContext) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
 
snapshotState() - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
 
snapshotState(FunctionSnapshotContext) - Method in class org.apache.hudi.sink.partitioner.BucketAssignFunction
 
snapshotState() - Method in class org.apache.hudi.sink.StreamWriteFunction
 
snapshotState(FunctionSnapshotContext) - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
 
snapshotState(StateSnapshotContext) - Method in class org.apache.hudi.source.StreamReadOperator
 
sortClusteringEnabled(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
Returns whether the clustering sort is enabled.
sortColumns - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
sortColumns - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
sortMemory - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
sortMemory - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
SortOperator - Class in org.apache.hudi.sink.bulk.sort
Operator for batch sort.
SortOperator(GeneratedNormalizedKeyComputer, GeneratedRecordComparator, Configuration) - Constructor for class org.apache.hudi.sink.bulk.sort.SortOperator
 
SortOperatorGen - Class in org.apache.hudi.sink.bulk.sort
Tools to generate the sort operator.
SortOperatorGen(RowType, String[]) - Constructor for class org.apache.hudi.sink.bulk.sort.SortOperatorGen
 
source(StreamExecutionEnvironment) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
 
SOURCE_AVRO_SCHEMA - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
SOURCE_AVRO_SCHEMA_PATH - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
sourceAvroSchema - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
sourceAvroSchemaPath - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
sourceOrderingField - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
SPARK_SOURCE_PROVIDER - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
 
SPARK_VERSION - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
 
spillableMap(HoodieWriteConfig, long) - Static method in class org.apache.hudi.table.format.FormatUtils
 
spillableMapPath - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
splitExprByPartitionCall(List<ResolvedExpression>, List<String>, RowType) - Static method in class org.apache.hudi.util.ExpressionUtils
Extracts partition predicate from filter condition.
splitSchemaByPartitionKeys(List<FieldSchema>, List<String>) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
Split the field schemas by given partition keys.
start(boolean) - Method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob
Main method to start clustering service.
start(boolean) - Method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor
Main method to start compaction service.
start() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
start() - Method in class org.apache.hudi.util.ClientIds
 
START_COMMIT_EARLIEST - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
startCompaction() - Method in class org.apache.hudi.metrics.FlinkCompactionMetrics
 
startInstant(String) - Method in class org.apache.hudi.sink.meta.CkpMetadata
 
startService() - Method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob.AsyncClusteringService
 
startService() - Method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor.AsyncCompactionService
 
startTimer(String) - Method in class org.apache.hudi.metrics.HoodieFlinkMetrics
 
stateBackend - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
stopTimer(String) - Method in class org.apache.hudi.metrics.HoodieFlinkMetrics
 
StreamerUtil - Class in org.apache.hudi.util
Utilities for Flink stream read and write.
StreamerUtil() - Constructor for class org.apache.hudi.util.StreamerUtil
 
StreamReadMonitoringFunction - Class in org.apache.hudi.source
This is the single (non-parallel) monitoring task which takes a MergeOnReadInputSplit , it is responsible for: Monitoring a user-provided hoodie table path. Deciding which files(or split) should be further read and processed. Creating the splits corresponding to those files. Assigning them to downstream tasks for further processing.
StreamReadMonitoringFunction(Configuration, Path, RowType, long, PartitionPruners.PartitionPruner) - Constructor for class org.apache.hudi.source.StreamReadMonitoringFunction
 
StreamReadOperator - Class in org.apache.hudi.source
The operator that reads the splits received from the preceding StreamReadMonitoringFunction.
StreamWriteFunction<I> - Class in org.apache.hudi.sink
Sink function to write the data to the underneath filesystem.
StreamWriteFunction(Configuration) - Constructor for class org.apache.hudi.sink.StreamWriteFunction
Constructs a StreamingSinkFunction.
StreamWriteFunction.DataBucket - Class in org.apache.hudi.sink
Data bucket.
StreamWriteOperator<I> - Class in org.apache.hudi.sink
Operator for StreamSink.
StreamWriteOperator(Configuration) - Constructor for class org.apache.hudi.sink.StreamWriteOperator
 
StreamWriteOperatorCoordinator - Class in org.apache.hudi.sink
OperatorCoordinator for StreamWriteFunction.
StreamWriteOperatorCoordinator(Configuration, OperatorCoordinator.Context) - Constructor for class org.apache.hudi.sink.StreamWriteOperatorCoordinator
Constructs a StreamingSinkOperatorCoordinator.
StreamWriteOperatorCoordinator.Provider - Class in org.apache.hudi.sink
StringToRowDataConverter - Class in org.apache.hudi.util
A converter that converts a string array into internal row data fields.
StringToRowDataConverter(LogicalType[]) - Constructor for class org.apache.hudi.util.StringToRowDataConverter
 
subtaskFailed(int, Throwable) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
subtaskReady(int, OperatorCoordinator.SubtaskGateway) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
subtaskReset(int, long) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
 
SUPPLEMENTAL_LOGGING_MODE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
supportsMultiPaths() - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
 
supportsNestedProjection() - Method in class org.apache.hudi.table.HoodieTableSource
 

T

TABLE_EXTERNAL - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
 
TABLE_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
TABLE_TYPE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
TABLE_TYPE_COPY_ON_WRITE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
TABLE_TYPE_MERGE_ON_READ - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
tableCommonOptions(Configuration) - Static method in class org.apache.hudi.table.catalog.CatalogOptions
Returns all the common table options that can be shared.
TableDescriptor(ObjectIdentifier, ResolvedCatalogTable) - Constructor for class org.apache.hudi.util.HoodiePipeline.TableDescriptor
 
tableExists(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
 
tableExists(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
 
tableExists(String, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
Returns whether the hoodie table exists under given path basePath.
TableOptionProperties - Class in org.apache.hudi.table.catalog
Helper class to read/write flink table options as a map.
TableOptionProperties() - Constructor for class org.apache.hudi.table.catalog.TableOptionProperties
 
tableState(MergeOnReadTableState) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.Builder
 
tableState - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
tableState(MergeOnReadTableState) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
 
tableState - Variable in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
 
tableType - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
targetBasePath - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
targetFileMaxBytes - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
targetFileMaxBytes - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
targetPartitions - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
 
targetPartitions - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
targetTableName - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
taskEpochId - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
taskID - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Id of current subtask.
taskID(int) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
 
taskPartitionId - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
test(RowData, RowType.RowField[]) - Method in class org.apache.hudi.source.prune.DataPruner
Filters the index row with specific data filters and query fields.
TIME_ELAPSED - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
TIME_ELAPSED - Static variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
 
timeout(long) - Method in class org.apache.hudi.sink.utils.TimeWait.Builder
 
timers - Variable in class org.apache.hudi.metrics.HoodieFlinkMetrics
 
TimeWait - Class in org.apache.hudi.sink.utils
Tool used for time waiting.
TimeWait.Builder - Class in org.apache.hudi.sink.utils
Builder.
toFlinkConfig(FlinkClusteringConfig) - Static method in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
Transforms a FlinkClusteringConfig.config into Configuration.
toFlinkConfig(FlinkCompactionConfig) - Static method in class org.apache.hudi.sink.compact.FlinkCompactionConfig
Transforms a HoodieFlinkCompaction.config into Configuration.
toFlinkConfig(FlinkStreamerConfig) - Static method in class org.apache.hudi.streamer.FlinkStreamerConfig
Transforms a HoodieFlinkStreamer.Config into Configuration.
toFlinkPath(Path) - Static method in class org.apache.hudi.table.format.FilePathUtils
Transforms the Hadoop path to Flink path.
toFlinkPaths(Path[]) - Static method in class org.apache.hudi.table.format.FilePathUtils
Transforms the array of Hadoop paths to Flink paths.
toFlinkType(TypeInfo) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
Convert Hive data type to a Flink data type.
toHiveFieldSchema(TableSchema, boolean) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
Create Hive field schemas from Flink table schema including the hoodie metadata fields.
toHiveTypeInfo(DataType) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
Convert Flink DataType to Hive TypeInfo.
toRelativePartitionPaths(List<String>, List<Map<String, String>>, boolean) - Static method in class org.apache.hudi.table.format.FilePathUtils
Transforms the given partition key value mapping to relative partition paths.
toRowDataProjection(int[]) - Method in class org.apache.hudi.table.format.CastMap
 
toString() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
 
toString() - Method in class org.apache.hudi.sink.meta.CkpMessage
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.And
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.Equals
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.GreaterThan
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.GreaterThanOrEqual
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.In
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.LessThan
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.LessThanOrEqual
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.Not
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.NotEquals
 
toString() - Method in class org.apache.hudi.source.ExpressionPredicates.Or
 
toString() - Method in class org.apache.hudi.table.format.CastMap
 
toString() - Method in class org.apache.hudi.table.format.cdc.CdcInputSplit
 
toString() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
 
totalSubtaskNum - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
Transformer - Interface in org.apache.hudi.sink.transform
Transform source stream to target stream before writing.
transformerClassNames - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
translateFlinkTableProperties2Spark(CatalogTable, Configuration, Map<String, String>, List<String>, boolean) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
 
translateSparkTableProperties2Flink(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
 
translateSparkTableProperties2Flink(Table) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
 
transposeColumnStatsIndex(List<RowData>, String[], RowType) - Static method in class org.apache.hudi.source.stats.ColumnStatsIndices
Transposes and converts the raw table format of the Column Stats Index representation, where each row/record corresponds to individual (column, file) pair, into the table format where each row corresponds to single file with statistic for individual columns collated w/in such row:
type - Variable in class org.apache.hudi.source.ExpressionEvaluators.LeafEvaluator
 
TypeConverters - Class in org.apache.hudi.table.format
Tool class used to perform supported casts from a LogicalType to another as defined in Hudi Comprehensive Schema Evolution's scope.
TypeConverters() - Constructor for class org.apache.hudi.table.format.TypeConverters
 
TypeConverters.TypeConverter - Interface in org.apache.hudi.table.format
 
TypeInfoLogicalTypeVisitor - Class in org.apache.hudi.table.catalog
Create a TypeInfoLogicalTypeVisitor for hoodie table.

U

unescapePathName(String) - Static method in class org.apache.hudi.table.format.FilePathUtils
 
update(int) - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAccumulator
 
updateCommitMetrics(String, HoodieCommitMetadata) - Method in class org.apache.hudi.metrics.FlinkWriteMetrics
 
updateCommitMetrics(long, long, HoodieCommitMetadata) - Method in class org.apache.hudi.metrics.FlinkWriteMetrics
 
UPSERT - Static variable in class org.apache.hudi.util.ChangelogModes
Change log mode that ignores UPDATE_BEFORE, e.g UPSERT.
URL_ENCODE_PARTITIONING - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
UTC_TIMEZONE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
utcTimezone - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 

V

val - Variable in class org.apache.hudi.source.ExpressionEvaluators.NullFalseEvaluator
 
validateAndReorderPartitions(Map<String, String>, List<String>) - Static method in class org.apache.hudi.table.format.FilePathUtils
Reorder the partition key value mapping based on the given partition keys sequence.
validateClusteringScheduling(Configuration) - Static method in class org.apache.hudi.util.ClusteringUtil
 
valueOf(String) - Static method in enum org.apache.hudi.sink.meta.CkpMessage.State
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.hudi.sink.overwrite.PartitionOverwriteMode
Returns the enum constant of this type with the specified name.
values() - Static method in enum org.apache.hudi.sink.meta.CkpMessage.State
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.hudi.sink.overwrite.PartitionOverwriteMode
Returns an array containing the constants of this enum type, in the order they are declared.
ViewStorageProperties - Class in org.apache.hudi.util
Helper class to read/write FileSystemViewStorageConfig.
ViewStorageProperties() - Constructor for class org.apache.hudi.util.ViewStorageProperties
 
visit(CharType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(VarCharType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(BooleanType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(VarBinaryType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(DecimalType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(TinyIntType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(SmallIntType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(IntType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(BigIntType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(FloatType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(DoubleType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(DateType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(TimestampType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(ArrayType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(MapType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(RowType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 
visit(NullType) - Method in class org.apache.hudi.table.catalog.TypeInfoLogicalTypeVisitor
 

W

waitFor() - Method in class org.apache.hudi.sink.utils.TimeWait
Wait for an interval time.
waitForTasksFinish(boolean) - Method in class org.apache.hudi.sink.utils.NonThrownExecutor.Builder
 
write(RowData) - Method in class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
 
write(RowData) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
write(DataInputView, int) - Method in class org.apache.hudi.table.format.cdc.CdcInputFormat.BytesArrayOutputView
 
WRITE_BATCH_SIZE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_BULK_INSERT_SHUFFLE_INPUT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_BULK_INSERT_SORT_INPUT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_BULK_INSERT_SORT_INPUT_BY_RECORD_KEY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_CLIENT_ID - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_COMMIT_ACK_TIMEOUT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_LOG_BLOCK_SIZE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_LOG_MAX_SIZE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_MERGE_MAX_MEMORY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_PARQUET_BLOCK_SIZE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_PARQUET_MAX_FILE_SIZE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_PARQUET_PAGE_SIZE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_PARTITION_OVERWRITE_MODE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_RATE_LIMIT - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_SORT_MEMORY - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_TASK_MAX_SIZE - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
WRITE_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
 
writeBatchSize - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
writeBucket(String, StreamWriteFunction.DataBucket, List<HoodieRecord>) - Method in class org.apache.hudi.sink.bucket.ConsistentBucketStreamWriteFunction
 
writeBucket(String, StreamWriteFunction.DataBucket, List<HoodieRecord>) - Method in class org.apache.hudi.sink.StreamWriteFunction
 
writeBuffer() - Method in class org.apache.hudi.sink.StreamWriteFunction.DataBucket
Prepare the write data buffer: patch up all the records with correct partition path.
writeClient - Variable in class org.apache.hudi.sink.CleanFunction
 
writeClient - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Write Client.
writeConfig - Variable in class org.apache.hudi.sink.bootstrap.BootstrapOperator
 
writeConfig - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
 
writeFunction - Variable in class org.apache.hudi.sink.StreamWriteFunction
 
writeLogBlockSize - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
writeLogMaxSize - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
writeMergeMaxMemory - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
WriteMetadataEvent - Class in org.apache.hudi.sink.event
An operator event to mark successful checkpoint batch write.
WriteMetadataEvent() - Constructor for class org.apache.hudi.sink.event.WriteMetadataEvent
 
WriteMetadataEvent.Builder - Class in org.apache.hudi.sink.event
Builder for WriteMetadataEvent.
WriteOperatorFactory<I> - Class in org.apache.hudi.sink.common
Factory class for StreamWriteOperator.
WriteOperatorFactory(Configuration, AbstractWriteOperator<I>) - Constructor for class org.apache.hudi.sink.common.WriteOperatorFactory
 
writeParquetBlockSize - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
writeParquetMaxFileSize - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
writePartitionFormat - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
writePartitionUrlEncode - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
WriteProfile - Class in org.apache.hudi.sink.partitioner.profile
Profiling of write statistics for BucketAssigner, such as the average record size and small files.
WriteProfile(HoodieWriteConfig, HoodieFlinkEngineContext) - Constructor for class org.apache.hudi.sink.partitioner.profile.WriteProfile
 
WriteProfiles - Class in org.apache.hudi.sink.partitioner.profile
Factory for WriteProfile.
writeRateLimit - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
WriterHelpers - Class in org.apache.hudi.sink.bulk
Factory clazz to generate bulk insert writer helpers.
WriterHelpers() - Constructor for class org.apache.hudi.sink.bulk.WriterHelpers
 
writeStatus(List<WriteStatus>) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
 
writeStatuses - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
Write status list for the current checkpoint.
writeTaskMaxSize - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
writeTaskNum - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
 
A B C D E F G H I J K L M N O P Q R S T U V W 
Skip navigation links

Copyright © 2023 The Apache Software Foundation. All rights reserved.