- BatchBootstrapOperator<I,O extends HoodieRecord<?>> - Class in org.apache.hudi.sink.bootstrap.batch
-
The operator to load index from existing hoodieTable.
- BatchBootstrapOperator(Configuration) - Constructor for class org.apache.hudi.sink.bootstrap.batch.BatchBootstrapOperator
-
- bindCall(CallExpression, RowData, RowType.RowField[]) - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.Evaluator
-
Binds the evaluator with specific call expression.
- bindColStats(RowData, RowType.RowField[], FieldReferenceExpression) - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.Evaluator
-
- bindEvaluator(ExpressionEvaluator.Evaluator...) - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.And
-
- bindEvaluator(ExpressionEvaluator.Evaluator) - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.Not
-
- bindEvaluator(ExpressionEvaluator.Evaluator...) - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.Or
-
- bindFieldReference(FieldReferenceExpression) - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.Evaluator
-
- bindVal(ValueLiteralExpression) - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.Evaluator
-
- bindVals(Object...) - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.In
-
- bootstrap(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
-
- bootstrap(HoodieTableMetaClient) - Method in class org.apache.hudi.sink.meta.CkpMetadata
-
Initialize the message bus, would clean all the messages and publish the last pending instant.
- bootstrap(Configuration, RowType, int, DataStream<RowData>) - Static method in class org.apache.hudi.sink.utils.Pipelines
-
Constructs bootstrap pipeline as streaming.
- bootstrap(Configuration, RowType, int, DataStream<RowData>, boolean, boolean) - Static method in class org.apache.hudi.sink.utils.Pipelines
-
Constructs bootstrap pipeline.
- BOOTSTRAP_INSTANT - Static variable in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- BootstrapAccumulator - Class in org.apache.hudi.sink.bootstrap.aggregate
-
Bootstrap ready task id accumulator.
- BootstrapAccumulator() - Constructor for class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAccumulator
-
- BootstrapAggFunction - Class in org.apache.hudi.sink.bootstrap.aggregate
-
Aggregate function that accumulates the loaded task number of
function
BootstrapOperator.
- BootstrapAggFunction() - Constructor for class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAggFunction
-
- BootstrapOperator<I,O extends HoodieRecord<?>> - Class in org.apache.hudi.sink.bootstrap
-
The operator to load index from existing hoodieTable.
- BootstrapOperator(Configuration) - Constructor for class org.apache.hudi.sink.bootstrap.BootstrapOperator
-
- BoundedMemoryRecords(MergeOnReadInputSplit, Schema, Configuration, Configuration) - Constructor for class org.apache.hudi.table.format.FormatUtils.BoundedMemoryRecords
-
- BUCKET_ASSIGN_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- BUCKET_INDEX_NUM_BUCKETS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- BucketAssigner - Class in org.apache.hudi.sink.partitioner
-
Bucket assigner that assigns the data buffer of one checkpoint into buckets.
- BucketAssigner(int, int, int, WriteProfile, HoodieWriteConfig) - Constructor for class org.apache.hudi.sink.partitioner.BucketAssigner
-
- BucketAssigners - Class in org.apache.hudi.sink.partitioner
-
Utilities for BucketAssigner.
- BucketAssignFunction<K,I,O extends HoodieRecord<?>> - Class in org.apache.hudi.sink.partitioner
-
The function to build the write profile incrementally for records within a checkpoint,
it then assigns the bucket with ID using the
BucketAssigner.
- BucketAssignFunction(Configuration) - Constructor for class org.apache.hudi.sink.partitioner.BucketAssignFunction
-
- bucketAssignNum - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- BucketBulkInsertWriterHelper - Class in org.apache.hudi.sink.bucket
-
Helper class for bucket index bulk insert used by Flink.
- BucketBulkInsertWriterHelper(Configuration, HoodieTable<?, ?, ?, ?>, HoodieWriteConfig, String, int, long, long, RowType) - Constructor for class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
-
- BucketIndexPartitioner<T extends HoodieKey> - Class in org.apache.hudi.sink.partitioner
-
Bucket index input partitioner.
- BucketIndexPartitioner(int, String) - Constructor for class org.apache.hudi.sink.partitioner.BucketIndexPartitioner
-
- BucketStreamWriteFunction<I> - Class in org.apache.hudi.sink.bucket
-
A stream write function with bucket hash index.
- BucketStreamWriteFunction(Configuration) - Constructor for class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
-
Constructs a BucketStreamWriteFunction.
- BucketStreamWriteOperator<I> - Class in org.apache.hudi.sink.bucket
-
- BucketStreamWriteOperator(Configuration) - Constructor for class org.apache.hudi.sink.bucket.BucketStreamWriteOperator
-
- bufferRecord(HoodieRecord<?>) - Method in class org.apache.hudi.sink.StreamWriteFunction
-
Buffers the given record.
- build() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
-
- build() - Method in class org.apache.hudi.sink.utils.NonThrownExecutor.Builder
-
- build() - Method in class org.apache.hudi.sink.utils.TimeWait.Builder
-
- build() - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
-
- build() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
-
- buildAvroRecordBySchema(IndexedRecord, Schema, int[], GenericRecordBuilder) - Static method in class org.apache.hudi.table.format.FormatUtils
-
- builder() - Static method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- Builder() - Constructor for class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
-
- builder(Logger) - Static method in class org.apache.hudi.sink.utils.NonThrownExecutor
-
- builder() - Static method in class org.apache.hudi.sink.utils.TimeWait
-
- builder() - Static method in class org.apache.hudi.source.IncrementalInputSplits
-
Returns the builder.
- Builder() - Constructor for class org.apache.hudi.source.IncrementalInputSplits.Builder
-
- builder() - Static method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
-
- Builder() - Constructor for class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
-
- builder(String) - Static method in class org.apache.hudi.util.HoodiePipeline
-
Returns the builder for hoodie pipeline construction.
- buildSyncConfig(Configuration) - Static method in class org.apache.hudi.sink.utils.HiveSyncContext
-
- bulkInsert(Configuration, RowType, DataStream<RowData>) - Static method in class org.apache.hudi.sink.utils.Pipelines
-
Bulk insert the input dataset at once.
- BulkInsertWriteFunction<I> - Class in org.apache.hudi.sink.bulk
-
Sink function to write the data to the underneath filesystem.
- BulkInsertWriteFunction(Configuration, RowType) - Constructor for class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
-
Constructs a StreamingSinkFunction.
- BulkInsertWriteOperator<I> - Class in org.apache.hudi.sink.bulk
-
Operator for bulk insert mode sink.
- BulkInsertWriteOperator(Configuration, RowType) - Constructor for class org.apache.hudi.sink.bulk.BulkInsertWriteOperator
-
- BulkInsertWriterHelper - Class in org.apache.hudi.sink.bulk
-
Helper class for bulk insert used by Flink.
- BulkInsertWriterHelper(Configuration, HoodieTable, HoodieWriteConfig, String, int, long, long, RowType) - Constructor for class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- cancel() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
-
- cancel() - Method in class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
-
- cancel() - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
-
- CATALOG_PATH - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
-
- CatalogOptions - Class in org.apache.hudi.table.catalog
-
Hoodie catalog options.
- CatalogOptions() - Constructor for class org.apache.hudi.table.catalog.CatalogOptions
-
- ChainedTransformer - Class in org.apache.hudi.sink.transform
-
- ChainedTransformer(List<Transformer>) - Constructor for class org.apache.hudi.sink.transform.ChainedTransformer
-
- CHANGELOG_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- ChangelogModes - Class in org.apache.hudi.util
-
Utilities for all kinds of common ChangelogModes.
- checkpointCoordinator(long, CompletableFuture<byte[]>) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- checkpointInterval - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
Flink checkpoint interval.
- checkRequiredProperties(TypedProperties, List<String>) - Static method in class org.apache.hudi.util.StreamerUtil
-
- CkpMessage - Class in org.apache.hudi.sink.meta
-
A checkpoint message.
- CkpMessage(String, String) - Constructor for class org.apache.hudi.sink.meta.CkpMessage
-
- CkpMessage(FileStatus) - Constructor for class org.apache.hudi.sink.meta.CkpMessage
-
- CkpMessage.State - Enum in org.apache.hudi.sink.meta
-
Instant State.
- CkpMetadata - Class in org.apache.hudi.sink.meta
-
The checkpoint metadata for bookkeeping the checkpoint messages.
- ckpMetaPath(String) - Static method in class org.apache.hudi.sink.meta.CkpMetadata
-
- clean(String) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
-
- clean(Configuration, DataStream<Object>) - Static method in class org.apache.hudi.sink.utils.Pipelines
-
- CLEAN_ASYNC_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLEAN_POLICY - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLEAN_RETAIN_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLEAN_RETAIN_FILE_VERSIONS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- cleanAsyncEnable - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- cleanAsyncEnable - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- cleanAsyncEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- CleanFunction<T> - Class in org.apache.hudi.sink
-
Sink function that cleans the old commits.
- CleanFunction(Configuration) - Constructor for class org.apache.hudi.sink.CleanFunction
-
- cleanInstant(HoodieTableMetaClient, HoodieInstant) - Static method in class org.apache.hudi.util.CompactionUtil
-
Cleans the metadata file for given instant instant.
- cleanPolicy - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- cleanRetainCommits - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- cleanRetainCommits - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- cleanRetainCommits - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- cleanRetainFileVersions - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- close() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
-
- close() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- close() - Method in class org.apache.hudi.sink.bulk.sort.SortOperator
-
- close() - Method in class org.apache.hudi.sink.CleanFunction
-
- close() - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
-
- close() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
-
- close() - Method in class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
-
- close() - Method in class org.apache.hudi.sink.meta.CkpMetadata
-
- close() - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
-
- close() - Method in class org.apache.hudi.sink.partitioner.BucketAssignFunction
-
- close() - Method in class org.apache.hudi.sink.StreamWriteFunction
-
- close() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- close() - Method in class org.apache.hudi.sink.utils.NonThrownExecutor
-
- close() - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
-
- close() - Method in class org.apache.hudi.source.StreamReadOperator
-
- close() - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- close() - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- close() - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
-
- close() - Method in class org.apache.hudi.table.format.FormatUtils.BoundedMemoryRecords
-
- close() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
-
- cluster(Configuration, RowType, DataStream<Object>) - Static method in class org.apache.hudi.sink.utils.Pipelines
-
The clustering tasks pipeline.
- CLUSTERING_ASYNC_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_DELTA_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_MAX_NUM_GROUPS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_PLAN_PARTITION_FILTER_MODE_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_PLAN_STRATEGY_CLASS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_PLAN_STRATEGY_SKIP_PARTITIONS_FROM_LATEST - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_PLAN_STRATEGY_SMALL_FILE_LIMIT - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_PLAN_STRATEGY_TARGET_FILE_MAX_BYTES - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_SCHEDULE_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_SORT_COLUMNS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_TARGET_PARTITIONS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- CLUSTERING_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- ClusteringCommitEvent - Class in org.apache.hudi.sink.clustering
-
- ClusteringCommitEvent() - Constructor for class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- ClusteringCommitEvent(String, List<WriteStatus>, int) - Constructor for class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- ClusteringCommitEvent(String, int) - Constructor for class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- ClusteringCommitSink - Class in org.apache.hudi.sink.clustering
-
Function to check and commit the clustering action.
- ClusteringCommitSink(Configuration) - Constructor for class org.apache.hudi.sink.clustering.ClusteringCommitSink
-
- clusteringDeltaCommits - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- ClusteringOperator - Class in org.apache.hudi.sink.clustering
-
Operator to execute the actual clustering task assigned by the clustering plan task.
- ClusteringOperator(Configuration, RowType) - Constructor for class org.apache.hudi.sink.clustering.ClusteringOperator
-
- ClusteringPlanEvent - Class in org.apache.hudi.sink.clustering
-
- ClusteringPlanEvent() - Constructor for class org.apache.hudi.sink.clustering.ClusteringPlanEvent
-
- ClusteringPlanEvent(String, ClusteringGroupInfo, Map<String, String>) - Constructor for class org.apache.hudi.sink.clustering.ClusteringPlanEvent
-
- ClusteringPlanOperator - Class in org.apache.hudi.sink.clustering
-
Operator that generates the clustering plan with pluggable strategies on finished checkpoints.
- ClusteringPlanOperator(Configuration) - Constructor for class org.apache.hudi.sink.clustering.ClusteringPlanOperator
-
- ClusteringPlanSourceFunction - Class in org.apache.hudi.sink.clustering
-
Flink hudi clustering source function.
- ClusteringPlanSourceFunction(String, HoodieClusteringPlan) - Constructor for class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
-
- clusteringSeq - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- clusteringTasks - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- ClusteringUtil - Class in org.apache.hudi.util
-
Utilities for flink hudi clustering.
- ClusteringUtil() - Constructor for class org.apache.hudi.util.ClusteringUtil
-
- column(String) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
-
Add a table column definition.
- ColumnStatsIndices - Class in org.apache.hudi.source.stats
-
Utilities for abstracting away heavy-lifting of interactions with Metadata Table's Column Stats Index,
providing convenient interfaces to read it, transpose, etc.
- COMMENT - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
-
- CommitAckEvent - Class in org.apache.hudi.sink.event
-
An operator event to mark successful instant commit.
- CommitAckEvent(long) - Constructor for class org.apache.hudi.sink.event.CommitAckEvent
-
- CommitAckEvent() - Constructor for class org.apache.hudi.sink.event.CommitAckEvent
-
- commitInstant(String) - Method in class org.apache.hudi.sink.meta.CkpMetadata
-
Add a checkpoint commit message.
- commitOnErrors - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- compact(Configuration, DataStream<Object>) - Static method in class org.apache.hudi.sink.utils.Pipelines
-
The compaction tasks pipeline.
- CompactFunction - Class in org.apache.hudi.sink.compact
-
Function to execute the actual compaction task assigned by the compaction plan task.
- CompactFunction(Configuration) - Constructor for class org.apache.hudi.sink.compact.CompactFunction
-
- COMPACTION_ASYNC_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- COMPACTION_DELTA_COMMITS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- COMPACTION_DELTA_SECONDS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- COMPACTION_MAX_MEMORY - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- COMPACTION_SCHEDULE_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- COMPACTION_TARGET_IO - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- COMPACTION_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- COMPACTION_TIMEOUT_SECONDS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- COMPACTION_TRIGGER_STRATEGY - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- compactionAsyncEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- CompactionCommitEvent - Class in org.apache.hudi.sink.compact
-
- CompactionCommitEvent() - Constructor for class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- CompactionCommitEvent(String, String, int) - Constructor for class org.apache.hudi.sink.compact.CompactionCommitEvent
-
An event with NULL write statuses that represents a failed compaction.
- CompactionCommitEvent(String, String, List<WriteStatus>, int) - Constructor for class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- CompactionCommitSink - Class in org.apache.hudi.sink.compact
-
Function to check and commit the compaction action.
- CompactionCommitSink(Configuration) - Constructor for class org.apache.hudi.sink.compact.CompactionCommitSink
-
- compactionDeltaCommits - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- compactionDeltaCommits - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- compactionDeltaSeconds - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- compactionDeltaSeconds - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- compactionMaxMemory - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- compactionMaxMemory - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- compactionMaxMemory - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- CompactionPlanEvent - Class in org.apache.hudi.sink.compact
-
- CompactionPlanEvent() - Constructor for class org.apache.hudi.sink.compact.CompactionPlanEvent
-
- CompactionPlanEvent(String, CompactionOperation) - Constructor for class org.apache.hudi.sink.compact.CompactionPlanEvent
-
- compactionPlanInstant - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- CompactionPlanOperator - Class in org.apache.hudi.sink.compact
-
Operator that generates the compaction plan with pluggable strategies on finished checkpoints.
- CompactionPlanOperator(Configuration) - Constructor for class org.apache.hudi.sink.compact.CompactionPlanOperator
-
- compactionPlanSelectStrategy - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- CompactionPlanSourceFunction - Class in org.apache.hudi.sink.compact
-
Flink hudi compaction source function.
- CompactionPlanSourceFunction(List<Pair<String, HoodieCompactionPlan>>) - Constructor for class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
-
- CompactionPlanStrategies - Class in org.apache.hudi.sink.compact.strategy
-
Factory clazz for CompactionPlanStrategy.
- CompactionPlanStrategy - Interface in org.apache.hudi.sink.compact.strategy
-
Compaction plan selection strategy.
- compactionSeq - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- compactionTargetIo - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- compactionTargetIo - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- compactionTasks - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- compactionTasks - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- compactionTriggerStrategy - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- compactionTriggerStrategy - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- CompactionUtil - Class in org.apache.hudi.util
-
Utilities for flink hudi compaction.
- CompactionUtil() - Constructor for class org.apache.hudi.util.CompactionUtil
-
- COMPARATOR - Static variable in class org.apache.hudi.sink.meta.CkpMessage
-
- compareTo(CkpMessage) - Method in class org.apache.hudi.sink.meta.CkpMessage
-
- conf - Variable in class org.apache.hudi.sink.bootstrap.BootstrapOperator
-
- conf(Configuration) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
-
- Config() - Constructor for class org.apache.hudi.schema.FilebasedSchemaProvider.Config
-
- Config() - Constructor for class org.apache.hudi.schema.SchemaRegistryProvider.Config
-
- config - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
Config options.
- config - Variable in class org.apache.hudi.sink.partitioner.BucketAssigner
-
The write config.
- config - Variable in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
The write config.
- config(Configuration) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
-
- configs - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- configure(Configuration) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
-
- confirming - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
Flag saying whether the write task is waiting for the checkpoint success notification
after it finished a checkpoint.
- consume() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- convert(Object) - Method in interface org.apache.hudi.util.AvroToRowDataConverters.AvroToRowDataConverter
-
- convert(String) - Method in class org.apache.hudi.util.FlinkStateBackendConverter
-
- convert(Schema, Object) - Method in interface org.apache.hudi.util.RowDataToAvroConverters.RowDataToAvroConverter
-
- convert(String[]) - Method in class org.apache.hudi.util.StringToRowDataConverter
-
- convertLogFilesSizeToExpectedParquetSize(List<HoodieLogFile>) - Method in class org.apache.hudi.sink.partitioner.profile.DeltaWriteProfile
-
- convertTableSchema(Table) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
-
- convertToDataType(Schema) - Static method in class org.apache.hudi.util.AvroSchemaConverter
-
Converts an Avro schema schema into a nested row structure with deterministic field order and
data types that are compatible with Flink's Table & SQL API.
- convertToSchema(LogicalType) - Static method in class org.apache.hudi.util.AvroSchemaConverter
-
Converts Flink SQL LogicalType (can be nested) into an Avro schema.
- convertToSchema(LogicalType, String) - Static method in class org.apache.hudi.util.AvroSchemaConverter
-
Converts Flink SQL LogicalType (can be nested) into an Avro schema.
- copy() - Method in class org.apache.hudi.table.HoodieTableSink
-
- copy() - Method in class org.apache.hudi.table.HoodieTableSource
-
- CopyOnWriteInputFormat - Class in org.apache.hudi.table.format.cow
-
An implementation of FileInputFormat to read RowData records
from Parquet files.
- CopyOnWriteInputFormat(Path[], String[], DataType[], int[], String, long, Configuration, boolean) - Constructor for class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
-
- create(int, int, int, boolean, HoodieTableType, HoodieFlinkEngineContext, HoodieWriteConfig) - Static method in class org.apache.hudi.sink.partitioner.BucketAssigners
-
Creates a BucketAssigner.
- create(OperatorCoordinator.Context) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator.Provider
-
- create(RowType, Configuration) - Static method in class org.apache.hudi.sink.transform.RowDataToHoodieFunctions
-
- create(Configuration, SerializableConfiguration) - Static method in class org.apache.hudi.sink.utils.HiveSyncContext
-
- createAccumulator() - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAggFunction
-
- createCatalog(CatalogFactory.Context) - Method in class org.apache.hudi.table.catalog.HoodieCatalogFactory
-
- createConverter(LogicalType) - Static method in class org.apache.hudi.util.AvroToRowDataConverters
-
Creates a runtime converter which assuming input object is not null.
- createConverter(LogicalType) - Static method in class org.apache.hudi.util.RowDataToAvroConverters
-
Creates a runtime converter according to the given logical type that converts objects of
Flink Table & SQL internal data structures to corresponding Avro data structures.
- createDatabase(String, CatalogDatabase, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- createDatabase(String, CatalogDatabase, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- createDeletePayload(BaseAvroPayload) - Method in class org.apache.hudi.sink.utils.PayloadCreation
-
- createDynamicTableSink(DynamicTableFactory.Context) - Method in class org.apache.hudi.table.HoodieTableFactory
-
- createDynamicTableSource(DynamicTableFactory.Context) - Method in class org.apache.hudi.table.HoodieTableFactory
-
- createFileIdOfThisTask() - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
-
- createFunction(ObjectPath, CatalogFunction, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- createFunction(ObjectPath, CatalogFunction, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- createHiveColumns(TableSchema) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
-
Create Hive columns from Flink TableSchema.
- createHiveConf(String) - Static method in class org.apache.hudi.table.catalog.HoodieCatalogUtil
-
Returns a new HiveConf.
- createInputSplits(int) - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
-
- createInputSplits(int) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
-
- createMetaClient(String, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Creates the meta client.
- createMetaClient(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Creates the meta client.
- createPartition(ObjectPath, CatalogPartitionSpec, CatalogPartition, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- createPartition(ObjectPath, CatalogPartitionSpec, CatalogPartition, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- createPayload(GenericRecord) - Method in class org.apache.hudi.sink.utils.PayloadCreation
-
- createProperties(String, Configuration, Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
-
- createProperties(String, FileSystemViewStorageConfig, Configuration) - Static method in class org.apache.hudi.util.ViewStorageProperties
-
- createRowConverter(RowType) - Static method in class org.apache.hudi.util.AvroToRowDataConverters
-
- createSortCodeGenerator() - Method in class org.apache.hudi.sink.bulk.sort.SortOperatorGen
-
- createSortOperator() - Method in class org.apache.hudi.sink.bulk.sort.SortOperatorGen
-
- createStreamOperator(StreamOperatorParameters<Object>) - Method in class org.apache.hudi.sink.common.WriteOperatorFactory
-
- createTable(ObjectPath, CatalogBaseTable, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- createTable(ObjectPath, CatalogBaseTable, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- createTable(Configuration, RuntimeContext) - Static method in class org.apache.hudi.util.FlinkTables
-
Creates the hoodie flink table.
- createTable(HoodieWriteConfig, Configuration, RuntimeContext) - Static method in class org.apache.hudi.util.FlinkTables
-
Creates the hoodie flink table.
- createTable(Configuration) - Static method in class org.apache.hudi.util.FlinkTables
-
Creates the hoodie flink table.
- createTransformer(List<String>) - Static method in class org.apache.hudi.util.StreamerUtil
-
- createWriteClient(Configuration, RuntimeContext) - Static method in class org.apache.hudi.util.StreamerUtil
-
Creates the Flink write client.
- createWriteClient(Configuration, RuntimeContext, boolean) - Static method in class org.apache.hudi.util.StreamerUtil
-
Creates the Flink write client.
- createWriteClient(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Creates the Flink write client.
- currentInstant - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
The REQUESTED instant we write the data.
- emitChangelog(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether the source should emit changelog.
- emitDelete(boolean) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
-
- EMPTY - Static variable in class org.apache.hudi.source.IncrementalInputSplits.Result
-
- EMPTY_INPUT_FORMAT - Static variable in class org.apache.hudi.util.InputFormats
-
- emptyBootstrap(int) - Static method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
Creates empty bootstrap event for task taskId.
- EmptyWriteProfile - Class in org.apache.hudi.sink.partitioner.profile
-
WriteProfile that always return empty small files.
- EmptyWriteProfile(HoodieWriteConfig, HoodieFlinkEngineContext) - Constructor for class org.apache.hudi.sink.partitioner.profile.EmptyWriteProfile
-
- endInput() - Method in class org.apache.hudi.sink.append.AppendWriteFunction
-
End input action for batch source.
- endInput() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
-
End input action for batch source.
- endInput() - Method in class org.apache.hudi.sink.bulk.sort.SortOperator
-
- endInput() - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
-
End input action for batch source.
- endInput() - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
- endInput() - Method in class org.apache.hudi.sink.common.AbstractWriteFunction
-
Invoked when bounded source ends up.
- endInput() - Method in class org.apache.hudi.sink.common.AbstractWriteOperator
-
- endInput() - Method in class org.apache.hudi.sink.compact.CompactionPlanOperator
-
- endInput(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
-
- endInput() - Method in class org.apache.hudi.sink.StreamWriteFunction
-
End input action for batch source.
- EqualTo() - Constructor for class org.apache.hudi.source.stats.ExpressionEvaluator.EqualTo
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.And
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.EqualTo
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.Evaluator
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.GreaterThan
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.GreaterThanOrEqual
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.In
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.IsNotNull
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.IsNull
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.LessThan
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.LessThanOrEqual
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.Not
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.NotEqualTo
-
- eval() - Method in class org.apache.hudi.source.stats.ExpressionEvaluator.Or
-
- Evaluator() - Constructor for class org.apache.hudi.source.stats.ExpressionEvaluator.Evaluator
-
- eventGateway - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
Gateway to send operator events to the operator coordinator.
- exceptionHook(NonThrownExecutor.ExceptionHook) - Method in class org.apache.hudi.sink.utils.NonThrownExecutor.Builder
-
- exceptionHook - Variable in class org.apache.hudi.sink.utils.NonThrownExecutor
-
Exception hook for post-exception handling.
- execute(ThrowingRunnable<Throwable>, String, Object...) - Method in class org.apache.hudi.sink.utils.NonThrownExecutor
-
Run the action in a loop.
- execute(ThrowingRunnable<Throwable>, NonThrownExecutor.ExceptionHook, String, Object...) - Method in class org.apache.hudi.sink.utils.NonThrownExecutor
-
Run the action in a loop.
- executeSync(ThrowingRunnable<Throwable>, String, Object...) - Method in class org.apache.hudi.sink.utils.NonThrownExecutor
-
Run the action in a loop and wait for completion.
- ExpressionEvaluator - Class in org.apache.hudi.source.stats
-
Tool to evaluate the ResolvedExpressions.
- ExpressionEvaluator() - Constructor for class org.apache.hudi.source.stats.ExpressionEvaluator
-
- ExpressionEvaluator.And - Class in org.apache.hudi.source.stats
-
To evaluate AND expr.
- ExpressionEvaluator.EqualTo - Class in org.apache.hudi.source.stats
-
To evaluate = expr.
- ExpressionEvaluator.Evaluator - Class in org.apache.hudi.source.stats
-
Used for deciding whether the literal values match the column stats.
- ExpressionEvaluator.GreaterThan - Class in org.apache.hudi.source.stats
-
To evaluate > expr.
- ExpressionEvaluator.GreaterThanOrEqual - Class in org.apache.hudi.source.stats
-
To evaluate >= expr.
- ExpressionEvaluator.In - Class in org.apache.hudi.source.stats
-
To evaluate IN expr.
- ExpressionEvaluator.IsNotNull - Class in org.apache.hudi.source.stats
-
To evaluate IS NOT NULL expr.
- ExpressionEvaluator.IsNull - Class in org.apache.hudi.source.stats
-
To evaluate IS NULL expr.
- ExpressionEvaluator.LessThan - Class in org.apache.hudi.source.stats
-
To evaluate < expr.
- ExpressionEvaluator.LessThanOrEqual - Class in org.apache.hudi.source.stats
-
To evaluate <= expr.
- ExpressionEvaluator.Not - Class in org.apache.hudi.source.stats
-
To evaluate NOT expr.
- ExpressionEvaluator.NotEqualTo - Class in org.apache.hudi.source.stats
-
To evaluate <> expr.
- ExpressionEvaluator.Or - Class in org.apache.hudi.source.stats
-
To evaluate OR expr.
- ExpressionUtils - Class in org.apache.hudi.util
-
Utilities for expression resolving.
- ExpressionUtils() - Constructor for class org.apache.hudi.util.ExpressionUtils
-
- extractHivePartitionFields(Configuration) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Extracts the hive sync partition fields with given configuration.
- extractPartitionKeys(Configuration) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Extracts the partition keys with given configuration.
- extractPartitionKeyValues(Path, boolean, String[]) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Generates partition key value mapping from path.
- extractValueTypeToAvroMap(LogicalType) - Static method in class org.apache.hudi.util.AvroSchemaConverter
-
- factory(MergeOnReadInputFormat) - Static method in class org.apache.hudi.source.StreamReadOperator
-
- FACTORY_ID - Static variable in class org.apache.hudi.table.HoodieTableFactory
-
- factoryIdentifier() - Method in class org.apache.hudi.table.catalog.HoodieCatalogFactory
-
- factoryIdentifier() - Method in class org.apache.hudi.table.HoodieTableFactory
-
- fetchSchemaFromRegistry(String) - Method in class org.apache.hudi.schema.SchemaRegistryProvider
-
The method takes the provided url registryUrl and gets the schema from the schema registry using that url.
- fieldTypes(List<DataType>) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
-
- FILE_GROUP_META_FIELD - Static variable in class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
-
- FilebasedSchemaProvider - Class in org.apache.hudi.schema
-
A simple schema provider, that reads off files on DFS.
- FilebasedSchemaProvider(TypedProperties) - Constructor for class org.apache.hudi.schema.FilebasedSchemaProvider
-
Deprecated.
- FilebasedSchemaProvider(Configuration) - Constructor for class org.apache.hudi.schema.FilebasedSchemaProvider
-
- FilebasedSchemaProvider.Config - Class in org.apache.hudi.schema
-
Configs supported.
- fileExists(FileSystem, Path) - Static method in class org.apache.hudi.util.StreamerUtil
-
- FileIndex - Class in org.apache.hudi.source
-
A file index which supports listing files efficiently through metadata table.
- FilePathUtils - Class in org.apache.hudi.table.format
-
Reference the Flink PartitionPathUtils
but supports simple partition path besides the Hive style.
- FilePathUtils() - Constructor for class org.apache.hudi.table.format.FilePathUtils
-
- filterExprs(List<ResolvedExpression>, RowData, RowType.RowField[]) - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator
-
Filter the index row with specific data filters and query fields.
- finish() - Method in class org.apache.hudi.source.StreamReadOperator
-
- flatOptions(Configuration) - Static method in class org.apache.hudi.configuration.FlinkOptions
-
Collects all the config options, the 'properties.' prefix would be removed if the option key starts with it.
- flinkCheckPointPath - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- FlinkClusteringConfig - Class in org.apache.hudi.sink.clustering
-
Configurations for Hoodie Flink clustering.
- FlinkClusteringConfig() - Constructor for class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- FlinkCompactionConfig - Class in org.apache.hudi.sink.compact
-
Configurations for Hoodie Flink compaction.
- FlinkCompactionConfig() - Constructor for class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- flinkConf2TypedProperties(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
- FlinkOptions - Class in org.apache.hudi.configuration
-
Hoodie Flink config options.
- FlinkStateBackendConverter - Class in org.apache.hudi.util
-
Converter that converts a string into Flink StateBackend.
- FlinkStateBackendConverter() - Constructor for class org.apache.hudi.util.FlinkStateBackendConverter
-
- FlinkStreamerConfig - Class in org.apache.hudi.streamer
-
Configurations for Hoodie Flink streamer.
- FlinkStreamerConfig() - Constructor for class org.apache.hudi.streamer.FlinkStreamerConfig
-
- FlinkTables - Class in org.apache.hudi.util
-
- FormatUtils - Class in org.apache.hudi.table.format
-
Utilities for format.
- FormatUtils.BoundedMemoryRecords - Class in org.apache.hudi.table.format
-
Utility to read and buffer the records in the unMerged log record scanner.
- fromMap(Map<String, String>) - Static method in class org.apache.hudi.configuration.FlinkOptions
-
Creates a new configuration that is initialized with the options of the given map.
- fsView - Variable in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
The file system view cache for one checkpoint interval.
- FULL - Static variable in class org.apache.hudi.util.ChangelogModes
-
- functionExists(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- functionExists(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- generateBucketKey(String, String) - Static method in class org.apache.hudi.util.StreamerUtil
-
Generates the bucket ID using format {partition path}_{fileID}.
- generateHoodieRecord(HoodieKey, FileSlice) - Static method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
-
- generatePartitionPath(LinkedHashMap<String, String>, boolean, boolean) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Make partition path from partition spec.
- getAllFileNames(String) - Static method in class org.apache.hudi.sink.meta.CkpMessage
-
- getAuxiliaryPath(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Returns the auxiliary path.
- getAvgSize() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
- getAvroSchema() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
-
- getBasePath() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getChangelogMode(ChangelogMode) - Method in class org.apache.hudi.table.HoodieTableSink
-
- getChangelogMode() - Method in class org.apache.hudi.table.HoodieTableSource
-
- getCheckpointId() - Method in class org.apache.hudi.sink.event.CommitAckEvent
-
- getClusteringGroupInfo() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
-
- getClusteringInstantTime() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
-
- getComment(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
-
- getCommitMetadata(String, Path, HoodieInstant, HoodieTimeline) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
-
Returns the commit metadata of the given instant.
- getCommitMetadataSafely(String, Path, HoodieInstant, HoodieTimeline) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
-
Returns the commit metadata of the given instant safely.
- getCompactionInstantTime() - Method in class org.apache.hudi.sink.compact.CompactionPlanEvent
-
- getCompactionInstantTime(HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
-
Gets compaction Instant time.
- getConf() - Method in class org.apache.hudi.table.HoodieTableSink
-
- getConf() - Method in class org.apache.hudi.table.HoodieTableSource
-
- getConsumed() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getContext() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- getCoordinatorProvider(String, OperatorID) - Method in class org.apache.hudi.sink.common.WriteOperatorFactory
-
- getDatabase(String) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- getDatabase(String) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getDataBuffer() - Method in class org.apache.hudi.sink.StreamWriteFunction
-
- getEndInstant() - Method in class org.apache.hudi.source.IncrementalInputSplits.Result
-
- getEventBuffer() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- getFactory(Configuration, RowType) - Static method in class org.apache.hudi.sink.append.AppendWriteOperator
-
- getFactory(Configuration) - Static method in class org.apache.hudi.sink.bucket.BucketStreamWriteOperator
-
- getFactory(Configuration, RowType) - Static method in class org.apache.hudi.sink.bulk.BulkInsertWriteOperator
-
- getFactory(Configuration) - Static method in class org.apache.hudi.sink.StreamWriteOperator
-
- getFieldNames(List<FieldSchema>) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
-
Get field names from field schemas.
- getFileId() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- getFileId() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getFileIdSorterGen(RowType) - Static method in class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
-
- getFileName(String, CkpMessage.State) - Static method in class org.apache.hudi.sink.meta.CkpMessage
-
- getFilesInPartitions() - Method in class org.apache.hudi.source.FileIndex
-
Returns all the file statuses under the table base path.
- getFileStatusRecursively(Path, int, Configuration) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
- getFileStatusRecursively(Path, int, FileSystem) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
- getFileSystemView() - Method in class org.apache.hudi.sink.partitioner.profile.DeltaWriteProfile
-
- getFileSystemView() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
- getFlinkClusteringConfig(String[]) - Static method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob
-
- getFlinkCompactionConfig(String[]) - Static method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor
-
- getFunction(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- getFunction(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getHadoopConf(Configuration) - Static method in class org.apache.hudi.configuration.HadoopConfigurations
-
Creates a new hadoop configuration that is initialized with the given flink configuration.
- getHiveConf(Configuration) - Static method in class org.apache.hudi.configuration.HadoopConfigurations
-
Creates a Hive configuration with configured dir path or empty if no Hive conf dir is set.
- getHiveConf() - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getHiveTable(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getHoodieClientConfig(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Mainly used for tests.
- getHoodieClientConfig(Configuration, boolean) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getHoodieClientConfig(Configuration, boolean, boolean) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getHoodieKey(RowData) - Method in class org.apache.hudi.sink.bulk.RowDataKeyGen
-
- getHoodieWriteStatuses() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- getInputFormat() - Method in class org.apache.hudi.table.HoodieTableSource
-
- getInputFormat(boolean) - Method in class org.apache.hudi.table.HoodieTableSource
-
- getInputSplitAssigner(MergeOnReadInputSplit[]) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
-
- getInputSplits() - Method in class org.apache.hudi.source.IncrementalInputSplits.Result
-
- getInputSplits() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
-
- getInstance(long) - Static method in class org.apache.hudi.sink.event.CommitAckEvent
-
- getInstance(Configuration) - Static method in class org.apache.hudi.sink.meta.CkpMetadata
-
- getInstance(FileSystem, String) - Static method in class org.apache.hudi.sink.meta.CkpMetadata
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.And
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.EqualTo
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.GreaterThan
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.GreaterThanOrEqual
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.In
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.IsNotNull
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.IsNull
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.LessThan
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.LessThanOrEqual
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.Not
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.NotEqualTo
-
- getInstance() - Static method in class org.apache.hudi.source.stats.ExpressionEvaluator.Or
-
- getInstant() - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- getInstant() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- getInstant() - Method in class org.apache.hudi.sink.meta.CkpMessage
-
- getInstant() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- getInstantRange() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getInstantTime() - Method in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
Returns the write instant time.
- getInstantTime() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- getLastCompletedInstant(HoodieTableMetaClient) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getLastPendingInstant(HoodieTableMetaClient) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getLastPendingInstant(HoodieTableMetaClient, boolean) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getLatestCommit() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getLatestTableSchema(String, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getLogPaths() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getMaxCompactionMemoryInBytes() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getMaxCompactionMemoryInBytes(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Returns the max compaction memory in bytes with given conf.
- getMergeType() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getMessages() - Method in class org.apache.hudi.sink.meta.CkpMetadata
-
- getMetaClient() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
- getMetaClient() - Method in class org.apache.hudi.table.HoodieTableSource
-
- getMetadataCache() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
- getOperation() - Method in class org.apache.hudi.sink.compact.CompactionPlanEvent
-
- getOperationPos() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
-
- getOperatorId() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator.Provider
-
- getOrBuildPartitionPaths() - Method in class org.apache.hudi.source.FileIndex
-
Returns all the relative partition paths.
- getParquetConf(Configuration, Configuration) - Static method in class org.apache.hudi.configuration.HadoopConfigurations
-
Creates a merged hadoop configuration with given flink configuration and hadoop configuration.
- getPartition(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- getPartition(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getPartitionColumns(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
-
- getPartitionColumnStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- getPartitionColumnStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getPartitionKeys(CatalogTable) - Static method in class org.apache.hudi.table.catalog.HoodieCatalogUtil
-
Returns the partition key list with given table.
- getPartitionPath(RowData) - Method in class org.apache.hudi.sink.bulk.RowDataKeyGen
-
- getPartitionPath(Object, String, boolean, boolean, Option<TimestampBasedAvroKeyGenerator>) - Static method in class org.apache.hudi.sink.bulk.RowDataKeyGen
-
- getPartitions(List<String>, String, boolean) - Method in class org.apache.hudi.source.FileIndex
-
Returns the partition path key and values as a list of map, each map item in the list
is a mapping of the partition key name to its actual partition value.
- getPartitions(Path, Configuration, List<String>, String, boolean) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Returns the partition path key and values as a list of map, each map item in the list
is a mapping of the partition key name to its actual partition value.
- getPartitionStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- getPartitionStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getPayloadConfig(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Returns the payload config with given configuration.
- getPkColumns(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
-
- getPkConstraintName(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
-
- getPkOffsetsInRequired() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
-
Get the primary key positions in required row type.
- getPkTypes(int[]) - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
-
Returns the primary key fields logical type with given offsets.
- getPreCombineField(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
- getPropertiesWithPrefix(Map<String, String>, String) - Static method in class org.apache.hudi.configuration.FlinkOptions
-
Collects the config options that start with specified prefix prefix into a 'key'='value' list.
- getProps(FlinkStreamerConfig) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getRawWritePathsOfInstants(Path, Configuration, List<HoodieCommitMetadata>, HoodieTableType) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
-
Returns all the incremental write file statuses with the given commits metadata.
- getReadFiles() - Method in class org.apache.hudi.table.HoodieTableSource
-
Get the reader paths with partition path expanded.
- getReadPaths(Path, Configuration, Configuration, List<String>) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Returns all the file paths that is the parents of the data files.
- getRecordKey(RowData) - Method in class org.apache.hudi.sink.bulk.RowDataKeyGen
-
- getRecordKey(Object, String) - Static method in class org.apache.hudi.sink.bulk.RowDataKeyGen
-
- getRecordsIterator() - Method in class org.apache.hudi.table.format.FormatUtils.BoundedMemoryRecords
-
- getRecordsPerBucket() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
- getRequiredAvroSchema() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
-
- getRequiredPositions() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
-
- getRequiredRowType() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
-
- getResolvedCatalogTable() - Method in class org.apache.hudi.util.HoodiePipeline.TableDescriptor
-
- getResult(BootstrapAccumulator) - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAggFunction
-
- getRowKindSafely(IndexedRecord, int) - Static method in class org.apache.hudi.table.format.FormatUtils
-
Returns the RowKind of the given record, never null.
- getRowType() - Method in class org.apache.hudi.table.format.mor.MergeOnReadTableState
-
- getScanRuntimeProvider(ScanTableSource.ScanContext) - Method in class org.apache.hudi.table.HoodieTableSource
-
- getSinkRuntimeProvider(DynamicTableSink.Context) - Method in class org.apache.hudi.table.HoodieTableSink
-
- getSmallFiles(String) - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
Returns a list of small files in the given partition path.
- getSourceSchema() - Method in class org.apache.hudi.schema.FilebasedSchemaProvider
-
- getSourceSchema() - Method in class org.apache.hudi.schema.SchemaProvider
-
- getSourceSchema() - Method in class org.apache.hudi.schema.SchemaRegistryProvider
-
- getSourceSchema(FlinkStreamerConfig) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getSourceSchema(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getSplitNumber() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getState() - Method in class org.apache.hudi.sink.meta.CkpMessage
-
- getStatistics(BaseStatistics) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
-
- getStrategy(FlinkCompactionConfig) - Static method in class org.apache.hudi.sink.compact.strategy.CompactionPlanStrategies
-
- getStrategyParams() - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
-
- getStream(HttpURLConnection) - Method in class org.apache.hudi.schema.SchemaRegistryProvider
-
- getTable() - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
- getTable(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- getTable(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getTableAvroSchema() - Method in class org.apache.hudi.table.HoodieTableSource
-
- getTableAvroSchema(HoodieTableMetaClient, boolean) - Static method in class org.apache.hudi.util.StreamerUtil
-
- getTableColumnStatistics(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- getTableColumnStatistics(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getTableDescriptor() - Method in class org.apache.hudi.util.HoodiePipeline.Builder
-
- getTableId() - Method in class org.apache.hudi.util.HoodiePipeline.TableDescriptor
-
- getTableOptions(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
-
- getTablePath() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- getTableStatistics(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- getTableStatistics(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- getTargetSchema() - Method in class org.apache.hudi.schema.FilebasedSchemaProvider
-
- getTargetSchema() - Method in class org.apache.hudi.schema.SchemaProvider
-
- getTargetSchema() - Method in class org.apache.hudi.schema.SchemaRegistryProvider
-
- getTaskID() - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- getTaskID() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- getTaskID() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- getTransformersNames() - Method in class org.apache.hudi.sink.transform.ChainedTransformer
-
- getValueFromLiteral(ValueLiteralExpression) - Static method in class org.apache.hudi.util.ExpressionUtils
-
Returns the value with given value literal expression.
- getWritePathsOfInstants(Path, Configuration, List<HoodieCommitMetadata>, HoodieTableType) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
-
Returns all the incremental write file statuses with the given commits metadata.
- getWriterHelper() - Method in class org.apache.hudi.sink.append.AppendWriteFunction
-
- getWriterHelper(Configuration, HoodieTable<?, ?, ?, ?>, HoodieWriteConfig, String, int, long, long, RowType) - Static method in class org.apache.hudi.sink.bulk.WriterHelpers
-
- getWriteStatuses(int) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- getWriteStatuses() - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- getWriteStatuses() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- getWriteStatuses() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- GreaterThan() - Constructor for class org.apache.hudi.source.stats.ExpressionEvaluator.GreaterThan
-
- GreaterThanOrEqual() - Constructor for class org.apache.hudi.source.stats.ExpressionEvaluator.GreaterThanOrEqual
-
- hadoopConf - Variable in class org.apache.hudi.sink.bootstrap.BootstrapOperator
-
- HadoopConfigurations - Class in org.apache.hudi.configuration
-
Utilities for fetching hadoop configurations.
- HadoopConfigurations() - Constructor for class org.apache.hudi.configuration.HadoopConfigurations
-
- handle - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- handleEventFromOperator(int, OperatorEvent) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
-
- handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteOperator
-
- handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
- handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.common.AbstractWriteFunction
-
Handles the operator event sent by the coordinator.
- handleOperatorEvent(OperatorEvent) - Method in class org.apache.hudi.sink.common.AbstractWriteOperator
-
- handles - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- haveSuccessfulCommits(HoodieTableMetaClient) - Static method in class org.apache.hudi.util.StreamerUtil
-
Returns whether there are successful commits on the timeline.
- help - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- help - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- help - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- HIVE_CONF_DIR - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
-
- HIVE_SITE_FILE - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
-
- HIVE_STYLE_PARTITIONING - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_ASSUME_DATE_PARTITION - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_AUTO_CREATE_DB - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_CONF_DIR - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_DB - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_FILE_FORMAT - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_IGNORE_EXCEPTIONS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_JDBC_URL - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_METASTORE_URIS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_MODE - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_PARTITION_EXTRACTOR_CLASS_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_PARTITION_FIELDS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_PASSWORD - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_SKIP_RO_SUFFIX - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_SUPPORT_TIMESTAMP - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_TABLE - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_TABLE_PROPERTIES - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_TABLE_SERDE_PROPERTIES - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_USE_JDBC - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HIVE_SYNC_USERNAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- HiveSchemaUtils - Class in org.apache.hudi.table.catalog
-
Utilities for Hive field schema.
- HiveSchemaUtils() - Constructor for class org.apache.hudi.table.catalog.HiveSchemaUtils
-
- hiveStylePartitioning - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncAssumeDatePartition - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncAutoCreateDb - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- HiveSyncContext - Class in org.apache.hudi.sink.utils
-
Hive synchronization context.
- hiveSyncDb - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncFileFormat - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncIgnoreExceptions - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncJdbcUrl - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncMetastoreUri - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncMode - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncPartitionExtractorClass - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncPartitionFields - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncPassword - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncSkipRoSuffix - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncSupportTimestamp - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncTable - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncTool() - Method in class org.apache.hudi.sink.utils.HiveSyncContext
-
- hiveSyncUseJdbc - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- hiveSyncUsername - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- HoodieCatalog - Class in org.apache.hudi.table.catalog
-
Catalog that can set up common options for underneath table.
- HoodieCatalog(String, Configuration) - Constructor for class org.apache.hudi.table.catalog.HoodieCatalog
-
- HoodieCatalogFactory - Class in org.apache.hudi.table.catalog
-
- HoodieCatalogFactory() - Constructor for class org.apache.hudi.table.catalog.HoodieCatalogFactory
-
- HoodieCatalogUtil - Class in org.apache.hudi.table.catalog
-
Utilities for Hoodie Catalog.
- HoodieCatalogUtil() - Constructor for class org.apache.hudi.table.catalog.HoodieCatalogUtil
-
- HoodieFlinkClusteringJob - Class in org.apache.hudi.sink.clustering
-
Flink hudi clustering program that can be executed manually.
- HoodieFlinkClusteringJob(HoodieFlinkClusteringJob.AsyncClusteringService) - Constructor for class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob
-
- HoodieFlinkClusteringJob.AsyncClusteringService - Class in org.apache.hudi.sink.clustering
-
Schedules clustering in service.
- HoodieFlinkCompactor - Class in org.apache.hudi.sink.compact
-
Flink hudi compaction program that can be executed manually.
- HoodieFlinkCompactor(HoodieFlinkCompactor.AsyncCompactionService) - Constructor for class org.apache.hudi.sink.compact.HoodieFlinkCompactor
-
- HoodieFlinkCompactor.AsyncCompactionService - Class in org.apache.hudi.sink.compact
-
Schedules compaction in service.
- HoodieFlinkStreamer - Class in org.apache.hudi.streamer
-
A utility which can incrementally consume data from Kafka and apply it to the target table.
- HoodieFlinkStreamer() - Constructor for class org.apache.hudi.streamer.HoodieFlinkStreamer
-
- HoodieHiveCatalog - Class in org.apache.hudi.table.catalog
-
A catalog implementation for Hoodie based on MetaStore.
- HoodieHiveCatalog(String, String, String, String) - Constructor for class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- HoodieHiveCatalog(String, String, String, HiveConf, boolean) - Constructor for class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- HoodiePipeline - Class in org.apache.hudi.util
-
A tool class to construct hoodie flink pipeline.
- HoodiePipeline() - Constructor for class org.apache.hudi.util.HoodiePipeline
-
- HoodiePipeline.Builder - Class in org.apache.hudi.util
-
Builder for hudi source/sink pipeline construction.
- HoodiePipeline.TableDescriptor - Class in org.apache.hudi.util
-
A POJO that contains tableId and resolvedCatalogTable.
- hoodieStreamWrite(Configuration, int, DataStream<HoodieRecord>) - Static method in class org.apache.hudi.sink.utils.Pipelines
-
The streaming write pipeline.
- hoodieTable - Variable in class org.apache.hudi.sink.bootstrap.BootstrapOperator
-
- hoodieTable - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- HoodieTableFactory - Class in org.apache.hudi.table
-
Hoodie data source/sink factory.
- HoodieTableFactory() - Constructor for class org.apache.hudi.table.HoodieTableFactory
-
- HoodieTableSink - Class in org.apache.hudi.table
-
Hoodie table sink.
- HoodieTableSink(Configuration, ResolvedSchema) - Constructor for class org.apache.hudi.table.HoodieTableSink
-
- HoodieTableSink(Configuration, ResolvedSchema, boolean) - Constructor for class org.apache.hudi.table.HoodieTableSink
-
- HoodieTableSource - Class in org.apache.hudi.table
-
Hoodie batch table source that always read the latest snapshot of the underneath table.
- HoodieTableSource(ResolvedSchema, Path, List<String>, String, Configuration) - Constructor for class org.apache.hudi.table.HoodieTableSource
-
- HoodieTableSource(ResolvedSchema, Path, List<String>, String, Configuration, List<Map<String, String>>, int[], Long, List<ResolvedExpression>) - Constructor for class org.apache.hudi.table.HoodieTableSource
-
- IDENTIFIER - Static variable in class org.apache.hudi.table.catalog.HoodieCatalogFactory
-
- IGNORE_FAILED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- In() - Constructor for class org.apache.hudi.source.stats.ExpressionEvaluator.In
-
- IncrementalInputSplits - Class in org.apache.hudi.source
-
- IncrementalInputSplits.Builder - Class in org.apache.hudi.source
-
- IncrementalInputSplits.Result - Class in org.apache.hudi.source
-
- INDEX_BOOTSTRAP_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- INDEX_BOOTSTRAP_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- INDEX_GLOBAL_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- INDEX_KEY_FIELD - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- INDEX_PARTITION_REGEX - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- INDEX_STATE_TTL - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- INDEX_TYPE - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- indexBootstrapEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- indexBootstrapNum - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- indexGlobalEnabled - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- indexPartitionRegex - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- IndexRecord<T extends HoodieRecordPayload> - Class in org.apache.hudi.sink.bootstrap
-
The index record.
- IndexRecord(HoodieRecord<T>) - Constructor for class org.apache.hudi.sink.bootstrap.IndexRecord
-
- indexStateTtl - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- inferChangelogMode(Configuration, HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
-
Infers the changelog mode based on the data file schema(including metadata fields).
- initializeState(StateInitializationContext) - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
-
- initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
-
- initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.sink.CleanFunction
-
- initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
- initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.sink.partitioner.BucketAssignFunction
-
- initializeState(FunctionInitializationContext) - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
-
- initializeState(StateInitializationContext) - Method in class org.apache.hudi.source.StreamReadOperator
-
- initTableIfNotExists(Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Initialize the table if it does not exist.
- initTableIfNotExists(Configuration, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Initialize the table if it does not exist.
- InputFormats - Class in org.apache.hudi.util
-
Utilities for all kinds of InputFormats.
- InputFormats() - Constructor for class org.apache.hudi.util.InputFormats
-
- inputSplits(HoodieTableMetaClient, Configuration) - Method in class org.apache.hudi.source.IncrementalInputSplits
-
Returns the incremental input splits.
- inputSplits(HoodieTableMetaClient, Configuration, String) - Method in class org.apache.hudi.source.IncrementalInputSplits
-
Returns the incremental input splits.
- INSERT_CLUSTER - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- insertCluster - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- insertClustering(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether insert clustering is allowed with given configuration conf.
- instance(Configuration, RowType) - Static method in class org.apache.hudi.sink.bulk.RowDataKeyGen
-
- instance(Configuration, AbstractWriteOperator<I>) - Static method in class org.apache.hudi.sink.common.WriteOperatorFactory
-
- instance(Configuration) - Static method in class org.apache.hudi.sink.utils.PayloadCreation
-
- INSTANCE - Static variable in class org.apache.hudi.sink.utils.Pipelines.DummySink
-
- instance(Path, Configuration, RowType) - Static method in class org.apache.hudi.source.FileIndex
-
- instance(List<MergeOnReadInputSplit>, String) - Static method in class org.apache.hudi.source.IncrementalInputSplits.Result
-
- instance(RowType, int[]) - Static method in class org.apache.hudi.util.RowDataProjection
-
- instance(LogicalType[], int[]) - Static method in class org.apache.hudi.util.RowDataProjection
-
- instanceV2(RowType, int[]) - Static method in class org.apache.hudi.util.RowDataProjection
-
- instantRetryInterval - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- instantRetryTimes - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- INSTANTS - Static variable in interface org.apache.hudi.sink.compact.strategy.CompactionPlanStrategy
-
- instantTime - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- instantTime(String) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
-
- instantTimeDiffSeconds(String, String) - Static method in class org.apache.hudi.util.StreamerUtil
-
Returns the time interval in seconds between the given instant time.
- instantToWrite(boolean) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
Prepares the instant time to write with for next checkpoint.
- interval(long) - Method in class org.apache.hudi.sink.utils.TimeWait.Builder
-
- invoke(ClusteringCommitEvent, SinkFunction.Context) - Method in class org.apache.hudi.sink.clustering.ClusteringCommitSink
-
- invoke(CompactionCommitEvent, SinkFunction.Context) - Method in class org.apache.hudi.sink.compact.CompactionCommitSink
-
- isAborted() - Method in class org.apache.hudi.sink.meta.CkpMessage
-
- isAborted(String) - Method in class org.apache.hudi.sink.meta.CkpMetadata
-
- isAlreadyBootstrap() - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
-
- isAppendMode(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether the insert is clustering disabled with given configuration conf.
- isBootstrap() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- isBucketIndexType(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
- isBucketToLoad(int, String) - Method in class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
-
Determine whether the current fileID belongs to the current task.
- isClosed() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
-
- isComplete() - Method in class org.apache.hudi.sink.meta.CkpMessage
-
- isConfirming() - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
- isConsumed() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- isCowTable(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether it is a COPY_ON_WRITE table.
- isDatetimeType(DataType) - Static method in class org.apache.hudi.util.DataTypeUtils
-
Returns whether the given type is DATETIME type.
- isDateType(DataType) - Static method in class org.apache.hudi.util.DataTypeUtils
-
Returns whether the given type is DATE type.
- isDefaultHoodieRecordPayloadClazz(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
- isDefaultValueDefined(Configuration, ConfigOption<T>) - Static method in class org.apache.hudi.configuration.FlinkOptions
-
Returns whether the given conf defines default value for the option option.
- isDeltaTimeCompaction(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether the compaction strategy is based on elapsed delta time.
- isEmbeddedMetastore(HiveConf) - Static method in class org.apache.hudi.table.catalog.HoodieCatalogUtil
-
Check whether the hive.metastore.uris is empty
- isEmitDelete(boolean) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
-
- isEmpty() - Method in class org.apache.hudi.source.IncrementalInputSplits.Result
-
- isEndInput() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- isFailed() - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- isFailed() - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- isFamily(LogicalType, LogicalTypeFamily) - Static method in class org.apache.hudi.util.DataTypeUtils
-
Returns whether the given logical type belongs to the family.
- isHiveStylePartitioning(String) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
- isInflight() - Method in class org.apache.hudi.sink.meta.CkpMessage
-
- isInputSorted - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- isInsertOperation(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether the table operation is 'insert'.
- isInsertOverwrite(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether the operation is INSERT OVERWRITE (table or partition).
- isLastBatch() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- isLIFO(String) - Static method in class org.apache.hudi.util.CompactionUtil
-
Returns whether the execution sequence is LIFO.
- isMorTable(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether it is a MERGE_ON_READ table.
- isMorTable(Map<String, String>) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether it is a MERGE_ON_READ table.
- IsNotNull() - Constructor for class org.apache.hudi.source.stats.ExpressionEvaluator.IsNotNull
-
- IsNull() - Constructor for class org.apache.hudi.source.stats.ExpressionEvaluator.IsNull
-
- isPartitionedTable(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether the table is partitioned.
- isReady(String) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
Returns whether the event is ready to commit.
- isSimpleCallExpression(Expression) - Static method in class org.apache.hudi.util.ExpressionUtils
-
Returns whether the given expression is simple call expression:
a binary call with one operand as field reference and another operand
as literal.
- isSpecificStartCommit(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether the read start commit is specific commit timestamp.
- isTimestampType(DataType) - Static method in class org.apache.hudi.util.DataTypeUtils
-
Returns whether the given type is TIMESTAMP type.
- isValidFile(FileStatus) - Static method in class org.apache.hudi.util.StreamerUtil
-
Returns whether the give file is in valid hoodie format.
- reachedEnd() - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
-
- reachedEnd() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat
-
- READ_AS_STREAMING - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- READ_DATA_SKIPPING_ENABLED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- READ_END_COMMIT - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- READ_START_COMMIT - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- READ_STREAMING_CHECK_INTERVAL - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- READ_STREAMING_SKIP_COMPACT - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- READ_TASKS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- readColumnStatsIndex(String, HoodieMetadataConfig, String[]) - Static method in class org.apache.hudi.source.stats.ColumnStatsIndices
-
- readConfig(Configuration, Path, List<String>) - Static method in class org.apache.hudi.util.StreamerUtil
-
Read config from properties file (`--props` option) and cmd line (`--hoodie-conf` option).
- readyTaskNum() - Method in class org.apache.hudi.sink.bootstrap.aggregate.BootstrapAccumulator
-
- REALTIME_PAYLOAD_COMBINE - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- REALTIME_SKIP_MERGE - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- RECORD_KEY_FIELD - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- recordKeyField - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- referencedColumns(List<ResolvedExpression>) - Static method in class org.apache.hudi.util.ExpressionUtils
-
Collect the referenced columns with given expressions,
only simple call expression is supported.
- reload(long) - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
-
Refresh the table state like TableFileSystemView and HoodieTimeline.
- reload(long) - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
Reload the write profile, should do once for each checkpoint.
- renameTable(ObjectPath, String, boolean) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- renameTable(ObjectPath, String, boolean) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- requiredOptions() - Method in class org.apache.hudi.table.catalog.HoodieCatalogFactory
-
- requiredOptions() - Method in class org.apache.hudi.table.HoodieTableFactory
-
- requiredPartitions(Set<String>) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
-
- reset() - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
-
Reset the states of this assigner, should do once for each checkpoint,
all the states are accumulated within one checkpoint interval.
- reset() - Method in class org.apache.hudi.source.FileIndex
-
Reset the state of the file index.
- reset() - Method in class org.apache.hudi.table.HoodieTableSource
-
Reset the state of the table source.
- resetToCheckpoint(long, byte[]) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- resolvePartition(String, DataType) - Static method in class org.apache.hudi.util.DataTypeUtils
-
Resolves the partition path string into value obj with given data type.
- RETRY_INTERVAL_MS - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- RETRY_TIMES - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- rollbackClustering(HoodieFlinkTable<?>, HoodieFlinkWriteClient) - Static method in class org.apache.hudi.util.ClusteringUtil
-
Force rolls back all the inflight clustering instants, especially for job failover restart.
- rollbackCompaction(HoodieFlinkTable<?>, String) - Static method in class org.apache.hudi.util.CompactionUtil
-
- rollbackCompaction(HoodieFlinkTable<?>) - Static method in class org.apache.hudi.util.CompactionUtil
-
Force rolls back all the inflight compaction instants, especially for job failover restart.
- rollbackEarliestCompaction(HoodieFlinkTable<?>, Configuration) - Static method in class org.apache.hudi.util.CompactionUtil
-
Rolls back the earliest compaction if there exists.
- RowDataKeyGen - Class in org.apache.hudi.sink.bulk
-
Key generator for RowData.
- RowDataProjection - Class in org.apache.hudi.util
-
Utilities to project the row data with given positions.
- RowDataToAvroConverters - Class in org.apache.hudi.util
-
Tool class used to convert from RowData to Avro GenericRecord.
- RowDataToAvroConverters() - Constructor for class org.apache.hudi.util.RowDataToAvroConverters
-
- RowDataToAvroConverters.RowDataToAvroConverter - Interface in org.apache.hudi.util
-
Runtime converter that converts objects of Flink Table & SQL internal data structures to
corresponding Avro data structures.
- RowDataToHoodieFunction<I extends org.apache.flink.table.data.RowData,O extends HoodieRecord> - Class in org.apache.hudi.sink.transform
-
Function that transforms RowData to HoodieRecord.
- RowDataToHoodieFunction(RowType, Configuration) - Constructor for class org.apache.hudi.sink.transform.RowDataToHoodieFunction
-
- RowDataToHoodieFunctions - Class in org.apache.hudi.sink.transform
-
- RowDataToHoodieFunctionWithRateLimit<I extends org.apache.flink.table.data.RowData,O extends HoodieRecord> - Class in org.apache.hudi.sink.transform
-
Function that transforms RowData to a HoodieRecord with RateLimit.
- RowDataToHoodieFunctionWithRateLimit(RowType, Configuration) - Constructor for class org.apache.hudi.sink.transform.RowDataToHoodieFunctionWithRateLimit
-
- rowDataToHoodieRecord(Configuration, RowType, DataStream<RowData>) - Static method in class org.apache.hudi.sink.utils.Pipelines
-
Transforms the row data to hoodie records.
- rowType - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- rowType(RowType) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
-
- rowTypeWithFileId(RowType) - Static method in class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
-
- rowWithFileId(Map<String, String>, RowDataKeyGen, RowData, String, int) - Static method in class org.apache.hudi.sink.bucket.BucketBulkInsertWriterHelper
-
- run(SourceFunction.SourceContext<ClusteringPlanEvent>) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanSourceFunction
-
- run(SourceFunction.SourceContext) - Method in class org.apache.hudi.sink.compact.CompactionPlanSourceFunction
-
- run(SourceFunction.SourceContext<MergeOnReadInputSplit>) - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
-
- schedule - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- schedule - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- scheduleClustering(Configuration, HoodieFlinkWriteClient, boolean) - Static method in class org.apache.hudi.util.ClusteringUtil
-
Schedules clustering plan by condition.
- scheduleCompaction(HoodieTableMetaClient, HoodieFlinkWriteClient<?>, boolean, boolean) - Static method in class org.apache.hudi.util.CompactionUtil
-
Schedules a new compaction instant.
- SchemaProvider - Class in org.apache.hudi.schema
-
Class to provide schema for reading data and also writing into a Hoodie table.
- SchemaProvider() - Constructor for class org.apache.hudi.schema.SchemaProvider
-
- SchemaRegistryProvider - Class in org.apache.hudi.schema
-
Obtains latest schema from the Confluent/Kafka schema-registry.
- SchemaRegistryProvider(TypedProperties) - Constructor for class org.apache.hudi.schema.SchemaRegistryProvider
-
- SchemaRegistryProvider.Config - Class in org.apache.hudi.schema
-
Configs supported.
- searchPartKeyValueAndPaths(FileSystem, Path, boolean, String[]) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Search all partitions in this path.
- select(HoodieTimeline) - Method in interface org.apache.hudi.sink.compact.strategy.CompactionPlanStrategy
-
Define how to select compaction plan to compact.
- SEQ_FIFO - Static variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- SEQ_FIFO - Static variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- SEQ_LIFO - Static variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- SEQ_LIFO - Static variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- serviceMode - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- serviceMode - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- setAuthorizationHeader(String, HttpURLConnection) - Method in class org.apache.hudi.schema.SchemaRegistryProvider
-
- setAvroSchema(Configuration, HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
-
Sets up the avro schema string into the give configuration conf
through reading from the hoodie table metadata.
- setAvroSchema(HoodieWriteConfig, HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
-
Sets up the avro schema string into the HoodieWriteConfig HoodieWriteConfig
through reading from the hoodie table metadata.
- setBootstrap(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- setCheckpointId(long) - Method in class org.apache.hudi.sink.event.CommitAckEvent
-
- setClusteringGroupInfo(ClusteringGroupInfo) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
-
- setClusteringInstantTime(String) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
-
- setCompactionInstantTime(String) - Method in class org.apache.hudi.sink.compact.CompactionPlanEvent
-
- setEndInput(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- setExecutor(NonThrownExecutor) - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
-
- setExecutor(NonThrownExecutor) - Method in class org.apache.hudi.sink.compact.CompactFunction
-
- setExecutor(NonThrownExecutor) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- setFileId(String) - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- setFileId(String) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- setFilesFilter(FilePathFilter) - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
-
- setFilters(List<ResolvedExpression>) - Method in class org.apache.hudi.source.FileIndex
-
Sets up pushed down filters.
- setInstant(String) - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- setInstant(String) - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- setInstantTime(String) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- setLastBatch(boolean) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- setOperation(CompactionOperation) - Method in class org.apache.hudi.sink.compact.CompactionPlanEvent
-
- setOperatorEventGateway(OperatorEventGateway) - Method in class org.apache.hudi.sink.bulk.BulkInsertWriteFunction
-
- setOperatorEventGateway(OperatorEventGateway) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
- setOperatorEventGateway(OperatorEventGateway) - Method in class org.apache.hudi.sink.common.AbstractWriteFunction
-
Sets up the event gateway.
- setOperatorEventGateway(OperatorEventGateway) - Method in class org.apache.hudi.sink.common.AbstractWriteOperator
-
- setOutput(Output<StreamRecord<ClusteringCommitEvent>>) - Method in class org.apache.hudi.sink.clustering.ClusteringOperator
-
- setOutput(Output<StreamRecord<ClusteringPlanEvent>>) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanOperator
-
- setOutput(Output<StreamRecord<CompactionPlanEvent>>) - Method in class org.apache.hudi.sink.compact.CompactionPlanOperator
-
- setPartitionPaths(Set<String>) - Method in class org.apache.hudi.source.FileIndex
-
Sets up explicit partition paths for pruning.
- setPreCombineField(Configuration, HoodieTableMetaClient) - Static method in class org.apache.hudi.util.CompactionUtil
-
Sets up the preCombine field into the given configuration conf
through reading from the hoodie table metadata.
- setRowKind(RowData, IndexedRecord, int) - Static method in class org.apache.hudi.table.format.FormatUtils
-
Sets up the row kind to the row data rowData from the resolved operation.
- setStrategyParams(Map<String, String>) - Method in class org.apache.hudi.sink.clustering.ClusteringPlanEvent
-
- setTaskID(int) - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- setTaskID(int) - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- setTaskID(int) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- setupTimestampKeygenOptions(Configuration, DataType) - Static method in class org.apache.hudi.table.HoodieTableFactory
-
Sets up the keygen options when the partition path is datetime type.
- setWriteStatuses(List<WriteStatus>) - Method in class org.apache.hudi.sink.clustering.ClusteringCommitEvent
-
- setWriteStatuses(List<WriteStatus>) - Method in class org.apache.hudi.sink.compact.CompactionCommitEvent
-
- setWriteStatuses(List<WriteStatus>) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- shouldLoadFile(String, int, int, int) - Method in class org.apache.hudi.sink.bootstrap.batch.BatchBootstrapOperator
-
- shouldLoadFile(String, int, int, int) - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
-
- shutDown() - Method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob.AsyncClusteringService
-
- shutDown() - Method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor.AsyncCompactionService
-
- shutdownAsyncService(boolean) - Method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob.AsyncClusteringService
-
Shutdown async services like compaction/clustering as DeltaSync is shutdown.
- shutdownAsyncService(boolean) - Method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor.AsyncCompactionService
-
Shutdown async services like compaction/clustering as DeltaSync is shutdown.
- singleton(boolean, boolean, HoodieWriteConfig, HoodieFlinkEngineContext) - Static method in class org.apache.hudi.sink.partitioner.profile.WriteProfiles
-
- sink(DataStream<RowData>, boolean) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
-
- skipCompaction(boolean) - Method in class org.apache.hudi.source.IncrementalInputSplits.Builder
-
- skipFromLatestPartitions - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- smallFileLimit - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- smallFilesOfThisTask(List<SmallFile>) - Method in class org.apache.hudi.sink.partitioner.BucketAssigner
-
- smallFilesProfile(String) - Method in class org.apache.hudi.sink.partitioner.profile.DeltaWriteProfile
-
- smallFilesProfile(String) - Method in class org.apache.hudi.sink.partitioner.profile.EmptyWriteProfile
-
- smallFilesProfile(String) - Method in class org.apache.hudi.sink.partitioner.profile.WriteProfile
-
Returns a list of small files in the given partition path from the latest filesystem view.
- snapshotState() - Method in class org.apache.hudi.sink.append.AppendWriteFunction
-
- snapshotState(StateSnapshotContext) - Method in class org.apache.hudi.sink.bootstrap.BootstrapOperator
-
- snapshotState() - Method in class org.apache.hudi.sink.bucket.BucketStreamWriteFunction
-
- snapshotState(FunctionSnapshotContext) - Method in class org.apache.hudi.sink.CleanFunction
-
- snapshotState(FunctionSnapshotContext) - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
- snapshotState() - Method in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
- snapshotState(FunctionSnapshotContext) - Method in class org.apache.hudi.sink.partitioner.BucketAssignFunction
-
- snapshotState() - Method in class org.apache.hudi.sink.StreamWriteFunction
-
- snapshotState(FunctionSnapshotContext) - Method in class org.apache.hudi.source.StreamReadMonitoringFunction
-
- snapshotState(StateSnapshotContext) - Method in class org.apache.hudi.source.StreamReadOperator
-
- sortClusteringEnabled(Configuration) - Static method in class org.apache.hudi.configuration.OptionsResolver
-
Returns whether the clustering sort is enabled.
- sortColumns - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- SortOperator - Class in org.apache.hudi.sink.bulk.sort
-
Operator for batch sort.
- SortOperator(GeneratedNormalizedKeyComputer, GeneratedRecordComparator) - Constructor for class org.apache.hudi.sink.bulk.sort.SortOperator
-
- SortOperatorGen - Class in org.apache.hudi.sink.bulk.sort
-
Tools to generate the sort operator.
- SortOperatorGen(RowType, String[]) - Constructor for class org.apache.hudi.sink.bulk.sort.SortOperatorGen
-
- source(StreamExecutionEnvironment) - Method in class org.apache.hudi.util.HoodiePipeline.Builder
-
- SOURCE_AVRO_SCHEMA - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- SOURCE_AVRO_SCHEMA_PATH - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- sourceAvroSchema - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- sourceAvroSchemaPath - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- sourceOrderingField - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- SPARK_SOURCE_PROVIDER - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
-
- SPARK_VERSION - Static variable in class org.apache.hudi.table.catalog.TableOptionProperties
-
- spillableMapPath - Variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- splitSchemaByPartitionKeys(List<FieldSchema>, List<String>) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
-
Split the field schemas by given partition keys.
- start(boolean) - Method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob
-
Main method to start clustering service.
- start(boolean) - Method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor
-
Main method to start compaction service.
- start() - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- START_COMMIT_EARLIEST - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- startInstant(String) - Method in class org.apache.hudi.sink.meta.CkpMetadata
-
- startService() - Method in class org.apache.hudi.sink.clustering.HoodieFlinkClusteringJob.AsyncClusteringService
-
- startService() - Method in class org.apache.hudi.sink.compact.HoodieFlinkCompactor.AsyncCompactionService
-
- stateBackend - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- StreamerUtil - Class in org.apache.hudi.util
-
Utilities for Flink stream read and write.
- StreamerUtil() - Constructor for class org.apache.hudi.util.StreamerUtil
-
- StreamReadMonitoringFunction - Class in org.apache.hudi.source
-
This is the single (non-parallel) monitoring task which takes a
MergeOnReadInputSplit
, it is responsible for:
Monitoring a user-provided hoodie table path.
Deciding which files(or split) should be further read and processed.
Creating the
splits corresponding to those files.
Assigning them to downstream tasks for further processing.
- StreamReadMonitoringFunction(Configuration, Path, RowType, long, Set<String>) - Constructor for class org.apache.hudi.source.StreamReadMonitoringFunction
-
- StreamReadOperator - Class in org.apache.hudi.source
-
- StreamWriteFunction<I> - Class in org.apache.hudi.sink
-
Sink function to write the data to the underneath filesystem.
- StreamWriteFunction(Configuration) - Constructor for class org.apache.hudi.sink.StreamWriteFunction
-
Constructs a StreamingSinkFunction.
- StreamWriteOperator<I> - Class in org.apache.hudi.sink
-
Operator for StreamSink.
- StreamWriteOperator(Configuration) - Constructor for class org.apache.hudi.sink.StreamWriteOperator
-
- StreamWriteOperatorCoordinator - Class in org.apache.hudi.sink
-
- StreamWriteOperatorCoordinator(Configuration, OperatorCoordinator.Context) - Constructor for class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
Constructs a StreamingSinkOperatorCoordinator.
- StreamWriteOperatorCoordinator.Provider - Class in org.apache.hudi.sink
-
- StringToRowDataConverter - Class in org.apache.hudi.util
-
A converter that converts a string array into internal row data fields.
- StringToRowDataConverter(LogicalType[]) - Constructor for class org.apache.hudi.util.StringToRowDataConverter
-
- subtaskFailed(int, Throwable) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- subtaskReady(int, OperatorCoordinator.SubtaskGateway) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- subtaskReset(int, long) - Method in class org.apache.hudi.sink.StreamWriteOperatorCoordinator
-
- supportsMultiPaths() - Method in class org.apache.hudi.table.format.cow.CopyOnWriteInputFormat
-
- supportsNestedProjection() - Method in class org.apache.hudi.table.HoodieTableSource
-
- TABLE_EXTERNAL - Static variable in class org.apache.hudi.table.catalog.CatalogOptions
-
- TABLE_NAME - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- TABLE_TYPE - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- TABLE_TYPE_COPY_ON_WRITE - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- TABLE_TYPE_MERGE_ON_READ - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- tableCommonOptions(Configuration) - Static method in class org.apache.hudi.table.catalog.CatalogOptions
-
Returns all the common table options that can be shared.
- TableDescriptor(ObjectIdentifier, ResolvedCatalogTable) - Constructor for class org.apache.hudi.util.HoodiePipeline.TableDescriptor
-
- tableExists(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieCatalog
-
- tableExists(ObjectPath) - Method in class org.apache.hudi.table.catalog.HoodieHiveCatalog
-
- tableExists(String, Configuration) - Static method in class org.apache.hudi.util.StreamerUtil
-
Returns whether the hoodie table exists under given path basePath.
- TableOptionProperties - Class in org.apache.hudi.table.catalog
-
Helper class to read/write flink table options as a map.
- TableOptionProperties() - Constructor for class org.apache.hudi.table.catalog.TableOptionProperties
-
- tableState(MergeOnReadTableState) - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputFormat.Builder
-
- tableType - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- targetBasePath - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- targetFileMaxBytes - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- targetPartitions - Variable in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
- targetTableName - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- taskEpochId - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- taskId - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- taskID - Variable in class org.apache.hudi.sink.common.AbstractStreamWriteFunction
-
Id of current subtask.
- taskID(int) - Method in class org.apache.hudi.sink.event.WriteMetadataEvent.Builder
-
- taskPartitionId - Variable in class org.apache.hudi.sink.bulk.BulkInsertWriterHelper
-
- TIME_ELAPSED - Static variable in class org.apache.hudi.configuration.FlinkOptions
-
- TIME_ELAPSED - Static variable in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
- timeout(long) - Method in class org.apache.hudi.sink.utils.TimeWait.Builder
-
- TimeWait - Class in org.apache.hudi.sink.utils
-
Tool used for time waiting.
- TimeWait.Builder - Class in org.apache.hudi.sink.utils
-
Builder.
- toFlinkConfig(FlinkClusteringConfig) - Static method in class org.apache.hudi.sink.clustering.FlinkClusteringConfig
-
Transforms a FlinkClusteringConfig.config into Configuration.
- toFlinkConfig(FlinkCompactionConfig) - Static method in class org.apache.hudi.sink.compact.FlinkCompactionConfig
-
Transforms a HoodieFlinkCompaction.config into Configuration.
- toFlinkConfig(FlinkStreamerConfig) - Static method in class org.apache.hudi.streamer.FlinkStreamerConfig
-
Transforms a HoodieFlinkStreamer.Config into Configuration.
- toFlinkPath(Path) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Transforms the Hadoop path to Flink path.
- toFlinkPaths(Path[]) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Transforms the array of Hadoop paths to Flink paths.
- toFlinkType(TypeInfo) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
-
Convert Hive data type to a Flink data type.
- toHiveTypeInfo(DataType) - Static method in class org.apache.hudi.table.catalog.HiveSchemaUtils
-
Convert Flink DataType to Hive TypeInfo.
- toRelativePartitionPaths(List<String>, List<Map<String, String>>, boolean) - Static method in class org.apache.hudi.table.format.FilePathUtils
-
Transforms the given partition key value mapping to relative partition paths.
- toString() - Method in class org.apache.hudi.sink.event.WriteMetadataEvent
-
- toString() - Method in class org.apache.hudi.sink.meta.CkpMessage
-
- toString() - Method in class org.apache.hudi.table.format.mor.MergeOnReadInputSplit
-
- Transformer - Interface in org.apache.hudi.sink.transform
-
Transform source stream to target stream before writing.
- transformerClassNames - Variable in class org.apache.hudi.streamer.FlinkStreamerConfig
-
- translateFlinkTableProperties2Spark(CatalogTable, Configuration, Map<String, String>, List<String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
-
- translateSparkTableProperties2Flink(Map<String, String>) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
-
- translateSparkTableProperties2Flink(Table) - Static method in class org.apache.hudi.table.catalog.TableOptionProperties
-
- transposeColumnStatsIndex(List<RowData>, String[], RowType) - Static method in class org.apache.hudi.source.stats.ColumnStatsIndices
-
Transposes and converts the raw table format of the Column Stats Index representation,
where each row/record corresponds to individual (column, file) pair, into the table format
where each row corresponds to single file with statistic for individual columns collated
w/in such row:
- type - Variable in class org.apache.hudi.source.stats.ExpressionEvaluator.Evaluator
-
- TypeInfoLogicalTypeVisitor - Class in org.apache.hudi.table.catalog
-
Create a TypeInfoLogicalTypeVisitor for hoodie table.