| Package | Description |
|---|---|
| org.apache.hudi.common.table | |
| org.apache.hudi.metadata |
| Modifier and Type | Method and Description |
|---|---|
boolean |
HoodieTableConfig.isMetadataPartitionAvailable(MetadataPartitionType metadataPartitionType)
Checks if metadata table is enabled and the specified partition has been initialized.
|
void |
HoodieTableConfig.setMetadataPartitionsInflight(HoodieTableMetaClient metaClient,
MetadataPartitionType... partitionTypes) |
| Modifier and Type | Method and Description |
|---|---|
static MetadataPartitionType |
MetadataPartitionType.fromPartitionPath(String partitionPath) |
static MetadataPartitionType |
MetadataPartitionType.valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static MetadataPartitionType[] |
MetadataPartitionType.values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
| Modifier and Type | Method and Description |
|---|---|
static Map<MetadataPartitionType,HoodieData<HoodieRecord>> |
HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext engineContext,
HoodieCleanMetadata cleanMetadata,
String instantTime,
HoodieTableMetaClient dataMetaClient,
List<MetadataPartitionType> enabledPartitionTypes,
int bloomIndexParallelism,
boolean isColumnStatsIndexEnabled,
int columnStatsIndexParallelism,
List<String> targetColumnsForColumnStatsIndex)
Convert the clean action to metadata records.
|
static Map<MetadataPartitionType,HoodieData<HoodieRecord>> |
HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext context,
HoodieConfig hoodieConfig,
HoodieCommitMetadata commitMetadata,
String instantTime,
HoodieTableMetaClient dataMetaClient,
List<MetadataPartitionType> enabledPartitionTypes,
String bloomFilterType,
int bloomIndexParallelism,
boolean isColumnStatsIndexEnabled,
int columnStatsIndexParallelism,
List<String> targetColumnsForColumnStatsIndex,
HoodieMetadataConfig metadataConfig)
Convert commit action to metadata records for the enabled partition types.
|
static Map<MetadataPartitionType,HoodieData<HoodieRecord>> |
HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext engineContext,
HoodieTableMetaClient dataTableMetaClient,
HoodieRollbackMetadata rollbackMetadata,
String instantTime)
Convert rollback action metadata to metadata table records.
|
static Map<MetadataPartitionType,HoodieData<HoodieRecord>> |
HoodieTableMetadataUtil.convertMissingPartitionRecords(HoodieEngineContext engineContext,
List<String> deletedPartitions,
Map<String,Map<String,Long>> filesAdded,
Map<String,List<String>> filesDeleted,
String instantTime) |
static List<MetadataPartitionType> |
MetadataPartitionType.getEnabledPartitions(TypedProperties writeConfig,
HoodieTableMetaClient metaClient)
Returns the list of metadata partition types enabled based on the metadata config and table config.
|
static List<MetadataPartitionType> |
MetadataPartitionType.getMetadataPartitionsNeedingWriteStatusTracking()
Returns the list of metadata table partitions which require WriteStatus to track written records.
|
| Modifier and Type | Method and Description |
|---|---|
static int |
HoodieTableMetadataUtil.estimateFileGroupCount(MetadataPartitionType partitionType,
long recordCount,
int averageRecordSize,
int minFileGroupCount,
int maxFileGroupCount,
float growthFactor,
int maxFileGroupSizeBytes)
Estimates the file group count to use for a MDT partition.
|
static String |
HoodieTableMetadataUtil.getFileIDForFileGroup(MetadataPartitionType partitionType,
int index)
Return the complete fileID for a file group within a MDT partition.
|
int |
FileSystemBackedTableMetadata.getNumFileGroupsForPartition(MetadataPartitionType partition) |
int |
HoodieBackedTableMetadata.getNumFileGroupsForPartition(MetadataPartitionType partition) |
int |
HoodieTableMetadata.getNumFileGroupsForPartition(MetadataPartitionType partition)
Returns the number of shards in a metadata table partition.
|
| Modifier and Type | Method and Description |
|---|---|
static Map<MetadataPartitionType,HoodieData<HoodieRecord>> |
HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext engineContext,
HoodieCleanMetadata cleanMetadata,
String instantTime,
HoodieTableMetaClient dataMetaClient,
List<MetadataPartitionType> enabledPartitionTypes,
int bloomIndexParallelism,
boolean isColumnStatsIndexEnabled,
int columnStatsIndexParallelism,
List<String> targetColumnsForColumnStatsIndex)
Convert the clean action to metadata records.
|
static Map<MetadataPartitionType,HoodieData<HoodieRecord>> |
HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext context,
HoodieConfig hoodieConfig,
HoodieCommitMetadata commitMetadata,
String instantTime,
HoodieTableMetaClient dataMetaClient,
List<MetadataPartitionType> enabledPartitionTypes,
String bloomFilterType,
int bloomIndexParallelism,
boolean isColumnStatsIndexEnabled,
int columnStatsIndexParallelism,
List<String> targetColumnsForColumnStatsIndex,
HoodieMetadataConfig metadataConfig)
Convert commit action to metadata records for the enabled partition types.
|
Copyright © 2024 The Apache Software Foundation. All rights reserved.