| Package | Description |
|---|---|
| org.apache.hudi.common.model | |
| org.apache.hudi.common.table.timeline | |
| org.apache.hudi.common.util | |
| org.apache.hudi.metadata |
| Modifier and Type | Class and Description |
|---|---|
class |
HoodieReplaceCommitMetadata
All the metadata that gets stored along with a commit.
|
| Modifier and Type | Method and Description |
|---|---|
HoodieCommitMetadata |
HoodieMetadataWrapper.getCommitMetadata() |
| Constructor and Description |
|---|
HoodieMetadataWrapper(HoodieCommitMetadata commitMetadata) |
| Modifier and Type | Method and Description |
|---|---|
static HoodieCommitMetadata |
TimelineUtils.getCommitMetadata(HoodieInstant instant,
HoodieTimeline timeline)
Returns the commit metadata of the given instant.
|
| Modifier and Type | Method and Description |
|---|---|
static Option<HoodieCommitMetadata> |
MetadataConversionUtils.getHoodieCommitMetadata(HoodieTableMetaClient metaClient,
HoodieInstant hoodieInstant) |
Option<Pair<HoodieInstant,HoodieCommitMetadata>> |
HoodieActiveTimeline.getLastCommitMetadataWithValidData()
Get the last instant with valid data, and convert this to HoodieCommitMetadata
|
Option<Pair<HoodieInstant,HoodieCommitMetadata>> |
HoodieActiveTimeline.getLastCommitMetadataWithValidSchema()
Returns most recent instant having valid schema in its
HoodieCommitMetadata |
| Modifier and Type | Method and Description |
|---|---|
static <T extends org.apache.avro.specific.SpecificRecordBase> |
MetadataConversionUtils.convertCommitMetadata(HoodieCommitMetadata hoodieCommitMetadata)
Convert commit metadata from json to avro.
|
static Option<byte[]> |
TimelineMetadataUtils.serializeCommitMetadata(HoodieCommitMetadata commitMetadata) |
| Modifier and Type | Method and Description |
|---|---|
static HoodieCommitMetadata |
CommitUtils.buildMetadata(List<HoodieWriteStat> writeStats,
Map<String,List<String>> partitionToReplaceFileIds,
Option<Map<String,String>> extraMetadata,
WriteOperationType operationType,
String schemaToStoreInCommit,
String commitActionType) |
| Modifier and Type | Method and Description |
|---|---|
static Option<HoodieCommitMetadata> |
CommitUtils.buildMetadataFromInstant(HoodieDefaultTimeline timeline,
HoodieInstant instant) |
| Modifier and Type | Method and Description |
|---|---|
static HoodieData<HoodieRecord> |
HoodieTableMetadataUtil.convertMetadataToBloomFilterRecords(HoodieEngineContext context,
HoodieConfig hoodieConfig,
HoodieCommitMetadata commitMetadata,
String instantTime,
HoodieTableMetaClient dataMetaClient,
String bloomFilterType,
int bloomIndexParallelism)
Convert commit action metadata to bloom filter records.
|
static HoodieData<HoodieRecord> |
HoodieTableMetadataUtil.convertMetadataToColumnStatsRecords(HoodieCommitMetadata commitMetadata,
HoodieEngineContext engineContext,
HoodieTableMetaClient dataMetaClient,
boolean isColumnStatsIndexEnabled,
int columnStatsIndexParallelism,
List<String> targetColumnsForColumnStatsIndex) |
static List<HoodieRecord> |
HoodieTableMetadataUtil.convertMetadataToFilesPartitionRecords(HoodieCommitMetadata commitMetadata,
String instantTime)
Finds all new files/partitions created as part of commit and creates metadata table records for them.
|
static HoodieData<HoodieRecord> |
HoodieTableMetadataUtil.convertMetadataToPartitionStatsRecords(HoodieCommitMetadata commitMetadata,
HoodieEngineContext engineContext,
HoodieTableMetaClient dataMetaClient,
HoodieMetadataConfig metadataConfig) |
static Map<MetadataPartitionType,HoodieData<HoodieRecord>> |
HoodieTableMetadataUtil.convertMetadataToRecords(HoodieEngineContext context,
HoodieConfig hoodieConfig,
HoodieCommitMetadata commitMetadata,
String instantTime,
HoodieTableMetaClient dataMetaClient,
List<MetadataPartitionType> enabledPartitionTypes,
String bloomFilterType,
int bloomIndexParallelism,
boolean isColumnStatsIndexEnabled,
int columnStatsIndexParallelism,
List<String> targetColumnsForColumnStatsIndex,
HoodieMetadataConfig metadataConfig)
Convert commit action to metadata records for the enabled partition types.
|
| Modifier and Type | Method and Description |
|---|---|
static Set<String> |
HoodieTableMetadataUtil.getWritePartitionPaths(List<HoodieCommitMetadata> metadataList)
Returns all the incremental write partition paths as a set with the given commits metadata.
|
Copyright © 2024 The Apache Software Foundation. All rights reserved.