T - public class HoodieGlobalSimpleIndex<T extends HoodieRecordPayload<T>> extends HoodieSimpleIndex<T>
HoodieIndex.IndexTypeconfig| Constructor and Description |
|---|
HoodieGlobalSimpleIndex(HoodieWriteConfig config,
Option<BaseKeyGenerator> keyGeneratorOpt) |
| Modifier and Type | Method and Description |
|---|---|
protected HoodiePairData<HoodieKey,HoodieRecordLocation> |
fetchAllRecordLocations(HoodieEngineContext context,
HoodieTable hoodieTable,
int parallelism)
Fetch record locations for passed in
HoodieKeys. |
protected List<Pair<String,HoodieBaseFile>> |
getAllBaseFilesInTable(HoodieEngineContext context,
HoodieTable hoodieTable)
Load all files for all partitions as
|
boolean |
isGlobal()
An index is `global` if
HoodieKey to fileID mapping, does not depend on the `partitionPath`. |
HoodieData<HoodieRecord<T>> |
tagLocation(HoodieData<HoodieRecord<T>> records,
HoodieEngineContext context,
HoodieTable hoodieTable)
Looks up the index and tags each incoming record with a location of a file that contains
the row (if it is actually present).
|
protected HoodieData<HoodieRecord<T>> |
tagLocationInternal(HoodieData<HoodieRecord<T>> inputRecords,
HoodieEngineContext context,
HoodieTable hoodieTable)
Tags records location for incoming records.
|
canIndexLogFiles, fetchRecordLocations, fetchRecordLocationsForAffectedPartitions, isImplicitWithStorage, rollbackCommit, updateLocationclose, tagLocation, updateLocationpublic HoodieGlobalSimpleIndex(HoodieWriteConfig config, Option<BaseKeyGenerator> keyGeneratorOpt)
public HoodieData<HoodieRecord<T>> tagLocation(HoodieData<HoodieRecord<T>> records, HoodieEngineContext context, HoodieTable hoodieTable)
HoodieIndextagLocation in class HoodieSimpleIndex<T extends HoodieRecordPayload<T>>protected HoodieData<HoodieRecord<T>> tagLocationInternal(HoodieData<HoodieRecord<T>> inputRecords, HoodieEngineContext context, HoodieTable hoodieTable)
tagLocationInternal in class HoodieSimpleIndex<T extends HoodieRecordPayload<T>>inputRecords - HoodieData of incoming recordscontext - instance of HoodieEngineContext to usehoodieTable - instance of HoodieTable to useHoodieData of records with record locations setprotected HoodiePairData<HoodieKey,HoodieRecordLocation> fetchAllRecordLocations(HoodieEngineContext context, HoodieTable hoodieTable, int parallelism)
HoodieKeys.context - instance of HoodieEngineContext to usehoodieTable - instance of HoodieTable of interestparallelism - parallelism to useHoodiePairData of HoodieKey and HoodieRecordLocationprotected List<Pair<String,HoodieBaseFile>> getAllBaseFilesInTable(HoodieEngineContext context, HoodieTable hoodieTable)
public boolean isGlobal()
HoodieIndexHoodieKey to fileID mapping, does not depend on the `partitionPath`. Such an
implementation is able to obtain the same mapping, for two hoodie keys with same `recordKey` but different
`partitionPath`isGlobal in class HoodieSimpleIndex<T extends HoodieRecordPayload<T>>Copyright © 2022 The Apache Software Foundation. All rights reserved.