org.apache.hudi.index.bucket

Class HoodieSimpleBucketIndex

java.lang.Object

org.apache.hudi.index.HoodieIndex<Object,Object>

org.apache.hudi.index.bucket.HoodieBucketIndex

org.apache.hudi.index.bucket.HoodieSimpleBucketIndex

All Implemented Interfaces:

Serializable

public class HoodieSimpleBucketIndex
extends HoodieBucketIndex

Simple bucket index implementation, with fixed bucket number.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hudi.index.HoodieIndex

HoodieIndex.BucketIndexEngineType, HoodieIndex.IndexType

Field Summary

Fields inherited from class org.apache.hudi.index.bucket.HoodieBucketIndex

indexKeyFields, numBuckets

Fields inherited from class org.apache.hudi.index.HoodieIndex

config

Constructor Summary

Constructors

Constructor and Description
HoodieSimpleBucketIndex(HoodieWriteConfig config)

Method Summary

Modifier and Type	Method and Description
boolean	canIndexLogFiles() This is used by storage to determine, if it is safe to send inserts, straight to the log, i.e.
List<String>	findConflictInstantsInPartition(HoodieTable hoodieTable, String partition, int bucketId, Set<String> pendingInstants) Find out the conflict instants with given partition and bucket id.
int	getBucketID(HoodieKey key)
Boolean	hasPendingDataFilesForInstant(List<StoragePathInfo> filesInPartition, String instant, int bucketId)
Map<Integer,HoodieRecordLocation>	loadBucketIdToFileIdMappingForPartition(HoodieTable hoodieTable, String partition)
<R> HoodieData<HoodieRecord<R>>	tagLocation(HoodieData<HoodieRecord<R>> records, HoodieEngineContext context, HoodieTable hoodieTable) Looks up the index and tags each incoming record with a location of a file that contains the row (if it is actually present).

Methods inherited from class org.apache.hudi.index.bucket.HoodieBucketIndex

getNumBuckets, isGlobal, isImplicitWithStorage, requiresTagging, rollbackCommit, updateLocation

Methods inherited from class org.apache.hudi.index.HoodieIndex

close, tagLocation, updateLocation, updateLocation

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieSimpleBucketIndex

public HoodieSimpleBucketIndex(HoodieWriteConfig config)

Method Detail

loadBucketIdToFileIdMappingForPartition

public Map<Integer,HoodieRecordLocation> loadBucketIdToFileIdMappingForPartition(HoodieTable hoodieTable,
                                                                                 String partition)

findConflictInstantsInPartition

public List<String> findConflictInstantsInPartition(HoodieTable hoodieTable,
                                                    String partition,
                                                    int bucketId,
                                                    Set<String> pendingInstants)

Find out the conflict instants with given partition and bucket id.

hasPendingDataFilesForInstant

public Boolean hasPendingDataFilesForInstant(List<StoragePathInfo> filesInPartition,
                                             String instant,
                                             int bucketId)

getBucketID

public int getBucketID(HoodieKey key)

canIndexLogFiles

public boolean canIndexLogFiles()

Description copied from class: HoodieIndex

This is used by storage to determine, if it is safe to send inserts, straight to the log, i.e. having a FileSlice, with no data file.

Overrides:

canIndexLogFiles in class HoodieBucketIndex

Returns:

Returns true/false depending on whether the impl has this capability

tagLocation

public <R> HoodieData<HoodieRecord<R>> tagLocation(HoodieData<HoodieRecord<R>> records,
                                                   HoodieEngineContext context,
                                                   HoodieTable hoodieTable)
                                            throws HoodieIndexException

Description copied from class: HoodieIndex

Looks up the index and tags each incoming record with a location of a file that contains the row (if it is actually present).

Specified by:

tagLocation in class HoodieIndex<Object,Object>

Throws:

HoodieIndexException