org.apache.hudi.index

Class HoodieIndexUtils

java.lang.Object

org.apache.hudi.index.HoodieIndexUtils

public class HoodieIndexUtils
extends Object

Hoodie Index Utilities.

Constructor Summary

Constructors

Constructor and Description
HoodieIndexUtils()

Method Summary

Modifier and Type	Method and Description
static List<String>	filterKeysFromFile(org.apache.hadoop.fs.Path filePath, List<String> candidateRecordKeys, org.apache.hadoop.conf.Configuration configuration) Given a list of row keys and one file, return only row keys existing in that file.
static List<Pair<String,HoodieBaseFile>>	getLatestBaseFilesForAllPartitions(List<String> partitions, HoodieEngineContext context, HoodieTable hoodieTable) Fetches Pair of partition path and HoodieBaseFiles for interested partitions.
static List<HoodieBaseFile>	getLatestBaseFilesForPartition(String partition, HoodieTable hoodieTable) Fetches Pair of partition path and HoodieBaseFiles for interested partitions.
static HoodieRecord	getTaggedRecord(HoodieRecord inputRecord, Option<HoodieRecordLocation> location) Get tagged record for the passed in HoodieRecord.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieIndexUtils

public HoodieIndexUtils()

Method Detail

getLatestBaseFilesForPartition

public static List<HoodieBaseFile> getLatestBaseFilesForPartition(String partition,
                                                                  HoodieTable hoodieTable)

Fetches Pair of partition path and HoodieBaseFiles for interested partitions.

Parameters:

partition - Partition of interest

hoodieTable - Instance of HoodieTable of interest

Returns:

the list of HoodieBaseFile

getLatestBaseFilesForAllPartitions

public static List<Pair<String,HoodieBaseFile>> getLatestBaseFilesForAllPartitions(List<String> partitions,
                                                                                   HoodieEngineContext context,
                                                                                   HoodieTable hoodieTable)

Fetches Pair of partition path and HoodieBaseFiles for interested partitions.

Parameters:

partitions - list of partitions of interest

context - instance of HoodieEngineContext to use

hoodieTable - instance of HoodieTable of interest

Returns:

the list of Pairs of partition path and fileId

getTaggedRecord

public static HoodieRecord getTaggedRecord(HoodieRecord inputRecord,
                                           Option<HoodieRecordLocation> location)

Get tagged record for the passed in HoodieRecord.

Parameters:

inputRecord - instance of HoodieRecord for which tagging is requested

location - HoodieRecordLocation for the passed in HoodieRecord

Returns:

the tagged HoodieRecord

filterKeysFromFile

public static List<String> filterKeysFromFile(org.apache.hadoop.fs.Path filePath,
                                              List<String> candidateRecordKeys,
                                              org.apache.hadoop.conf.Configuration configuration)
                                       throws HoodieIndexException

Given a list of row keys and one file, return only row keys existing in that file.

Parameters:

filePath - - File to filter keys from

candidateRecordKeys - - Candidate keys to filter

Returns:

List of candidate keys that are available in the file

Throws:

HoodieIndexException