Uses of Class
org.apache.hudi.common.model.FileSlice

Packages that use FileSlice

Package	Description
org.apache.hudi
org.apache.hudi.common.model
org.apache.hudi.common.table.cdc
org.apache.hudi.common.table.read
org.apache.hudi.common.table.timeline.dto
org.apache.hudi.common.table.view
org.apache.hudi.common.util
org.apache.hudi.metadata

Uses of FileSlice in org.apache.hudi

Methods in org.apache.hudi that return types with arguments of type FileSlice

Modifier and Type	Method and Description
protected Map<BaseHoodieTableFileIndex.PartitionPath,List<FileSlice>>	BaseHoodieTableFileIndex.getAllInputFileSlices() Returns all listed file-slices w/in the partition paths returned by BaseHoodieTableFileIndex.getAllQueryPartitionPaths()
protected Map<BaseHoodieTableFileIndex.PartitionPath,List<FileSlice>>	BaseHoodieTableFileIndex.getInputFileSlices(BaseHoodieTableFileIndex.PartitionPath... partitions) Get input file slice for the given partition.

Uses of FileSlice in org.apache.hudi.common.model

Methods in org.apache.hudi.common.model that return types with arguments of type FileSlice

Modifier and Type	Method and Description
Stream<FileSlice>	HoodieFileGroup.getAllFileSlices() Provides a stream of committed file slices, sorted reverse base commit time.
Stream<FileSlice>	HoodieFileGroup.getAllFileSlicesBeforeOn(String maxInstantTime)
Stream<FileSlice>	HoodieFileGroup.getAllFileSlicesIncludingInflight() Get all the file slices including in-flight ones as seen in underlying file system.
Stream<FileSlice>	HoodieFileGroup.getAllRawFileSlices()
Option<FileSlice>	HoodieFileGroup.getLatestFileSlice() Gets the latest slice - this can contain either.
Option<FileSlice>	HoodieFileGroup.getLatestFileSliceBefore(String maxInstantTime) Obtain the latest file slice, upto an instantTime i.e < maxInstantTime.
Option<FileSlice>	HoodieFileGroup.getLatestFileSliceBeforeOrOn(String maxInstantTime) Obtain the latest file slice, upto a instantTime i.e <= maxInstantTime.
Option<FileSlice>	HoodieFileGroup.getLatestFileSliceInRange(List<String> commitRange)
Option<FileSlice>	HoodieFileGroup.getLatestFileSlicesIncludingInflight() Get the latest file slices including inflight ones.

Methods in org.apache.hudi.common.model with parameters of type FileSlice

Modifier and Type	Method and Description
void	HoodieFileGroup.addFileSlice(FileSlice slice)

Constructors in org.apache.hudi.common.model with parameters of type FileSlice

Constructor and Description
FileSlice(FileSlice fileSlice)

Uses of FileSlice in org.apache.hudi.common.table.cdc

Methods in org.apache.hudi.common.table.cdc that return types with arguments of type FileSlice

Modifier and Type	Method and Description
Option<FileSlice>	HoodieCDCFileSplit.getAfterFileSlice()
Option<FileSlice>	HoodieCDCFileSplit.getBeforeFileSlice()

Constructor parameters in org.apache.hudi.common.table.cdc with type arguments of type FileSlice

Constructor and Description
HoodieCDCFileSplit(String instant, HoodieCDCInferenceCase cdcInferCase, Collection<String> cdcFiles, Option<FileSlice> beforeFileSlice, Option<FileSlice> afterFileSlice)
HoodieCDCFileSplit(String instant, HoodieCDCInferenceCase cdcInferCase, Collection<String> cdcFiles, Option<FileSlice> beforeFileSlice, Option<FileSlice> afterFileSlice)
HoodieCDCFileSplit(String instant, HoodieCDCInferenceCase cdcInferCase, String cdcFile, Option<FileSlice> beforeFileSlice, Option<FileSlice> afterFileSlice)
HoodieCDCFileSplit(String instant, HoodieCDCInferenceCase cdcInferCase, String cdcFile, Option<FileSlice> beforeFileSlice, Option<FileSlice> afterFileSlice)

Uses of FileSlice in org.apache.hudi.common.table.read

Constructors in org.apache.hudi.common.table.read with parameters of type FileSlice

Constructor and Description
HoodieFileGroupReader(HoodieReaderContext<T> readerContext, HoodieStorage storage, String tablePath, String latestCommitTime, FileSlice fileSlice, org.apache.avro.Schema dataSchema, org.apache.avro.Schema requestedSchema, Option<InternalSchema> internalSchemaOpt, HoodieTableMetaClient hoodieTableMetaClient, TypedProperties props, long start, long length, boolean shouldUseRecordPosition)

Uses of FileSlice in org.apache.hudi.common.table.timeline.dto

Methods in org.apache.hudi.common.table.timeline.dto that return FileSlice

Modifier and Type	Method and Description
static FileSlice	FileSliceDTO.toFileSlice(FileSliceDTO dto)

Methods in org.apache.hudi.common.table.timeline.dto with parameters of type FileSlice

Modifier and Type	Method and Description
static FileSliceDTO	FileSliceDTO.fromFileSlice(FileSlice slice)

Uses of FileSlice in org.apache.hudi.common.table.view

Methods in org.apache.hudi.common.table.view that return FileSlice

Modifier and Type	Method and Description
protected FileSlice	AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(FileSlice fileSlice)
protected FileSlice	AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(FileSlice fileSlice, Function<HoodieFileGroupId,Option<BootstrapBaseFileMapping>> bootstrapBaseFileMappingFunc)

Methods in org.apache.hudi.common.table.view that return types with arguments of type FileSlice

Modifier and Type	Method and Description
Option<FileSlice>	RocksDbBasedFileSystemView.fetchLatestFileSlice(String partitionPath, String fileId)
Option<FileSlice>	AbstractTableFileSystemView.fetchLatestFileSlice(String partitionPath, String fileId) Default implementation for fetching file-slice.
Option<FileSlice>	RocksDbBasedFileSystemView.fetchLatestFileSliceBeforeOrOn(String partitionPath, String fileId, String instantTime)
Stream<FileSlice>	TableFileSystemView.SliceView.getAllFileSlices(String partitionPath) Stream all the file slices for a given partition, latest or not.
Stream<FileSlice>	AbstractTableFileSystemView.getAllFileSlices(String partitionStr)
Stream<FileSlice>	PriorityBasedFileSystemView.getAllFileSlices(String partitionPath)
Stream<FileSlice>	RemoteHoodieTableFileSystemView.getAllFileSlices(String partitionPath)
Map<String,Stream<FileSlice>>	TableFileSystemView.SliceViewWithLatestSlice.getAllLatestFileSlicesBeforeOrOn(String maxCommitTime) Stream all latest file slices with precondition that commitTime(file) before maxCommitTime.
Map<String,Stream<FileSlice>>	AbstractTableFileSystemView.getAllLatestFileSlicesBeforeOrOn(String maxCommitTime)
Map<String,Stream<FileSlice>>	PriorityBasedFileSystemView.getAllLatestFileSlicesBeforeOrOn(String maxCommitTime)
Map<String,Stream<FileSlice>>	RemoteHoodieTableFileSystemView.getAllLatestFileSlicesBeforeOrOn(String maxCommitTime)
Stream<FileSlice>	AbstractTableFileSystemView.getAllLogsMergedFileSliceBeforeOrOn(String partitionStr, String maxInstantTime) Stream all "merged" file-slices before on an instant time for a MERGE_ON_READ table with index that can index log files(which means it writes pure logs first).
Option<FileSlice>	TableFileSystemView.SliceViewWithLatestSlice.getLatestFileSlice(String partitionPath, String fileId) Get Latest File Slice for a given fileId in a given partition.
Option<FileSlice>	AbstractTableFileSystemView.getLatestFileSlice(String partitionStr, String fileId) Get Latest File Slice for a given fileId in a given partition.
Option<FileSlice>	PriorityBasedFileSystemView.getLatestFileSlice(String partitionPath, String fileId)
Option<FileSlice>	RemoteHoodieTableFileSystemView.getLatestFileSlice(String partitionPath, String fileId)
Stream<FileSlice>	TableFileSystemView.SliceViewWithLatestSlice.getLatestFileSliceInRange(List<String> commitsToReturn) Stream all the latest file slices, in the given range.
Stream<FileSlice>	AbstractTableFileSystemView.getLatestFileSliceInRange(List<String> commitsToReturn)
Stream<FileSlice>	PriorityBasedFileSystemView.getLatestFileSliceInRange(List<String> commitsToReturn)
Stream<FileSlice>	RemoteHoodieTableFileSystemView.getLatestFileSliceInRange(List<String> commitsToReturn)
Stream<FileSlice>	TableFileSystemView.SliceViewWithLatestSlice.getLatestFileSlices(String partitionPath) Stream all the latest file slices in the given partition.
Stream<FileSlice>	AbstractTableFileSystemView.getLatestFileSlices(String partitionStr)
Stream<FileSlice>	PriorityBasedFileSystemView.getLatestFileSlices(String partitionPath)
Stream<FileSlice>	RemoteHoodieTableFileSystemView.getLatestFileSlices(String partitionPath)
Stream<FileSlice>	TableFileSystemView.SliceViewWithLatestSlice.getLatestFileSlicesBeforeOrOn(String partitionPath, String maxCommitTime, boolean includeFileSlicesInPendingCompaction) Stream all latest file slices in given partition with precondition that commitTime(file) before maxCommitTime.
Stream<FileSlice>	AbstractTableFileSystemView.getLatestFileSlicesBeforeOrOn(String partitionStr, String maxCommitTime, boolean includeFileSlicesInPendingCompaction)
Stream<FileSlice>	PriorityBasedFileSystemView.getLatestFileSlicesBeforeOrOn(String partitionPath, String maxCommitTime, boolean includeFileSlicesInPendingCompaction)
Stream<FileSlice>	RemoteHoodieTableFileSystemView.getLatestFileSlicesBeforeOrOn(String partitionPath, String maxCommitTime, boolean includeFileSlicesInPendingCompaction)
Stream<FileSlice>	TableFileSystemView.SliceViewWithLatestSlice.getLatestFileSlicesIncludingInflight(String partitionPath) Get the latest file slices for a given partition including the inflight ones.
Stream<FileSlice>	AbstractTableFileSystemView.getLatestFileSlicesIncludingInflight(String partitionPath)
Stream<FileSlice>	PriorityBasedFileSystemView.getLatestFileSlicesIncludingInflight(String partitionPath)
Stream<FileSlice>	RemoteHoodieTableFileSystemView.getLatestFileSlicesIncludingInflight(String partitionPath)
Stream<FileSlice>	TableFileSystemView.SliceViewWithLatestSlice.getLatestFileSlicesStateless(String partitionPath) Stream all the latest file slices in the given partition without caching the file group mappings.
Stream<FileSlice>	AbstractTableFileSystemView.getLatestFileSlicesStateless(String partitionStr)
Stream<FileSlice>	PriorityBasedFileSystemView.getLatestFileSlicesStateless(String partitionPath)
Stream<FileSlice>	RemoteHoodieTableFileSystemView.getLatestFileSlicesStateless(String partitionPath)
Stream<FileSlice>	TableFileSystemView.SliceViewWithLatestSlice.getLatestMergedFileSlicesBeforeOrOn(String partitionPath, String maxInstantTime) Stream all "merged" file-slices before on an instant time If a file-group has a pending compaction request, the file-slice before and after compaction request instant is merged and returned.
Stream<FileSlice>	AbstractTableFileSystemView.getLatestMergedFileSlicesBeforeOrOn(String partitionStr, String maxInstantTime)
Stream<FileSlice>	PriorityBasedFileSystemView.getLatestMergedFileSlicesBeforeOrOn(String partitionPath, String maxInstantTime)
Stream<FileSlice>	RemoteHoodieTableFileSystemView.getLatestMergedFileSlicesBeforeOrOn(String partitionPath, String maxInstantTime)
Stream<FileSlice>	TableFileSystemView.SliceViewWithLatestSlice.getLatestUnCompactedFileSlices(String partitionPath) Stream all the latest uncompacted file slices in the given partition.
Stream<FileSlice>	AbstractTableFileSystemView.getLatestUnCompactedFileSlices(String partitionStr)
Stream<FileSlice>	PriorityBasedFileSystemView.getLatestUnCompactedFileSlices(String partitionPath)
Stream<FileSlice>	RemoteHoodieTableFileSystemView.getLatestUnCompactedFileSlices(String partitionPath)

Methods in org.apache.hudi.common.table.view with parameters of type FileSlice

Modifier and Type	Method and Description
protected FileSlice	AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(FileSlice fileSlice)
protected FileSlice	AbstractTableFileSystemView.addBootstrapBaseFileIfPresent(FileSlice fileSlice, Function<HoodieFileGroupId,Option<BootstrapBaseFileMapping>> bootstrapBaseFileMappingFunc)

Uses of FileSlice in org.apache.hudi.common.util

Methods in org.apache.hudi.common.util with parameters of type FileSlice

Modifier and Type	Method and Description
static HoodieCompactionOperation	CompactionUtils.buildFromFileSlice(String partitionPath, FileSlice fileSlice, Option<Function<Pair<String,FileSlice>,Map<String,Double>>> metricsCaptureFunction) Generate compaction operation from file-slice.
String	RocksDBSchemaHelper.getKeyForDataFileView(HoodieFileGroup fileGroup, FileSlice slice)
String	RocksDBSchemaHelper.getKeyForSliceView(HoodieFileGroup fileGroup, FileSlice slice)

Method parameters in org.apache.hudi.common.util with type arguments of type FileSlice

Modifier and Type	Method and Description
static HoodieCompactionOperation	CompactionUtils.buildFromFileSlice(String partitionPath, FileSlice fileSlice, Option<Function<Pair<String,FileSlice>,Map<String,Double>>> metricsCaptureFunction) Generate compaction operation from file-slice.
static HoodieCompactionPlan	CompactionUtils.buildFromFileSlices(List<Pair<String,FileSlice>> partitionFileSlicePairs, Option<Map<String,String>> extraMetadata, Option<Function<Pair<String,FileSlice>,Map<String,Double>>> metricsCaptureFunction) Generate compaction plan from file-slices.
static HoodieCompactionPlan	CompactionUtils.buildFromFileSlices(List<Pair<String,FileSlice>> partitionFileSlicePairs, Option<Map<String,String>> extraMetadata, Option<Function<Pair<String,FileSlice>,Map<String,Double>>> metricsCaptureFunction) Generate compaction plan from file-slices.

Uses of FileSlice in org.apache.hudi.metadata

Methods in org.apache.hudi.metadata that return types with arguments of type FileSlice

Modifier and Type	Method and Description
static List<FileSlice>	HoodieTableMetadataUtil.getPartitionLatestFileSlices(HoodieTableMetaClient metaClient, Option<HoodieTableFileSystemView> fsView, String partition) Get the latest file slices for a Metadata Table partition.
static List<FileSlice>	HoodieTableMetadataUtil.getPartitionLatestFileSlicesIncludingInflight(HoodieTableMetaClient metaClient, Option<HoodieTableFileSystemView> fileSystemView, String partition) Get the latest file slices for a given partition including the inflight ones.
static List<FileSlice>	HoodieTableMetadataUtil.getPartitionLatestMergedFileSlices(HoodieTableMetaClient metaClient, HoodieTableFileSystemView fsView, String partition) Get the latest file slices for a Metadata Table partition.

Method parameters in org.apache.hudi.metadata with type arguments of type FileSlice

Modifier and Type	Method and Description
static HoodieData<HoodieRecord>	HoodieTableMetadataUtil.readRecordKeysFromFileSlices(HoodieEngineContext engineContext, List<Pair<String,FileSlice>> partitionFileSlicePairs, boolean forDelete, int recordIndexMaxParallelism, String activeModule, HoodieTableMetaClient metaClient, EngineType engineType) Reads the record keys from the given file slices and returns a HoodieData of HoodieRecord to be updated in the metadata table.
static HoodieData<HoodieRecord>	HoodieTableMetadataUtil.readSecondaryKeysFromFileSlices(HoodieEngineContext engineContext, List<Pair<String,FileSlice>> partitionFileSlicePairs, int secondaryIndexMaxParallelism, String activeModule, HoodieTableMetaClient metaClient, EngineType engineType, HoodieIndexDefinition indexDefinition)