org.apache.hudi.common.table.log

Class HoodieMetadataMergedLogRecordScanner

java.lang.Object

org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader

org.apache.hudi.common.table.log.BaseHoodieMergedLogRecordScanner<String>

org.apache.hudi.common.table.log.HoodieMetadataMergedLogRecordScanner

All Implemented Interfaces:

Closeable, AutoCloseable, Iterable<HoodieRecord>

public class HoodieMetadataMergedLogRecordScanner
extends BaseHoodieMergedLogRecordScanner<String>

Merged log record scanner for metadata table using HoodieMetadataRecordMerger.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HoodieMetadataMergedLogRecordScanner.Builder Builder used to build HoodieMetadataMergedLogRecordScanner.

Nested classes/interfaces inherited from class org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader

AbstractHoodieLogRecordReader.KeySpec

Field Summary

Fields inherited from class org.apache.hudi.common.table.log.BaseHoodieMergedLogRecordScanner

records, timer

Fields inherited from class org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader

forceFullScan, hoodieTableMetaClient, logFilePaths, preCombineField, readerSchema, recordMerger, recordType

Method Summary

Modifier and Type	Method and Description
Map<String,HoodieRecord>	getRecords()
static HoodieMetadataMergedLogRecordScanner.Builder	newBuilder() Returns the builder for HoodieMetadataMergedLogRecordScanner.
<T> void	processNextRecord(HoodieRecord<T> newRecord) Process next record.

Methods inherited from class org.apache.hudi.common.table.log.BaseHoodieMergedLogRecordScanner

close, getLatestHoodieRecord, getNumMergedRecordsInLog, getRecordType, getTotalTimeTakenToReadAndMergeBlocks, iterator, processNextDeletedRecord, scan, scan, scanByFullKeys, scanByKeyPrefixes

Methods inherited from class org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader

getCurrentInstantLogBlocks, getPartitionNameOverride, getPayloadClassFQN, getPayloadProps, getProgress, getTotalCorruptBlocks, getTotalLogBlocks, getTotalLogFiles, getTotalLogRecords, getTotalRollbacks, getValidBlockInstants, isWithOperationField, scanInternal

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Method Detail

getRecords

public Map<String,HoodieRecord> getRecords()

Specified by:

getRecords in class BaseHoodieMergedLogRecordScanner<String>

processNextRecord

public <T> void processNextRecord(HoodieRecord<T> newRecord)
                           throws IOException

Description copied from class: AbstractHoodieLogRecordReader

Process next record.

Specified by:

processNextRecord in class AbstractHoodieLogRecordReader

Parameters:

newRecord - Hoodie Record to process

Throws:

IOException

newBuilder

public static HoodieMetadataMergedLogRecordScanner.Builder newBuilder()

Returns the builder for HoodieMetadataMergedLogRecordScanner.