org.apache.hudi.common.table.read

Interface HoodieFileGroupRecordBuffer<T>

All Known Implementing Classes:

HoodieBaseFileGroupRecordBuffer, HoodieKeyBasedFileGroupRecordBuffer, HoodiePositionBasedFileGroupRecordBuffer, HoodieUnmergedFileGroupRecordBuffer

public interface HoodieFileGroupRecordBuffer<T>

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	HoodieFileGroupRecordBuffer.BufferType

Method Summary

Modifier and Type	Method and Description
void	close()
boolean	containsLogRecord(String recordKey) Check if a record exists in the buffered records.
HoodieFileGroupRecordBuffer.BufferType	getBufferType()
Iterator<Pair<Option<T>,Map<String,Object>>>	getLogRecordIterator()
Map<Serializable,Pair<Option<T>,Map<String,Object>>>	getLogRecords()
boolean	hasNext() Check if next merged record exists.
T	next()
void	processDataBlock(HoodieDataBlock dataBlock, Option<KeySpec> keySpecOpt) Process a log data block, and store the resulting records into the buffer.
void	processDeleteBlock(HoodieDeleteBlock deleteBlock) Process a log delete block, and store the resulting records into the buffer.
void	processNextDataRecord(T record, Map<String,Object> metadata, Serializable index) Process a next record in a log data block.
void	processNextDeletedRecord(DeleteRecord deleteRecord, Serializable index) Process next delete record.
void	setBaseFileIterator(ClosableIterator<T> baseFileIterator) Link the base file iterator for consequential merge.
int	size()

Method Detail

getBufferType

HoodieFileGroupRecordBuffer.BufferType getBufferType()

Returns:

The merge strategy implemented.

processDataBlock

void processDataBlock(HoodieDataBlock dataBlock,
                      Option<KeySpec> keySpecOpt)
               throws IOException

Process a log data block, and store the resulting records into the buffer.

Parameters:

dataBlock -

keySpecOpt -

Throws:

IOException

processNextDataRecord

void processNextDataRecord(T record,
                           Map<String,Object> metadata,
                           Serializable index)
                    throws IOException

Process a next record in a log data block.

Parameters:

record -

metadata -

Throws:

Exception

IOException

processDeleteBlock

void processDeleteBlock(HoodieDeleteBlock deleteBlock)
                 throws IOException

Process a log delete block, and store the resulting records into the buffer.

Parameters:

deleteBlock -

Throws:

IOException

processNextDeletedRecord

void processNextDeletedRecord(DeleteRecord deleteRecord,
                              Serializable index)

Process next delete record.

Parameters:

deleteRecord -

containsLogRecord

boolean containsLogRecord(String recordKey)

Check if a record exists in the buffered records.

size

int size()

Returns:

the number of log records in the buffer.

getLogRecordIterator

Iterator<Pair<Option<T>,Map<String,Object>>> getLogRecordIterator()

Returns:

An iterator on the log records.

getLogRecords

Map<Serializable,Pair<Option<T>,Map<String,Object>>> getLogRecords()

Returns:

The underlying data stored in the buffer.

setBaseFileIterator

void setBaseFileIterator(ClosableIterator<T> baseFileIterator)

Link the base file iterator for consequential merge.

Parameters:

baseFileIterator -

hasNext

boolean hasNext()
         throws IOException

Check if next merged record exists.

Returns:

true if it has, otherwise false.

Throws:

IOException

next

T next()

Returns:

output the next merged record.

close

void close()