org.apache.hudi.common.table.read

Class HoodieFileGroupReader<T>

java.lang.Object

org.apache.hudi.common.table.read.HoodieFileGroupReader<T>

Type Parameters:

T - The type of engine-specific record representation, e.g.,InternalRow in Spark and RowData in Flink.

All Implemented Interfaces:

Closeable, AutoCloseable

public final class HoodieFileGroupReader<T>
extends Object
implements Closeable

A file group reader that iterates through the records in a single file group.

This should be used by the every engine integration, by plugging in a HoodieReaderContext implementation.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HoodieFileGroupReader.HoodieFileGroupReaderIterator<T>

Constructor Summary

Constructors

Constructor and Description
HoodieFileGroupReader(HoodieReaderContext<T> readerContext, HoodieStorage storage, String tablePath, String latestCommitTime, FileSlice fileSlice, org.apache.avro.Schema dataSchema, org.apache.avro.Schema requestedSchema, Option<InternalSchema> internalSchemaOpt, HoodieTableMetaClient hoodieTableMetaClient, TypedProperties props, long start, long length, boolean shouldUseRecordPosition)

Method Summary

Modifier and Type	Method and Description
void	close()
HoodieFileGroupReader.HoodieFileGroupReaderIterator<T>	getClosableIterator()
static RecordMergeMode	getRecordMergeMode(Properties props)
boolean	hasNext()
void	initRecordIterators() Initialize internal iterators on the base and log files.
T	next()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieFileGroupReader

public HoodieFileGroupReader(HoodieReaderContext<T> readerContext,
                             HoodieStorage storage,
                             String tablePath,
                             String latestCommitTime,
                             FileSlice fileSlice,
                             org.apache.avro.Schema dataSchema,
                             org.apache.avro.Schema requestedSchema,
                             Option<InternalSchema> internalSchemaOpt,
                             HoodieTableMetaClient hoodieTableMetaClient,
                             TypedProperties props,
                             long start,
                             long length,
                             boolean shouldUseRecordPosition)

Method Detail

initRecordIterators

public void initRecordIterators()
                         throws IOException

Initialize internal iterators on the base and log files.

Throws:

IOException

hasNext

public boolean hasNext()
                throws IOException

Returns:

true if the next record exists; false otherwise.

Throws:

IOException - on reader error.

next

public T next()

Returns:

The next record after calling hasNext().

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

getClosableIterator

public HoodieFileGroupReader.HoodieFileGroupReaderIterator<T> getClosableIterator()

getRecordMergeMode

public static RecordMergeMode getRecordMergeMode(Properties props)