org.apache.hudi.io.storage

Interface HoodieFileReader<T>

Type Parameters:

T - target engine-specific representation of the raw data (IndexedRecord for Avro, InternalRow for Spark, etc)

All Superinterfaces:

AutoCloseable

All Known Subinterfaces:

HoodieSeekingFileReader<T>

All Known Implementing Classes:

HoodieAvroBootstrapFileReader, HoodieAvroFileReader, HoodieAvroHFileReaderImplBase, HoodieBootstrapFileReader, HoodieNativeAvroHFileReader

public interface HoodieFileReader<T>
extends AutoCloseable

Hudi's File Reader interface providing common set of APIs to fetch

• HoodieRecords
• Metadata (statistics, bloom-filters, etc)

from a file persisted in storage.

Method Summary

Modifier and Type	Method and Description
void	close()
Set<Pair<String,Long>>	filterRowKeys(Set<String> candidateRowKeys)
default ClosableIterator<HoodieRecord<T>>	getRecordIterator()
default ClosableIterator<HoodieRecord<T>>	getRecordIterator(org.apache.avro.Schema readerSchema)
ClosableIterator<HoodieRecord<T>>	getRecordIterator(org.apache.avro.Schema readerSchema, org.apache.avro.Schema requestedSchema)
ClosableIterator<String>	getRecordKeyIterator()
org.apache.avro.Schema	getSchema()
long	getTotalRecords()
BloomFilter	readBloomFilter()
String[]	readMinMaxRecordKeys()

Method Detail

readMinMaxRecordKeys

String[] readMinMaxRecordKeys()

readBloomFilter

BloomFilter readBloomFilter()

filterRowKeys

Set<Pair<String,Long>> filterRowKeys(Set<String> candidateRowKeys)

getRecordIterator

ClosableIterator<HoodieRecord<T>> getRecordIterator(org.apache.avro.Schema readerSchema,
                                                    org.apache.avro.Schema requestedSchema)
                                             throws IOException

Throws:

IOException

getRecordIterator

default ClosableIterator<HoodieRecord<T>> getRecordIterator(org.apache.avro.Schema readerSchema)
                                                     throws IOException

Throws:

IOException

getRecordIterator

default ClosableIterator<HoodieRecord<T>> getRecordIterator()
                                                     throws IOException

Throws:

IOException

getRecordKeyIterator

ClosableIterator<String> getRecordKeyIterator()
                                       throws IOException

Throws:

IOException

getSchema

org.apache.avro.Schema getSchema()

close

void close()

Specified by:

close in interface AutoCloseable

getTotalRecords

long getTotalRecords()