org.apache.hudi.io.storage

Class HoodieAvroHFileReaderImplBase

java.lang.Object

org.apache.hudi.io.storage.HoodieAvroFileReader

org.apache.hudi.io.storage.HoodieAvroHFileReaderImplBase

All Implemented Interfaces:

AutoCloseable, HoodieFileReader<org.apache.avro.generic.IndexedRecord>, HoodieSeekingFileReader<org.apache.avro.generic.IndexedRecord>

Direct Known Subclasses:

HoodieNativeAvroHFileReader

public abstract class HoodieAvroHFileReaderImplBase
extends HoodieAvroFileReader
implements HoodieSeekingFileReader<org.apache.avro.generic.IndexedRecord>

Field Summary

Fields

Modifier and Type	Field and Description
static String	KEY_BLOOM_FILTER_META_BLOCK
static String	KEY_BLOOM_FILTER_TYPE_CODE
static String	KEY_FIELD_NAME
static String	KEY_MAX_RECORD
static String	KEY_MIN_RECORD
static String	SCHEMA_KEY

Constructor Summary

Constructors

Constructor and Description
HoodieAvroHFileReaderImplBase()

Method Summary

Modifier and Type	Method and Description
protected static org.apache.avro.generic.GenericRecord	deserialize(byte[] keyBytes, byte[] valueBytes, org.apache.avro.Schema writerSchema, org.apache.avro.Schema readerSchema)
protected static org.apache.avro.generic.GenericRecord	deserialize(byte[] keyBytes, int keyOffset, int keyLength, byte[] valueBytes, int valueOffset, int valueLength, org.apache.avro.Schema writerSchema, org.apache.avro.Schema readerSchema)
abstract ClosableIterator<org.apache.avro.generic.IndexedRecord>	getIndexedRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes, org.apache.avro.Schema readerSchema)
abstract ClosableIterator<org.apache.avro.generic.IndexedRecord>	getIndexedRecordsByKeysIterator(List<String> keys, org.apache.avro.Schema readerSchema)
static List<org.apache.avro.generic.IndexedRecord>	readAllRecords(HoodieAvroFileReader reader) NOTE: THIS SHOULD ONLY BE USED FOR TESTING, RECORDS ARE MATERIALIZED EAGERLY
static List<org.apache.avro.generic.IndexedRecord>	readRecords(HoodieAvroHFileReaderImplBase reader, List<String> keys) NOTE: THIS SHOULD ONLY BE USED FOR TESTING, RECORDS ARE MATERIALIZED EAGERLY
static List<org.apache.avro.generic.IndexedRecord>	readRecords(HoodieAvroHFileReaderImplBase reader, List<String> keys, org.apache.avro.Schema schema) NOTE: THIS SHOULD ONLY BE USED FOR TESTING, RECORDS ARE MATERIALIZED EAGERLY

Methods inherited from class org.apache.hudi.io.storage.HoodieAvroFileReader

getIndexedRecordIterator, getIndexedRecordIterator, getRecordIterator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.io.storage.HoodieSeekingFileReader

getRecordsByKeyPrefixIterator, getRecordsByKeyPrefixIterator, getRecordsByKeysIterator, getRecordsByKeysIterator

Methods inherited from interface org.apache.hudi.io.storage.HoodieFileReader

close, filterRowKeys, getRecordIterator, getRecordIterator, getRecordIterator, getRecordKeyIterator, getSchema, getTotalRecords, readBloomFilter, readMinMaxRecordKeys

Field Detail

SCHEMA_KEY

public static final String SCHEMA_KEY

See Also:

Constant Field Values

KEY_BLOOM_FILTER_META_BLOCK

public static final String KEY_BLOOM_FILTER_META_BLOCK

See Also:

Constant Field Values

KEY_BLOOM_FILTER_TYPE_CODE

public static final String KEY_BLOOM_FILTER_TYPE_CODE

See Also:

Constant Field Values

KEY_FIELD_NAME

public static final String KEY_FIELD_NAME

See Also:

Constant Field Values

KEY_MIN_RECORD

public static final String KEY_MIN_RECORD

See Also:

Constant Field Values

KEY_MAX_RECORD

public static final String KEY_MAX_RECORD

See Also:

Constant Field Values

Constructor Detail

HoodieAvroHFileReaderImplBase

public HoodieAvroHFileReaderImplBase()

Method Detail

readAllRecords

public static List<org.apache.avro.generic.IndexedRecord> readAllRecords(HoodieAvroFileReader reader)
                                                                  throws IOException

NOTE: THIS SHOULD ONLY BE USED FOR TESTING, RECORDS ARE MATERIALIZED EAGERLY

Reads all the records with given schema

Throws:

IOException

readRecords

public static List<org.apache.avro.generic.IndexedRecord> readRecords(HoodieAvroHFileReaderImplBase reader,
                                                                      List<String> keys)
                                                               throws IOException

NOTE: THIS SHOULD ONLY BE USED FOR TESTING, RECORDS ARE MATERIALIZED EAGERLY

Reads all the records with given schema and filtering keys.

Throws:

IOException

readRecords

public static List<org.apache.avro.generic.IndexedRecord> readRecords(HoodieAvroHFileReaderImplBase reader,
                                                                      List<String> keys,
                                                                      org.apache.avro.Schema schema)
                                                               throws IOException

NOTE: THIS SHOULD ONLY BE USED FOR TESTING, RECORDS ARE MATERIALIZED EAGERLY

Reads all the records with given schema and filtering keys.

Throws:

IOException

getIndexedRecordsByKeysIterator

public abstract ClosableIterator<org.apache.avro.generic.IndexedRecord> getIndexedRecordsByKeysIterator(List<String> keys,
                                                                                                        org.apache.avro.Schema readerSchema)
                                                                                                 throws IOException

Throws:

IOException

getIndexedRecordsByKeyPrefixIterator

public abstract ClosableIterator<org.apache.avro.generic.IndexedRecord> getIndexedRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes,
                                                                                                             org.apache.avro.Schema readerSchema)
                                                                                                      throws IOException

Throws:

IOException

deserialize

protected static org.apache.avro.generic.GenericRecord deserialize(byte[] keyBytes,
                                                                   byte[] valueBytes,
                                                                   org.apache.avro.Schema writerSchema,
                                                                   org.apache.avro.Schema readerSchema)
                                                            throws IOException

Throws:

IOException

deserialize

protected static org.apache.avro.generic.GenericRecord deserialize(byte[] keyBytes,
                                                                   int keyOffset,
                                                                   int keyLength,
                                                                   byte[] valueBytes,
                                                                   int valueOffset,
                                                                   int valueLength,
                                                                   org.apache.avro.Schema writerSchema,
                                                                   org.apache.avro.Schema readerSchema)
                                                            throws IOException

Throws:

IOException