Uses of Interface
org.apache.hudi.common.util.collection.ClosableIterator

Packages that use ClosableIterator

Package	Description
org.apache.hudi.common.engine
org.apache.hudi.common.table.log
org.apache.hudi.common.table.log.block
org.apache.hudi.common.table.read
org.apache.hudi.common.util
org.apache.hudi.common.util.collection
org.apache.hudi.io.storage

Uses of ClosableIterator in org.apache.hudi.common.engine

Methods in org.apache.hudi.common.engine that return ClosableIterator

Modifier and Type	Method and Description
abstract ClosableIterator<T>	HoodieReaderContext.getFileRecordIterator(StoragePath filePath, long start, long length, org.apache.avro.Schema dataSchema, org.apache.avro.Schema requiredSchema, HoodieStorage storage) Gets the record iterator based on the type of engine-specific record representation from the file.
abstract ClosableIterator<T>	HoodieReaderContext.mergeBootstrapReaders(ClosableIterator<T> skeletonFileIterator, org.apache.avro.Schema skeletonRequiredSchema, ClosableIterator<T> dataFileIterator, org.apache.avro.Schema dataRequiredSchema) Merge the skeleton file and data file iterators into a single iterator that will produce rows that contain all columns from the skeleton file iterator, followed by all columns in the data file iterator

Methods in org.apache.hudi.common.engine with parameters of type ClosableIterator

Modifier and Type	Method and Description
abstract ClosableIterator<T>	HoodieReaderContext.mergeBootstrapReaders(ClosableIterator<T> skeletonFileIterator, org.apache.avro.Schema skeletonRequiredSchema, ClosableIterator<T> dataFileIterator, org.apache.avro.Schema dataRequiredSchema) Merge the skeleton file and data file iterators into a single iterator that will produce rows that contain all columns from the skeleton file iterator, followed by all columns in the data file iterator
abstract ClosableIterator<T>	HoodieReaderContext.mergeBootstrapReaders(ClosableIterator<T> skeletonFileIterator, org.apache.avro.Schema skeletonRequiredSchema, ClosableIterator<T> dataFileIterator, org.apache.avro.Schema dataRequiredSchema) Merge the skeleton file and data file iterators into a single iterator that will produce rows that contain all columns from the skeleton file iterator, followed by all columns in the data file iterator

Uses of ClosableIterator in org.apache.hudi.common.table.log

Classes in org.apache.hudi.common.table.log that implement ClosableIterator

Modifier and Type	Class and Description
class	HoodieCDCLogRecordIterator Record iterator for Hudi logs in CDC format.
class	HoodieFileSliceReader<T>
class	LogFileIterator<T>

Uses of ClosableIterator in org.apache.hudi.common.table.log.block

Methods in org.apache.hudi.common.table.log.block that return ClosableIterator

Modifier and Type	Method and Description
protected <T> ClosableIterator<HoodieRecord<T>>	HoodieParquetDataBlock.deserializeRecords(byte[] content, HoodieRecord.HoodieRecordType type)
protected abstract <T> ClosableIterator<HoodieRecord<T>>	HoodieDataBlock.deserializeRecords(byte[] content, HoodieRecord.HoodieRecordType type)
protected <T> ClosableIterator<HoodieRecord<T>>	HoodieHFileDataBlock.deserializeRecords(byte[] content, HoodieRecord.HoodieRecordType type)
protected <T> ClosableIterator<HoodieRecord<T>>	HoodieAvroDataBlock.deserializeRecords(byte[] content, HoodieRecord.HoodieRecordType type)
protected <T> ClosableIterator<T>	HoodieParquetDataBlock.deserializeRecords(HoodieReaderContext<T> readerContext, byte[] content)
protected abstract <T> ClosableIterator<T>	HoodieDataBlock.deserializeRecords(HoodieReaderContext<T> readerContext, byte[] content) Deserializes the content bytes of the data block to the records in engine-specific representation.
protected <T> ClosableIterator<T>	HoodieHFileDataBlock.deserializeRecords(HoodieReaderContext<T> readerContext, byte[] content)
protected <T> ClosableIterator<T>	HoodieAvroDataBlock.deserializeRecords(HoodieReaderContext<T> readerContext, byte[] content)
<T> ClosableIterator<T>	HoodieDataBlock.getEngineRecordIterator(HoodieReaderContext<T> readerContext) Returns all the records in the type of engine-specific record representation contained within this block in an iterator.
<T> ClosableIterator<T>	HoodieDataBlock.getEngineRecordIterator(HoodieReaderContext<T> readerContext, List<String> keys, boolean fullKey) Batch get of keys of interest.
<T> ClosableIterator<HoodieRecord<T>>	HoodieDataBlock.getRecordIterator(HoodieRecord.HoodieRecordType type) Returns all the records iterator contained w/in this block.
<T> ClosableIterator<HoodieRecord<T>>	HoodieDataBlock.getRecordIterator(List<String> keys, boolean fullKey, HoodieRecord.HoodieRecordType type) Batch get of keys of interest.
protected <T> ClosableIterator<HoodieRecord<T>>	HoodieDataBlock.lookupRecords(List<String> keys, boolean fullKey)
protected <T> ClosableIterator<HoodieRecord<T>>	HoodieHFileDataBlock.lookupRecords(List<String> sortedKeys, boolean fullKey)
protected <T> ClosableIterator<T>	HoodieParquetDataBlock.readRecordsFromBlockPayload(HoodieReaderContext<T> readerContext)
protected <T> ClosableIterator<T>	HoodieDataBlock.readRecordsFromBlockPayload(HoodieReaderContext<T> readerContext)
protected <T> ClosableIterator<HoodieRecord<T>>	HoodieParquetDataBlock.readRecordsFromBlockPayload(HoodieRecord.HoodieRecordType type) NOTE: We're overriding the whole reading sequence to make sure we properly respect the requested Reader's schema and only fetch the columns that have been explicitly requested by the caller (providing projected Reader's schema)
protected <T> ClosableIterator<HoodieRecord<T>>	HoodieDataBlock.readRecordsFromBlockPayload(HoodieRecord.HoodieRecordType type)

Uses of ClosableIterator in org.apache.hudi.common.table.read

Classes in org.apache.hudi.common.table.read that implement ClosableIterator

Modifier and Type	Class and Description
static class	HoodieFileGroupReader.HoodieFileGroupReaderIterator<T>

Fields in org.apache.hudi.common.table.read declared as ClosableIterator

Modifier and Type	Field and Description
protected ClosableIterator<T>	HoodieBaseFileGroupRecordBuffer.baseFileIterator

Methods in org.apache.hudi.common.table.read that return types with arguments of type ClosableIterator

Modifier and Type	Method and Description
protected Pair<ClosableIterator<T>,org.apache.avro.Schema>	HoodieBaseFileGroupRecordBuffer.getRecordsIterator(HoodieDataBlock dataBlock, Option<KeySpec> keySpecOpt) Create a record iterator for a data block.

Methods in org.apache.hudi.common.table.read with parameters of type ClosableIterator

Modifier and Type	Method and Description
void	HoodieBaseFileGroupRecordBuffer.setBaseFileIterator(ClosableIterator<T> baseFileIterator)
void	HoodieFileGroupRecordBuffer.setBaseFileIterator(ClosableIterator<T> baseFileIterator) Link the base file iterator for consequential merge.

Uses of ClosableIterator in org.apache.hudi.common.util

Methods in org.apache.hudi.common.util that return ClosableIterator

Modifier and Type	Method and Description
abstract ClosableIterator<HoodieKey>	FileFormatUtils.getHoodieKeyIterator(HoodieStorage storage, StoragePath filePath) Provides a closable iterator for reading the given data file.
abstract ClosableIterator<HoodieKey>	FileFormatUtils.getHoodieKeyIterator(HoodieStorage storage, StoragePath filePath, Option<BaseKeyGenerator> keyGeneratorOpt) Provides a closable iterator for reading the given data file.

Uses of ClosableIterator in org.apache.hudi.common.util.collection

Classes in org.apache.hudi.common.util.collection that implement ClosableIterator

Modifier and Type	Class and Description
class	CachingIterator<T>
class	CloseableMappingIterator<I,O> MappingIterator requiring to be closed after iteration (to cleanup resources)
class	EmptyIterator<R> A ClosableIterator that does not contain any record.
class	LazyFileIterable.LazyFileIterator<T,R> Iterator implementation for the iterable defined above.

Methods in org.apache.hudi.common.util.collection that return ClosableIterator

Modifier and Type	Method and Description
ClosableIterator<R>	LazyFileIterable.iterator()
static <E> ClosableIterator<E>	ClosableIterator.wrap(Iterator<E> iterator)

Methods in org.apache.hudi.common.util.collection with parameters of type ClosableIterator

Modifier and Type	Method and Description
static <U> CachingIterator<U>	CachingIterator.wrap(ClosableIterator<U> iterator)
static <U> CachingIterator<U>	CachingIterator.wrap(ClosableIterator<U> iterator, HoodieReaderContext<U> readerContext)

Constructors in org.apache.hudi.common.util.collection with parameters of type ClosableIterator

Constructor and Description
CloseableMappingIterator(ClosableIterator<I> source, Function<I,O> mapper)

Uses of ClosableIterator in org.apache.hudi.io.storage

Classes in org.apache.hudi.io.storage that implement ClosableIterator

Modifier and Type	Class and Description
class	HoodieBootstrapRecordIterator<T>

Fields in org.apache.hudi.io.storage declared as ClosableIterator

Modifier and Type	Field and Description
protected ClosableIterator<HoodieRecord<T>>	HoodieBootstrapRecordIterator.dataFileIterator
protected ClosableIterator<HoodieRecord<T>>	HoodieBootstrapRecordIterator.skeletonIterator

Methods in org.apache.hudi.io.storage that return ClosableIterator

Modifier and Type	Method and Description
protected ClosableIterator<org.apache.avro.generic.IndexedRecord>	HoodieAvroFileReader.getIndexedRecordIterator(org.apache.avro.Schema readerSchema)
abstract ClosableIterator<org.apache.avro.generic.IndexedRecord>	HoodieAvroFileReader.getIndexedRecordIterator(org.apache.avro.Schema readerSchema, org.apache.avro.Schema requestedSchema)
ClosableIterator<org.apache.avro.generic.IndexedRecord>	HoodieNativeAvroHFileReader.getIndexedRecordIterator(org.apache.avro.Schema readerSchema, org.apache.avro.Schema requestedSchema)
abstract ClosableIterator<org.apache.avro.generic.IndexedRecord>	HoodieAvroHFileReaderImplBase.getIndexedRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes, org.apache.avro.Schema readerSchema)
ClosableIterator<org.apache.avro.generic.IndexedRecord>	HoodieNativeAvroHFileReader.getIndexedRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes, org.apache.avro.Schema readerSchema)
abstract ClosableIterator<org.apache.avro.generic.IndexedRecord>	HoodieAvroHFileReaderImplBase.getIndexedRecordsByKeysIterator(List<String> keys, org.apache.avro.Schema readerSchema)
ClosableIterator<org.apache.avro.generic.IndexedRecord>	HoodieNativeAvroHFileReader.getIndexedRecordsByKeysIterator(List<String> sortedKeys, org.apache.avro.Schema readerSchema)
default ClosableIterator<HoodieRecord<T>>	HoodieFileReader.getRecordIterator()
ClosableIterator<HoodieRecord<T>>	HoodieBootstrapFileReader.getRecordIterator(org.apache.avro.Schema schema)
default ClosableIterator<HoodieRecord<T>>	HoodieFileReader.getRecordIterator(org.apache.avro.Schema readerSchema)
ClosableIterator<HoodieRecord<T>>	HoodieBootstrapFileReader.getRecordIterator(org.apache.avro.Schema readerSchema, org.apache.avro.Schema requestedSchema)
ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>>	HoodieAvroFileReader.getRecordIterator(org.apache.avro.Schema readerSchema, org.apache.avro.Schema requestedSchema)
ClosableIterator<HoodieRecord<T>>	HoodieFileReader.getRecordIterator(org.apache.avro.Schema readerSchema, org.apache.avro.Schema requestedSchema)
ClosableIterator<String>	HoodieBootstrapFileReader.getRecordKeyIterator()
ClosableIterator<String>	HoodieFileReader.getRecordKeyIterator()
ClosableIterator<String>	HoodieNativeAvroHFileReader.getRecordKeyIterator()
default ClosableIterator<HoodieRecord<T>>	HoodieSeekingFileReader.getRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes)
default ClosableIterator<HoodieRecord<T>>	HoodieSeekingFileReader.getRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes, org.apache.avro.Schema schema)
ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>>	HoodieNativeAvroHFileReader.getRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes, org.apache.avro.Schema schema)
default ClosableIterator<HoodieRecord<T>>	HoodieSeekingFileReader.getRecordsByKeysIterator(List<String> sortedKeys)
default ClosableIterator<HoodieRecord<T>>	HoodieSeekingFileReader.getRecordsByKeysIterator(List<String> sortedKeys, org.apache.avro.Schema schema)
ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>>	HoodieNativeAvroHFileReader.getRecordsByKeysIterator(List<String> sortedKeys, org.apache.avro.Schema schema)

Constructors in org.apache.hudi.io.storage with parameters of type ClosableIterator

Constructor and Description
HoodieBootstrapRecordIterator(ClosableIterator<HoodieRecord<T>> skeletonIterator, ClosableIterator<HoodieRecord<T>> dataFileIterator, org.apache.avro.Schema schema, Option<String[]> partitionFields, Object[] partitionValues)
HoodieBootstrapRecordIterator(ClosableIterator<HoodieRecord<T>> skeletonIterator, ClosableIterator<HoodieRecord<T>> dataFileIterator, org.apache.avro.Schema schema, Option<String[]> partitionFields, Object[] partitionValues)