org.apache.drill.exec.store.parquet.columnreaders

Class ReadState

java.lang.Object

org.apache.drill.exec.store.parquet.columnreaders.ReadState

public class ReadState
extends Object

Internal state for reading from a Parquet file. Tracks information required from one call of next() to the next.

At present, this is a bit of a muddle as it holds all read state. As such, this is a snapshot of a refactoring effort. Subsequent passes will move state into specific readers where possible.

Constructor Summary

Constructors

Constructor and Description
ReadState(ParquetSchema schema, ParquetReaderStats parquetReaderStats, long numRecordsToRead, boolean useAsyncColReader)

Method Summary

Methods

Modifier and Type	Method and Description
void	buildReader(ParquetRecordReader reader, OutputMutator output) Create the readers needed to read columns: fixed-length or variable length.
void	close()
void	fillNullVectors(int readCount) When the SELECT clause references columns that do not exist in the Parquet file, we don't issue an error; instead we simply make up a column and fill it with nulls.
List<ColumnReader<?>>	getColumnReaders()
ColumnReader<?>	getFirstColumnReader() Several readers use the first column reader to get information about the whole record or group (such as row count.)
long	getRecordsToRead()
ParquetReaderStats	parquetReaderStats()
long	recordsRead()
void	resetBatch()
ParquetSchema	schema()
void	updateCounts(int readCount)
boolean	useAsyncColReader()
VarLenBinaryReader	varLengthReader()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ReadState

public ReadState(ParquetSchema schema,
         ParquetReaderStats parquetReaderStats,
         long numRecordsToRead,
         boolean useAsyncColReader)

Method Detail

buildReader

public void buildReader(ParquetRecordReader reader,
               OutputMutator output)
                 throws Exception

Create the readers needed to read columns: fixed-length or variable length.

Parameters:

reader -

output -

Throws:

Exception

getFirstColumnReader

public ColumnReader<?> getFirstColumnReader()

Several readers use the first column reader to get information about the whole record or group (such as row count.)

Returns:

the reader for the first column

resetBatch

public void resetBatch()

schema

public ParquetSchema schema()

getColumnReaders

public List<ColumnReader<?>> getColumnReaders()

recordsRead

public long recordsRead()

varLengthReader

public VarLenBinaryReader varLengthReader()

getRecordsToRead

public long getRecordsToRead()

useAsyncColReader

public boolean useAsyncColReader()

parquetReaderStats

public ParquetReaderStats parquetReaderStats()

fillNullVectors

public void fillNullVectors(int readCount)

When the SELECT clause references columns that do not exist in the Parquet file, we don't issue an error; instead we simply make up a column and fill it with nulls. This method does the work of null-filling the made-up vectors.

Parameters:

readCount - the number of rows read in the present record batch, which is the number of null column values to create

updateCounts

public void updateCounts(int readCount)

close

public void close()