org.apache.drill.exec.store.parquet2

Class DrillParquetReader

java.lang.Object

org.apache.drill.exec.store.AbstractRecordReader

org.apache.drill.exec.store.parquet2.DrillParquetReader

All Implemented Interfaces:

AutoCloseable, RecordReader

public class DrillParquetReader
extends AbstractRecordReader

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DrillParquetReader.ProjectedColumnType

Field Summary

Fields inherited from class org.apache.drill.exec.store.AbstractRecordReader

DEFAULT_TEXT_COLS_TO_READ

Fields inherited from interface org.apache.drill.exec.store.RecordReader

ALLOCATOR_INITIAL_RESERVATION, ALLOCATOR_MAX_RESERVATION

Constructor Summary

Constructors

Constructor and Description
DrillParquetReader(FragmentContext fragmentContext, org.apache.parquet.hadoop.metadata.ParquetMetadata footer, RowGroupReadEntry entry, List<SchemaPath> columns, DrillFileSystem fileSystem, ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates)

Method Summary

Methods

Modifier and Type	Method and Description
void	allocate(Map<String,ValueVector> vectorMap)
void	close()
static org.apache.parquet.schema.MessageType	getProjection(org.apache.parquet.schema.MessageType schema, Collection<SchemaPath> columns, List<SchemaPath> columnsNotFound)
protected void	handleAndRaise(String s, Exception e)
int	next() Increments this record reader forward, writing via the provided output mutator into the output batch.
void	setup(OperatorContext context, OutputMutator output) Configure the RecordReader with the provided schema and the record batch that should be written to.

Methods inherited from class org.apache.drill.exec.store.AbstractRecordReader

getColumns, getDefaultColumnsToRead, isSkipQuery, isStarQuery, setColumns, toString, transformColumns

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

DrillParquetReader

public DrillParquetReader(FragmentContext fragmentContext,
                  org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
                  RowGroupReadEntry entry,
                  List<SchemaPath> columns,
                  DrillFileSystem fileSystem,
                  ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates)

Method Detail

getProjection

public static org.apache.parquet.schema.MessageType getProjection(org.apache.parquet.schema.MessageType schema,
                                                  Collection<SchemaPath> columns,
                                                  List<SchemaPath> columnsNotFound)

allocate

public void allocate(Map<String,ValueVector> vectorMap)
              throws OutOfMemoryException

Specified by:

allocate in interface RecordReader

Overrides:

allocate in class AbstractRecordReader

Throws:

OutOfMemoryException

setup

public void setup(OperatorContext context,
         OutputMutator output)
           throws ExecutionSetupException

Description copied from interface: RecordReader

Configure the RecordReader with the provided schema and the record batch that should be written to.

Parameters:

context - operator context for the reader

output - The place where output for a particular scan should be written. The record reader is responsible for mutating the set of schema values for that particular record.

Throws:

ExecutionSetupException

handleAndRaise

protected void handleAndRaise(String s,
                  Exception e)

next

public int next()

Description copied from interface: RecordReader

Increments this record reader forward, writing via the provided output mutator into the output batch.

Returns:

The number of additional records added to the output.

close

public void close()