org.apache.drill.exec.store.direct

Class MetadataDirectGroupScan

java.lang.Object

org.apache.drill.exec.physical.base.AbstractBase

org.apache.drill.exec.physical.base.AbstractGroupScan

org.apache.drill.exec.store.direct.DirectGroupScan

org.apache.drill.exec.store.direct.MetadataDirectGroupScan

All Implemented Interfaces:

Iterable<PhysicalOperator>, GraphValue<PhysicalOperator>, FragmentLeaf, GroupScan, HasAffinity, Leaf, PhysicalOperator, Scan

public class MetadataDirectGroupScan
extends DirectGroupScan

Represents direct scan based on metadata information. For example, for parquet files it can be obtained from parquet footer (total row count) or from parquet metadata files (column counts). Contains reader, statistics and list of scanned files if present.

Field Summary

Fields inherited from class org.apache.drill.exec.store.direct.DirectGroupScan

reader, stats

Fields inherited from class org.apache.drill.exec.physical.base.AbstractBase

INIT_ALLOCATION, initialAllocation, MAX_ALLOCATION, maxAllocation

Fields inherited from interface org.apache.drill.exec.physical.base.GroupScan

ALL_COLUMNS, NO_COLUMN_STATS

Fields inherited from interface org.apache.drill.common.graph.GraphValue

logger

Constructor Summary

Constructors

Constructor and Description
MetadataDirectGroupScan(RecordReader reader, Collection<String> files)
MetadataDirectGroupScan(RecordReader reader, Collection<String> files, ScanStats stats)

Method Summary

Methods

Modifier and Type	Method and Description
GroupScan	clone(List<SchemaPath> columns) Returns a clone of GroupScan instance, except that the new GroupScan will use the provided list of columns .
String	getDigest() Returns string representation of group scan data.
PhysicalOperator	getNewWithChildren(List<PhysicalOperator> children) Regenerate with this node with a new set of children.

Methods inherited from class org.apache.drill.exec.store.direct.DirectGroupScan

applyAssignments, getMaxParallelizationWidth, getScanStats, getSpecificScan

Methods inherited from class org.apache.drill.exec.physical.base.AbstractGroupScan

accept, applyLimit, canPushdownProjects, enforceWidth, getColumnValueCount, getDistributionAffinity, getFiles, getInitialAllocation, getMaxAllocation, getMinParallelizationWidth, getOperatorAffinity, getOperatorType, getPartitionColumns, getScanStats, hasFiles, isExecutable, iterator, supportsLimitPushdown, supportsPartitionFilterPushdown

Methods inherited from class org.apache.drill.exec.physical.base.AbstractBase

accept, getCost, getOperatorId, getSVMode, getUserName, isBufferedOperator, setCost, setMaxAllocation, setOperatorId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.drill.exec.physical.base.PhysicalOperator

getCost, getOperatorId, getSVMode, getUserName, isBufferedOperator, setCost, setMaxAllocation, setOperatorId

Methods inherited from interface org.apache.drill.common.graph.GraphValue

accept

Constructor Detail

MetadataDirectGroupScan

public MetadataDirectGroupScan(RecordReader reader,
                       Collection<String> files)

MetadataDirectGroupScan

public MetadataDirectGroupScan(RecordReader reader,
                       Collection<String> files,
                       ScanStats stats)

Method Detail

getNewWithChildren

public PhysicalOperator getNewWithChildren(List<PhysicalOperator> children)
                                    throws ExecutionSetupException

Description copied from interface: PhysicalOperator

Regenerate with this node with a new set of children. This is used in the case of materialization or optimization.

Specified by:

getNewWithChildren in interface PhysicalOperator

Overrides:

getNewWithChildren in class DirectGroupScan

Returns:

Throws:

ExecutionSetupException

clone

public GroupScan clone(List<SchemaPath> columns)

Description copied from interface: GroupScan

Returns a clone of GroupScan instance, except that the new GroupScan will use the provided list of columns .

Specified by:

clone in interface GroupScan

Overrides:

clone in class DirectGroupScan

getDigest

public String getDigest()

Returns string representation of group scan data. Includes list of files if present.

Example: [files = [/tmp/0_0_0.parquet], numFiles = 1]

Specified by:

getDigest in interface GroupScan

Overrides:

getDigest in class DirectGroupScan

Returns:

string representation of group scan data