Package org.apache.iotdb.db.mpp.execution.operator.process

Class TransformOperator

java.lang.Object

org.apache.iotdb.db.mpp.execution.operator.process.TransformOperator

All Implemented Interfaces:

java.lang.AutoCloseable, Operator, ProcessOperator

public class TransformOperator
extends java.lang.Object
implements ProcessOperator

Field Summary

Fields

Modifier and Type	Field	Description
protected QueryDataSetInputLayer	inputLayer
protected Operator	inputOperator
protected boolean	keepNull
protected OperatorContext	operatorContext
protected java.util.List<org.apache.iotdb.tsfile.file.metadata.enums.TSDataType>	outputDataTypes
protected boolean[]	shouldIterateReadersToNextValid
protected TimeSelector	timeHeap
protected LayerPointReader[]	transformers
protected float	udfCollectorMemoryBudgetInMB
protected float	udfReaderMemoryBudgetInMB
protected float	udfTransformerMemoryBudgetInMB
protected UDTFContext	udtfContext

Fields inherited from interface org.apache.iotdb.db.mpp.execution.operator.Operator

NOT_BLOCKED

Constructor Summary

Constructors

Constructor	Description
TransformOperator(OperatorContext operatorContext, Operator inputOperator, java.util.List<org.apache.iotdb.tsfile.file.metadata.enums.TSDataType> inputDataTypes, java.util.Map<java.lang.String,java.util.List<InputLocation>> inputLocations, Expression[] outputExpressions, boolean keepNull, java.time.ZoneId zoneId, TypeProvider typeProvider, boolean isAscending)

Method Summary

Modifier and Type	Method	Description
long	calculateMaxPeekMemory()	We should also consider the memory used by its children operator, so the calculation logic may be like: long estimatedOfCurrentOperator = XXXXX; return max(estimatedOfCurrentOperator, child1.calculateMaxPeekMemory(), child2.calculateMaxPeekMemory(), ....)
long	calculateMaxReturnSize()
long	calculateRetainedSizeAfterCallingNext()
void	close()	This method will always be called before releasing the Operator reference.
protected YieldableState	collectDataPoint(LayerPointReader reader, org.apache.iotdb.tsfile.read.common.block.column.ColumnBuilder writer, long currentTime, int readerIndex)
protected boolean	collectReaderAppendIsNull(LayerPointReader reader, long currentTime)
OperatorContext	getOperatorContext()
boolean	hasNext()
protected void	initTransformers(java.util.Map<java.lang.String,java.util.List<InputLocation>> inputLocations, Expression[] outputExpressions, TypeProvider typeProvider)
com.google.common.util.concurrent.ListenableFuture<?>	isBlocked()	Returns a future that will be completed when the operator becomes unblocked.
boolean	isFinished()	Is this operator completely finished processing and no more output TsBlock will be produced.
protected YieldableState	iterateAllColumnsToNextValid()
protected YieldableState	iterateReaderToNextValid(LayerPointReader reader)
org.apache.iotdb.tsfile.read.common.block.TsBlock	next()	Gets next tsBlock from this operator.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

udfReaderMemoryBudgetInMB

protected final float udfReaderMemoryBudgetInMB

udfTransformerMemoryBudgetInMB

protected final float udfTransformerMemoryBudgetInMB

udfCollectorMemoryBudgetInMB

protected final float udfCollectorMemoryBudgetInMB

operatorContext

protected final OperatorContext operatorContext

inputOperator

protected final Operator inputOperator

keepNull

protected final boolean keepNull

inputLayer

protected QueryDataSetInputLayer inputLayer

udtfContext

protected UDTFContext udtfContext

transformers

protected LayerPointReader[] transformers

outputDataTypes

protected java.util.List<org.apache.iotdb.tsfile.file.metadata.enums.TSDataType> outputDataTypes

timeHeap

protected TimeSelector timeHeap

shouldIterateReadersToNextValid

protected boolean[] shouldIterateReadersToNextValid

Constructor Detail

TransformOperator

public TransformOperator(OperatorContext operatorContext,
                         Operator inputOperator,
                         java.util.List<org.apache.iotdb.tsfile.file.metadata.enums.TSDataType> inputDataTypes,
                         java.util.Map<java.lang.String,java.util.List<InputLocation>> inputLocations,
                         Expression[] outputExpressions,
                         boolean keepNull,
                         java.time.ZoneId zoneId,
                         TypeProvider typeProvider,
                         boolean isAscending)
                  throws QueryProcessException,
                         java.io.IOException

Throws:

QueryProcessException

java.io.IOException

Method Detail

initTransformers

protected void initTransformers(java.util.Map<java.lang.String,java.util.List<InputLocation>> inputLocations,
                                Expression[] outputExpressions,
                                TypeProvider typeProvider)
                         throws QueryProcessException,
                                java.io.IOException

Throws:

QueryProcessException

java.io.IOException

iterateAllColumnsToNextValid

protected YieldableState iterateAllColumnsToNextValid()
                                               throws QueryProcessException,
                                                      java.io.IOException

Throws:

QueryProcessException

java.io.IOException

iterateReaderToNextValid

protected YieldableState iterateReaderToNextValid(LayerPointReader reader)
                                           throws QueryProcessException,
                                                  java.io.IOException

Throws:

QueryProcessException

java.io.IOException

hasNext

public final boolean hasNext()

Specified by:

hasNext in interface Operator

Returns:

true if the operator has more data, otherwise false

next

public org.apache.iotdb.tsfile.read.common.block.TsBlock next()

Description copied from interface: Operator

Gets next tsBlock from this operator. If no data is currently available, return null.

Specified by:

next in interface Operator

collectReaderAppendIsNull

protected boolean collectReaderAppendIsNull(LayerPointReader reader,
                                            long currentTime)
                                     throws QueryProcessException,
                                            java.io.IOException

Throws:

QueryProcessException

java.io.IOException

collectDataPoint

protected YieldableState collectDataPoint(LayerPointReader reader,
                                          org.apache.iotdb.tsfile.read.common.block.column.ColumnBuilder writer,
                                          long currentTime,
                                          int readerIndex)
                                   throws QueryProcessException,
                                          java.io.IOException

Throws:

QueryProcessException

java.io.IOException

close

public void close()
           throws java.lang.Exception

Description copied from interface: Operator

This method will always be called before releasing the Operator reference.

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface Operator

Throws:

java.lang.Exception

isBlocked

public com.google.common.util.concurrent.ListenableFuture<?> isBlocked()

Description copied from interface: Operator

Returns a future that will be completed when the operator becomes unblocked. If the operator is not blocked, this method should return NOT_BLOCKED.

Specified by:

isBlocked in interface Operator

isFinished

public boolean isFinished()

Description copied from interface: Operator

Is this operator completely finished processing and no more output TsBlock will be produced.

Specified by:

isFinished in interface Operator

getOperatorContext

public OperatorContext getOperatorContext()

Specified by:

getOperatorContext in interface Operator

calculateMaxPeekMemory

public long calculateMaxPeekMemory()

Description copied from interface: Operator

We should also consider the memory used by its children operator, so the calculation logic may be like: long estimatedOfCurrentOperator = XXXXX; return max(estimatedOfCurrentOperator, child1.calculateMaxPeekMemory(), child2.calculateMaxPeekMemory(), ....)

Each operator's MaxPeekMemory should also take retained size of each child operator into account.

Specified by:

calculateMaxPeekMemory in interface Operator

Returns:

estimated max memory footprint that the Operator Tree(rooted from this operator) will use while doing its own query processing

calculateMaxReturnSize

public long calculateMaxReturnSize()

Specified by:

calculateMaxReturnSize in interface Operator

Returns:

estimated max memory footprint for returned TsBlock when calling operator.next()

calculateRetainedSizeAfterCallingNext

public long calculateRetainedSizeAfterCallingNext()

Specified by:

calculateRetainedSizeAfterCallingNext in interface Operator

Returns:

each operator's retained size(including all its children's retained size) after calling its next() method