org.apache.flink.table.runtime.operators.python.aggregate.arrow.batch

类 BatchArrowPythonGroupAggregateFunctionOperator

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.table.runtime.operators.python.AbstractOneInputPythonFunctionOperator<IN,OUT>

org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

org.apache.flink.table.runtime.operators.python.aggregate.arrow.AbstractArrowPythonAggregateFunctionOperator

org.apache.flink.table.runtime.operators.python.aggregate.arrow.batch.BatchArrowPythonGroupAggregateFunctionOperator

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

@Internal
public class BatchArrowPythonGroupAggregateFunctionOperator
extends AbstractArrowPythonAggregateFunctionOperator

The Batch Arrow Python AggregateFunction Operator for Group Aggregation.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.table.runtime.operators.python.aggregate.arrow.AbstractArrowPythonAggregateFunctionOperator

arrowSerializer, currentBatchCount, groupingSet, pandasAggFunctions, reuseJoinedRow, rowDataWrapper

从类继承的字段 org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator

bais, baisWrapper, baos, baosWrapper, forwardedInputQueue, inputType, outputType, userDefinedFunctionInputOffsets, userDefinedFunctionInputType, userDefinedFunctionOutputType

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

config, elementCount, jobOptions, maxBundleSize, pythonConfig, pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
BatchArrowPythonGroupAggregateFunctionOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.functions.python.PythonFunctionInfo[] pandasAggFunctions, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType outputType, int[] groupKey, int[] groupingSet, int[] udafInputOffsets)

方法概要

限定符和类型	方法和说明
void	bufferInput(org.apache.flink.table.data.RowData input) Buffers the specified input, it will be used to construct the operator result together with the user-defined function execution result.
org.apache.flink.table.types.logical.RowType	createUserDefinedFunctionOutputType()
void	emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple) Sends the execution result to the downstream operator.
void	endInput()
void	finish()
protected void	invokeCurrentBatch()
void	open()
void	processElementInternal(org.apache.flink.table.data.RowData value)

从类继承的方法 org.apache.flink.table.runtime.operators.python.aggregate.arrow.AbstractArrowPythonAggregateFunctionOperator

close, createInputCoderInfoDescriptor, createOutputCoderInfoDescriptor, getFunctionInput, getFunctionUrn, getPythonEnv, getUserDefinedFunctionsProto, isBundleFinished, processElement

从类继承的方法 org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator

createPythonFunctionRunner

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, createPythonEnvironmentManager, emitResults, getConfiguration, getFlinkMetricContainer, invokeFinishBundle, prepareSnapshotPreBarrier, processWatermark, setConfiguration, setCurrentKey

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processWatermark, processWatermarkStatus

构造器详细资料

BatchArrowPythonGroupAggregateFunctionOperator

public BatchArrowPythonGroupAggregateFunctionOperator(org.apache.flink.configuration.Configuration config,
                                                      org.apache.flink.table.functions.python.PythonFunctionInfo[] pandasAggFunctions,
                                                      org.apache.flink.table.types.logical.RowType inputType,
                                                      org.apache.flink.table.types.logical.RowType outputType,
                                                      int[] groupKey,
                                                      int[] groupingSet,
                                                      int[] udafInputOffsets)

方法详细资料

invokeCurrentBatch

protected void invokeCurrentBatch()
                           throws Exception

抛出:

Exception

bufferInput

public void bufferInput(org.apache.flink.table.data.RowData input)
                 throws Exception

从类复制的说明: AbstractStatelessFunctionOperator

Buffers the specified input, it will be used to construct the operator result together with the user-defined function execution result.

指定者:

bufferInput 在类中 AbstractStatelessFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

抛出:

Exception

createUserDefinedFunctionOutputType

public org.apache.flink.table.types.logical.RowType createUserDefinedFunctionOutputType()

指定者:

createUserDefinedFunctionOutputType 在类中 AbstractStatelessFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

processElementInternal

public void processElementInternal(org.apache.flink.table.data.RowData value)

指定者:

processElementInternal 在类中 AbstractStatelessFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

emitResult

public void emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple)
                throws Exception

从类复制的说明: AbstractPythonFunctionOperator

Sends the execution result to the downstream operator.

指定者:

emitResult 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

覆盖:

open 在类中 AbstractArrowPythonAggregateFunctionOperator

抛出:

Exception

endInput

public void endInput()
              throws Exception

指定者:

endInput 在接口中 org.apache.flink.streaming.api.operators.BoundedOneInput

覆盖:

endInput 在类中 AbstractOneInputPythonFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

抛出:

Exception

finish

public void finish()
            throws Exception

指定者:

finish 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

覆盖:

finish 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

抛出:

Exception