org.apache.flink.table.runtime.operators.python.aggregate.arrow.batch

类 BatchArrowPythonGroupAggregateFunctionOperator

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator<OUT>

org.apache.flink.table.runtime.operators.python.AbstractOneInputPythonFunctionOperator<IN,OUT>

org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

org.apache.flink.table.runtime.operators.python.aggregate.arrow.AbstractArrowPythonAggregateFunctionOperator

org.apache.flink.table.runtime.operators.python.aggregate.arrow.batch.BatchArrowPythonGroupAggregateFunctionOperator

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.YieldingOperator<org.apache.flink.table.data.RowData>

@Internal
public class BatchArrowPythonGroupAggregateFunctionOperator
extends AbstractArrowPythonAggregateFunctionOperator

The Batch Arrow Python AggregateFunction Operator for Group Aggregation.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.table.runtime.operators.python.aggregate.arrow.AbstractArrowPythonAggregateFunctionOperator

arrowSerializer, currentBatchCount, pandasAggFunctions, reuseJoinedRow, rowDataWrapper

从类继承的字段 org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator

bais, baisWrapper, baos, baosWrapper, forwardedInputQueue, inputType, udfInputType, udfOutputType

从类继承的字段 org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

bundleFinishedCallback, config, elementCount, lastFinishBundleTime, maxBundleSize, systemEnvEnabled

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

构造器概要

构造器

构造器和说明

BatchArrowPythonGroupAggregateFunctionOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.functions.python.PythonFunctionInfo[] pandasAggFunctions, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType udfInputType, org.apache.flink.table.types.logical.RowType udfOutputType, org.apache.flink.table.runtime.generated.GeneratedProjection inputGeneratedProjection, org.apache.flink.table.runtime.generated.GeneratedProjection groupKeyGeneratedProjection, org.apache.flink.table.runtime.generated.GeneratedProjection groupSetGeneratedProjection)

方法概要

限定符和类型	方法和说明
void	bufferInput(org.apache.flink.table.data.RowData input) Buffers the specified input, it will be used to construct the operator result together with the user-defined function execution result.
void	emitResult(org.apache.flink.api.java.tuple.Tuple3<String,byte[],Integer> resultTuple) Sends the execution result to the downstream operator.
void	endInput()
void	finish()
protected void	invokeCurrentBatch()
void	open()
void	processElementInternal(org.apache.flink.table.data.RowData value)

从类继承的方法 org.apache.flink.table.runtime.operators.python.aggregate.arrow.AbstractArrowPythonAggregateFunctionOperator

close, createInputCoderInfoDescriptor, createOutputCoderInfoDescriptor, createUserDefinedFunctionsProto, getFunctionInput, getFunctionUrn, getPythonEnv, isBundleFinished, processElement

从类继承的方法 org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator

createPythonFunctionRunner

从类继承的方法 org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

createPythonEnvironmentManager, emitResults, invokeFinishBundle

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, getConfiguration, getFlinkMetricContainer, prepareSnapshotPreBarrier, processWatermark, setCurrentKey

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, setup, snapshotState, snapshotState, useSplittableTimers

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processRecordAttributes, processWatermark, processWatermarkStatus

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

构造器详细资料

BatchArrowPythonGroupAggregateFunctionOperator

public BatchArrowPythonGroupAggregateFunctionOperator(org.apache.flink.configuration.Configuration config,
                                                      org.apache.flink.table.functions.python.PythonFunctionInfo[] pandasAggFunctions,
                                                      org.apache.flink.table.types.logical.RowType inputType,
                                                      org.apache.flink.table.types.logical.RowType udfInputType,
                                                      org.apache.flink.table.types.logical.RowType udfOutputType,
                                                      org.apache.flink.table.runtime.generated.GeneratedProjection inputGeneratedProjection,
                                                      org.apache.flink.table.runtime.generated.GeneratedProjection groupKeyGeneratedProjection,
                                                      org.apache.flink.table.runtime.generated.GeneratedProjection groupSetGeneratedProjection)

方法详细资料

invokeCurrentBatch

protected void invokeCurrentBatch()
                           throws Exception

抛出:

Exception

bufferInput

public void bufferInput(org.apache.flink.table.data.RowData input)
                 throws Exception

从类复制的说明: AbstractStatelessFunctionOperator

Buffers the specified input, it will be used to construct the operator result together with the user-defined function execution result.

指定者:

bufferInput 在类中 AbstractStatelessFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

抛出:

Exception

processElementInternal

public void processElementInternal(org.apache.flink.table.data.RowData value)

指定者:

processElementInternal 在类中 AbstractStatelessFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

emitResult

public void emitResult(org.apache.flink.api.java.tuple.Tuple3<String,byte[],Integer> resultTuple)
                throws Exception

从类复制的说明: AbstractExternalPythonFunctionOperator

Sends the execution result to the downstream operator.

指定者:

emitResult 在类中 AbstractExternalPythonFunctionOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

覆盖:

open 在类中 AbstractArrowPythonAggregateFunctionOperator

抛出:

Exception

endInput

public void endInput()
              throws Exception

指定者:

endInput 在接口中 org.apache.flink.streaming.api.operators.BoundedOneInput

覆盖:

endInput 在类中 AbstractOneInputPythonFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

抛出:

Exception

finish

public void finish()
            throws Exception

指定者:

finish 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

覆盖:

finish 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

抛出:

Exception