org.apache.flink.table.runtime.operators.python.aggregate

类 AbstractPythonStreamAggregateOperator

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.table.runtime.operators.python.AbstractOneInputPythonFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamAggregateOperator

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

直接已知子类:

AbstractPythonStreamGroupAggregateOperator, PythonStreamGroupWindowAggregateOperator

@Internal
public abstract class AbstractPythonStreamAggregateOperator
extends AbstractOneInputPythonFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

Base class for AbstractPythonStreamGroupAggregateOperator and PythonStreamGroupWindowAggregateOperator.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected org.apache.flink.core.memory.ByteArrayInputStreamWithPos	bais Reusable InputStream used to holding the execution results to be deserialized.
protected org.apache.flink.core.memory.DataInputViewStreamWrapper	baisWrapper InputStream Wrapper.
protected org.apache.flink.core.memory.ByteArrayOutputStreamWithPos	baos Reusable OutputStream used to holding the serialized input elements.
protected org.apache.flink.core.memory.DataOutputViewStreamWrapper	baosWrapper OutputStream Wrapper.
protected org.apache.flink.table.types.logical.RowType	inputType The input logical type.
protected org.apache.flink.table.types.logical.RowType	outputType The output logical type.
protected StreamRecordRowDataWrappingCollector	rowDataWrapper The collector used to collect records.
protected org.apache.flink.table.types.logical.RowType	userDefinedFunctionInputType The user-defined function input logical type.
protected org.apache.flink.table.types.logical.RowType	userDefinedFunctionOutputType The user-defined function output logical type.

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

config, elementCount, jobOptions, maxBundleSize, pythonConfig, pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明

AbstractPythonStreamAggregateOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType outputType, org.apache.flink.table.functions.python.PythonAggregateFunctionInfo[] aggregateFunctions, org.apache.flink.table.planner.typeutils.DataViewUtils.DataViewSpec[][] dataViewSpecs, int[] grouping, int indexOfCountStar, boolean generateUpdateBefore)

方法概要

限定符和类型	方法和说明
FlinkFnApi.CoderInfoDescriptor	createInputCoderInfoDescriptor(org.apache.flink.table.types.logical.RowType runnerInputType)
FlinkFnApi.CoderInfoDescriptor	createOutputCoderInfoDescriptor(org.apache.flink.table.types.logical.RowType runnerOutType)
PythonFunctionRunner	createPythonFunctionRunner() Creates the PythonFunctionRunner which is responsible for Python user-defined function execution.
abstract org.apache.flink.table.types.logical.RowType	createUserDefinedFunctionInputType()
abstract org.apache.flink.table.types.logical.RowType	createUserDefinedFunctionOutputType()
Object	getCurrentKey()
abstract String	getFunctionUrn()
protected org.apache.flink.table.types.logical.RowType	getKeyType()
org.apache.flink.table.functions.python.PythonEnv	getPythonEnv() Returns the PythonEnv used to create PythonEnvironmentManager..
protected FlinkFnApi.UserDefinedAggregateFunctions	getUserDefinedFunctionsProto() Gets the proto representation of the Python user-defined aggregate functions to be executed.
void	open()
void	processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.table.data.RowData> element)
abstract void	processElementInternal(org.apache.flink.table.data.RowData value)
void	setCurrentKey(Object key) As the beam state gRPC service will access the KeyedStateBackend in parallel with this operator, we must override this method to prevent changing the current key of the KeyedStateBackend while the beam service is handling requests.

从类继承的方法 org.apache.flink.table.runtime.operators.python.AbstractOneInputPythonFunctionOperator

endInput

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, close, createPythonEnvironmentManager, emitResult, emitResults, finish, getConfiguration, getFlinkMetricContainer, invokeFinishBundle, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setConfiguration

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processWatermark, processWatermarkStatus

字段详细资料

inputType

protected final org.apache.flink.table.types.logical.RowType inputType

The input logical type.

outputType

protected final org.apache.flink.table.types.logical.RowType outputType

The output logical type.

userDefinedFunctionInputType

protected transient org.apache.flink.table.types.logical.RowType userDefinedFunctionInputType

The user-defined function input logical type.

userDefinedFunctionOutputType

protected transient org.apache.flink.table.types.logical.RowType userDefinedFunctionOutputType

The user-defined function output logical type.

bais

protected transient org.apache.flink.core.memory.ByteArrayInputStreamWithPos bais

Reusable InputStream used to holding the execution results to be deserialized.

baisWrapper

protected transient org.apache.flink.core.memory.DataInputViewStreamWrapper baisWrapper

InputStream Wrapper.

baos

protected transient org.apache.flink.core.memory.ByteArrayOutputStreamWithPos baos

Reusable OutputStream used to holding the serialized input elements.

baosWrapper

protected transient org.apache.flink.core.memory.DataOutputViewStreamWrapper baosWrapper

OutputStream Wrapper.

rowDataWrapper

protected transient StreamRecordRowDataWrappingCollector rowDataWrapper

The collector used to collect records.

构造器详细资料

AbstractPythonStreamAggregateOperator

public AbstractPythonStreamAggregateOperator(org.apache.flink.configuration.Configuration config,
                                             org.apache.flink.table.types.logical.RowType inputType,
                                             org.apache.flink.table.types.logical.RowType outputType,
                                             org.apache.flink.table.functions.python.PythonAggregateFunctionInfo[] aggregateFunctions,
                                             org.apache.flink.table.planner.typeutils.DataViewUtils.DataViewSpec[][] dataViewSpecs,
                                             int[] grouping,
                                             int indexOfCountStar,
                                             boolean generateUpdateBefore)

方法详细资料

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

覆盖:

open 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

processElement

public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.table.data.RowData> element)
                    throws Exception

抛出:

Exception

createPythonFunctionRunner

public PythonFunctionRunner createPythonFunctionRunner()
                                                throws Exception

从类复制的说明: AbstractPythonFunctionOperator

Creates the PythonFunctionRunner which is responsible for Python user-defined function execution.

指定者:

createPythonFunctionRunner 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

setCurrentKey

public void setCurrentKey(Object key)

As the beam state gRPC service will access the KeyedStateBackend in parallel with this operator, we must override this method to prevent changing the current key of the KeyedStateBackend while the beam service is handling requests.

指定者:

setCurrentKey 在接口中 org.apache.flink.streaming.api.operators.KeyContext

覆盖:

setCurrentKey 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

getCurrentKey

public Object getCurrentKey()

指定者:

getCurrentKey 在接口中 org.apache.flink.streaming.api.operators.KeyContext

覆盖:

getCurrentKey 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.table.data.RowData>

getPythonEnv

public org.apache.flink.table.functions.python.PythonEnv getPythonEnv()

从类复制的说明: AbstractPythonFunctionOperator

Returns the PythonEnv used to create PythonEnvironmentManager..

指定者:

getPythonEnv 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

getKeyType

protected org.apache.flink.table.types.logical.RowType getKeyType()

getUserDefinedFunctionsProto

protected FlinkFnApi.UserDefinedAggregateFunctions getUserDefinedFunctionsProto()

Gets the proto representation of the Python user-defined aggregate functions to be executed.

getFunctionUrn

public abstract String getFunctionUrn()

processElementInternal

public abstract void processElementInternal(org.apache.flink.table.data.RowData value)
                                     throws Exception

抛出:

Exception

createUserDefinedFunctionInputType

public abstract org.apache.flink.table.types.logical.RowType createUserDefinedFunctionInputType()

createUserDefinedFunctionOutputType

public abstract org.apache.flink.table.types.logical.RowType createUserDefinedFunctionOutputType()

createInputCoderInfoDescriptor

public FlinkFnApi.CoderInfoDescriptor createInputCoderInfoDescriptor(org.apache.flink.table.types.logical.RowType runnerInputType)

createOutputCoderInfoDescriptor

public FlinkFnApi.CoderInfoDescriptor createOutputCoderInfoDescriptor(org.apache.flink.table.types.logical.RowType runnerOutType)