org.apache.flink.table.runtime.operators.python.aggregate

类 PythonStreamGroupAggregateOperator

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

org.apache.flink.table.runtime.operators.python.aggregate.PythonStreamGroupAggregateOperator

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.Triggerable<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace>, org.apache.flink.table.runtime.functions.CleanupState, org.apache.flink.util.Disposable

public class PythonStreamGroupAggregateOperator
extends AbstractOneInputPythonFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>
implements org.apache.flink.streaming.api.operators.Triggerable<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace>, org.apache.flink.table.runtime.functions.CleanupState

The Python AggregateFunction operator for the blink planner.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected static String	FLINK_AGGREGATE_FUNCTION_SCHEMA_CODER_URN
protected org.apache.flink.table.types.logical.RowType	inputType The input logical type.
protected static byte	NORMAL_RECORD
protected org.apache.flink.table.types.logical.RowType	outputType The output logical type.
protected static String	STREAM_GROUP_AGGREGATE_URN
protected org.apache.flink.api.common.typeutils.TypeSerializer<org.apache.flink.table.data.RowData>	udfInputTypeSerializer The TypeSerializer for udf input elements.
protected org.apache.flink.api.common.typeutils.TypeSerializer<org.apache.flink.table.data.RowData>	udfOutputTypeSerializer The TypeSerializer for udf execution results.
protected org.apache.flink.table.types.logical.RowType	userDefinedFunctionInputType The user-defined function input logical type.

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

elementCount, maxBundleSize, pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明

PythonStreamGroupAggregateOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType outputType, org.apache.flink.table.functions.python.PythonAggregateFunctionInfo[] aggregateFunctions, org.apache.flink.table.planner.typeutils.DataViewUtils.DataViewSpec[][] dataViewSpecs, int[] grouping, int indexOfCountStar, boolean countStarInserted, boolean generateUpdateBefore, long minRetentionTime, long maxRetentionTime)

方法概要

限定符和类型	方法和说明
PythonFunctionRunner	createPythonFunctionRunner() Creates the PythonFunctionRunner which is responsible for Python user-defined function execution.
void	emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple) Sends the execution result to the downstream operator.
Object	getCurrentKey()
protected org.apache.flink.api.common.typeutils.TypeSerializer	getKeySerializer()
protected org.apache.flink.table.types.logical.RowType	getKeyType()
org.apache.flink.table.functions.python.PythonEnv	getPythonEnv() Returns the PythonEnv used to create PythonEnvironmentManager..
FlinkFnApi.UserDefinedAggregateFunctions	getUserDefinedFunctionsProto() Gets the proto representation of the Python user-defined aggregate functions to be executed.
void	onEventTime(org.apache.flink.streaming.api.operators.InternalTimer<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace> timer) Invoked when an event-time timer fires.
void	onProcessingTime(org.apache.flink.streaming.api.operators.InternalTimer<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace> timer) Invoked when a processing-time timer fires.
void	open()
void	processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.table.data.RowData> element)
void	setCurrentKey(Object key) As the beam state gRPC service will access the KeyedStateBackend in parallel with this operator, we must override this method to prevent changing the current key of the KeyedStateBackend while the beam service is handling requests.

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator

endInput

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, close, createPythonEnvironmentManager, dispose, emitResults, getConfig, getFlinkMetricContainer, getPythonConfig, invokeFinishBundle, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setPythonConfig

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.table.runtime.functions.CleanupState

registerProcessingCleanupTimer

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, dispose, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processWatermark

字段详细资料

FLINK_AGGREGATE_FUNCTION_SCHEMA_CODER_URN

@VisibleForTesting
protected static final String FLINK_AGGREGATE_FUNCTION_SCHEMA_CODER_URN

另请参阅:

常量字段值

STREAM_GROUP_AGGREGATE_URN

@VisibleForTesting
protected static final String STREAM_GROUP_AGGREGATE_URN

另请参阅:

常量字段值

NORMAL_RECORD

@VisibleForTesting
protected static final byte NORMAL_RECORD

另请参阅:

常量字段值

inputType

protected final org.apache.flink.table.types.logical.RowType inputType

The input logical type.

outputType

protected final org.apache.flink.table.types.logical.RowType outputType

The output logical type.

userDefinedFunctionInputType

protected transient org.apache.flink.table.types.logical.RowType userDefinedFunctionInputType

The user-defined function input logical type.

udfOutputTypeSerializer

protected transient org.apache.flink.api.common.typeutils.TypeSerializer<org.apache.flink.table.data.RowData> udfOutputTypeSerializer

The TypeSerializer for udf execution results.

udfInputTypeSerializer

protected transient org.apache.flink.api.common.typeutils.TypeSerializer<org.apache.flink.table.data.RowData> udfInputTypeSerializer

The TypeSerializer for udf input elements.

构造器详细资料

PythonStreamGroupAggregateOperator

public PythonStreamGroupAggregateOperator(org.apache.flink.configuration.Configuration config,
                                          org.apache.flink.table.types.logical.RowType inputType,
                                          org.apache.flink.table.types.logical.RowType outputType,
                                          org.apache.flink.table.functions.python.PythonAggregateFunctionInfo[] aggregateFunctions,
                                          org.apache.flink.table.planner.typeutils.DataViewUtils.DataViewSpec[][] dataViewSpecs,
                                          int[] grouping,
                                          int indexOfCountStar,
                                          boolean countStarInserted,
                                          boolean generateUpdateBefore,
                                          long minRetentionTime,
                                          long maxRetentionTime)

方法详细资料

setCurrentKey

public void setCurrentKey(Object key)

As the beam state gRPC service will access the KeyedStateBackend in parallel with this operator, we must override this method to prevent changing the current key of the KeyedStateBackend while the beam service is handling requests.

指定者:

setCurrentKey 在接口中 org.apache.flink.streaming.api.operators.KeyContext

覆盖:

setCurrentKey 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.table.data.RowData>

getCurrentKey

public Object getCurrentKey()

指定者:

getCurrentKey 在接口中 org.apache.flink.streaming.api.operators.KeyContext

覆盖:

getCurrentKey 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.table.data.RowData>

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

覆盖:

open 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

createPythonFunctionRunner

public PythonFunctionRunner createPythonFunctionRunner()
                                                throws Exception

从类复制的说明: AbstractPythonFunctionOperator

Creates the PythonFunctionRunner which is responsible for Python user-defined function execution.

指定者:

createPythonFunctionRunner 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

processElement

public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.table.data.RowData> element)
                    throws Exception

指定者:

processElement 在接口中 org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>

抛出:

Exception

emitResult

public void emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple)
                throws Exception

从类复制的说明: AbstractPythonFunctionOperator

Sends the execution result to the downstream operator.

指定者:

emitResult 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

onEventTime

public void onEventTime(org.apache.flink.streaming.api.operators.InternalTimer<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace> timer)

Invoked when an event-time timer fires.

指定者:

onEventTime 在接口中 org.apache.flink.streaming.api.operators.Triggerable<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace>

onProcessingTime

public void onProcessingTime(org.apache.flink.streaming.api.operators.InternalTimer<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace> timer)
                      throws Exception

Invoked when a processing-time timer fires.

指定者:

onProcessingTime 在接口中 org.apache.flink.streaming.api.operators.Triggerable<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace>

抛出:

Exception

getPythonEnv

public org.apache.flink.table.functions.python.PythonEnv getPythonEnv()

从类复制的说明: AbstractPythonFunctionOperator

Returns the PythonEnv used to create PythonEnvironmentManager..

指定者:

getPythonEnv 在类中 AbstractPythonFunctionOperator<org.apache.flink.table.data.RowData>

getKeySerializer

@VisibleForTesting
protected org.apache.flink.api.common.typeutils.TypeSerializer getKeySerializer()

getKeyType

protected org.apache.flink.table.types.logical.RowType getKeyType()

getUserDefinedFunctionsProto

public FlinkFnApi.UserDefinedAggregateFunctions getUserDefinedFunctionsProto()

Gets the proto representation of the Python user-defined aggregate functions to be executed.