org.apache.flink.table.runtime.operators.python

类 AbstractStatelessFunctionOperator<IN,OUT,UDFIN>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator<OUT>

org.apache.flink.table.runtime.operators.python.AbstractOneInputPythonFunctionOperator<IN,OUT>

org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator<IN,OUT,UDFIN>

类型参数:

IN - Type of the input elements.

OUT - Type of the output elements.

UDFIN - Type of the UDF input type.

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<IN>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,OUT>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.YieldingOperator<OUT>

直接已知子类:

AbstractArrowPythonAggregateFunctionOperator, AbstractPythonScalarFunctionOperator, PythonTableFunctionOperator

@Internal
public abstract class AbstractStatelessFunctionOperator<IN,OUT,UDFIN>
extends AbstractOneInputPythonFunctionOperator<IN,OUT>

Base class for all stream operators to execute Python Stateless Functions.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected org.apache.flink.core.memory.ByteArrayInputStreamWithPos	bais Reusable InputStream used to holding the execution results to be deserialized.
protected org.apache.flink.core.memory.DataInputViewStreamWrapper	baisWrapper InputStream Wrapper.
protected org.apache.flink.core.memory.ByteArrayOutputStreamWithPos	baos Reusable OutputStream used to holding the serialized input elements.
protected org.apache.flink.core.memory.DataOutputViewStreamWrapper	baosWrapper OutputStream Wrapper.
protected LinkedList<IN>	forwardedInputQueue The queue holding the input elements for which the execution results have not been received.
protected org.apache.flink.table.types.logical.RowType	inputType The input logical type.
protected org.apache.flink.table.types.logical.RowType	udfInputType The user-defined function input logical type.
protected org.apache.flink.table.types.logical.RowType	udfOutputType The user-defined function output logical type.

从类继承的字段 org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

bundleFinishedCallback, config, elementCount, lastFinishBundleTime, maxBundleSize, systemEnvEnabled

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

构造器概要

构造器

构造器和说明
AbstractStatelessFunctionOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType udfInputType, org.apache.flink.table.types.logical.RowType udfOutputType)

方法概要

限定符和类型	方法和说明
abstract void	bufferInput(IN input) Buffers the specified input, it will be used to construct the operator result together with the user-defined function execution result.
abstract FlinkFnApi.CoderInfoDescriptor	createInputCoderInfoDescriptor(org.apache.flink.table.types.logical.RowType runnerInputType)
abstract FlinkFnApi.CoderInfoDescriptor	createOutputCoderInfoDescriptor(org.apache.flink.table.types.logical.RowType runnerOutType)
PythonFunctionRunner	createPythonFunctionRunner() Creates the PythonFunctionRunner which is responsible for Python user-defined function execution.
abstract FlinkFnApi.UserDefinedFunctions	createUserDefinedFunctionsProto() Gets the proto representation of the Python user-defined functions to be executed.
abstract UDFIN	getFunctionInput(IN element)
abstract String	getFunctionUrn()
void	open()
void	processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN> element)
abstract void	processElementInternal(IN value)

从类继承的方法 org.apache.flink.table.runtime.operators.python.AbstractOneInputPythonFunctionOperator

endInput

从类继承的方法 org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

close, createPythonEnvironmentManager, emitResult, emitResults, getPythonEnv, invokeFinishBundle

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, finish, getConfiguration, getFlinkMetricContainer, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setCurrentKey

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, setup, snapshotState, snapshotState, useSplittableTimers

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processRecordAttributes, processWatermark, processWatermarkStatus

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

字段详细资料

inputType

protected final org.apache.flink.table.types.logical.RowType inputType

The input logical type.

udfInputType

protected final org.apache.flink.table.types.logical.RowType udfInputType

The user-defined function input logical type.

udfOutputType

protected final org.apache.flink.table.types.logical.RowType udfOutputType

The user-defined function output logical type.

forwardedInputQueue

protected transient LinkedList<IN> forwardedInputQueue

The queue holding the input elements for which the execution results have not been received.

bais

protected transient org.apache.flink.core.memory.ByteArrayInputStreamWithPos bais

Reusable InputStream used to holding the execution results to be deserialized.

baisWrapper

protected transient org.apache.flink.core.memory.DataInputViewStreamWrapper baisWrapper

InputStream Wrapper.

baos

protected transient org.apache.flink.core.memory.ByteArrayOutputStreamWithPos baos

Reusable OutputStream used to holding the serialized input elements.

baosWrapper

protected transient org.apache.flink.core.memory.DataOutputViewStreamWrapper baosWrapper

OutputStream Wrapper.

构造器详细资料

AbstractStatelessFunctionOperator

public AbstractStatelessFunctionOperator(org.apache.flink.configuration.Configuration config,
                                         org.apache.flink.table.types.logical.RowType inputType,
                                         org.apache.flink.table.types.logical.RowType udfInputType,
                                         org.apache.flink.table.types.logical.RowType udfOutputType)

方法详细资料

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<OUT>

覆盖:

open 在类中 AbstractExternalPythonFunctionOperator<OUT>

抛出:

Exception

processElement

public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN> element)
                    throws Exception

抛出:

Exception

createPythonFunctionRunner

public PythonFunctionRunner createPythonFunctionRunner()
                                                throws IOException

从类复制的说明: AbstractExternalPythonFunctionOperator

Creates the PythonFunctionRunner which is responsible for Python user-defined function execution.

指定者:

createPythonFunctionRunner 在类中 AbstractExternalPythonFunctionOperator<OUT>

抛出:

IOException

bufferInput

public abstract void bufferInput(IN input)
                          throws Exception

Buffers the specified input, it will be used to construct the operator result together with the user-defined function execution result.

抛出:

Exception

getFunctionInput

public abstract UDFIN getFunctionInput(IN element)

createUserDefinedFunctionsProto

public abstract FlinkFnApi.UserDefinedFunctions createUserDefinedFunctionsProto()

Gets the proto representation of the Python user-defined functions to be executed.

getFunctionUrn

public abstract String getFunctionUrn()

createInputCoderInfoDescriptor

public abstract FlinkFnApi.CoderInfoDescriptor createInputCoderInfoDescriptor(org.apache.flink.table.types.logical.RowType runnerInputType)

createOutputCoderInfoDescriptor

public abstract FlinkFnApi.CoderInfoDescriptor createOutputCoderInfoDescriptor(org.apache.flink.table.types.logical.RowType runnerOutType)

processElementInternal

public abstract void processElementInternal(IN value)
                                     throws Exception

抛出:

Exception