org.apache.flink.streaming.api.operators.python

类 AbstractTwoInputPythonFunctionOperator<IN1,IN2,OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractDataStreamPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractTwoInputPythonFunctionOperator<IN1,IN2,OUT>

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.java.typeutils.ResultTypeQueryable<OUT>, org.apache.flink.streaming.api.operators.BoundedMultiInput, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.SetupableStreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>

直接已知子类:

PythonCoProcessOperator, PythonKeyedCoProcessOperator

@Internal
public abstract class AbstractTwoInputPythonFunctionOperator<IN1,IN2,OUT>
extends AbstractDataStreamPythonFunctionOperator<OUT>
implements org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>, org.apache.flink.streaming.api.operators.BoundedMultiInput

AbstractTwoInputPythonFunctionOperator is responsible for launching beam runner which will start a python harness to execute two-input user defined python function.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected org.apache.flink.core.memory.ByteArrayOutputStreamWithPos	baos
protected org.apache.flink.core.memory.DataOutputViewStreamWrapper	baosWrapper

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

config, elementCount, jobOptions, maxBundleSize, pythonConfig, pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
AbstractTwoInputPythonFunctionOperator(org.apache.flink.configuration.Configuration config, DataStreamPythonFunctionInfo pythonFunctionInfo, org.apache.flink.api.common.typeinfo.TypeInformation<IN1> inputTypeInfo1, org.apache.flink.api.common.typeinfo.TypeInformation<IN2> inputTypeInfo2, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> outputTypeInfo)

方法概要

限定符和类型	方法和说明
FlinkFnApi.CoderInfoDescriptor	createInputCoderInfoDescriptor()
FlinkFnApi.CoderInfoDescriptor	createOutputCoderInfoDescriptor()
void	emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple) Sends the execution result to the downstream operator.
void	endInput(int inputId)
protected org.apache.flink.api.common.typeinfo.TypeInformation<IN1>	getLeftInputType()
protected org.apache.flink.api.common.typeinfo.TypeInformation<IN2>	getRightInputType()
void	open()
void	processElement(boolean isLeft, long timestamp, long watermark, Object element)

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractDataStreamPythonFunctionOperator

containsPartitionCustom, copy, getInternalParameters, getProducedType, getPythonEnv, getPythonFunctionInfo, setContainsPartitionCustom, setNumPartitions

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, close, createPythonEnvironmentManager, createPythonFunctionRunner, emitResults, finish, getConfiguration, getFlinkMetricContainer, invokeFinishBundle, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setConfiguration, setCurrentKey

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.TwoInputStreamOperator

processElement1, processElement2, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus1, processWatermarkStatus2

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

字段详细资料

baos

protected transient org.apache.flink.core.memory.ByteArrayOutputStreamWithPos baos

baosWrapper

protected transient org.apache.flink.core.memory.DataOutputViewStreamWrapper baosWrapper

构造器详细资料

AbstractTwoInputPythonFunctionOperator

public AbstractTwoInputPythonFunctionOperator(org.apache.flink.configuration.Configuration config,
                                              DataStreamPythonFunctionInfo pythonFunctionInfo,
                                              org.apache.flink.api.common.typeinfo.TypeInformation<IN1> inputTypeInfo1,
                                              org.apache.flink.api.common.typeinfo.TypeInformation<IN2> inputTypeInfo2,
                                              org.apache.flink.api.common.typeinfo.TypeInformation<OUT> outputTypeInfo)

方法详细资料

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<OUT>

覆盖:

open 在类中 AbstractPythonFunctionOperator<OUT>

抛出:

Exception

endInput

public void endInput(int inputId)
              throws Exception

指定者:

endInput 在接口中 org.apache.flink.streaming.api.operators.BoundedMultiInput

抛出:

Exception

emitResult

public void emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple)
                throws Exception

从类复制的说明: AbstractPythonFunctionOperator

Sends the execution result to the downstream operator.

指定者:

emitResult 在类中 AbstractPythonFunctionOperator<OUT>

抛出:

Exception

processElement

public void processElement(boolean isLeft,
                           long timestamp,
                           long watermark,
                           Object element)
                    throws Exception

抛出:

Exception

createInputCoderInfoDescriptor

public FlinkFnApi.CoderInfoDescriptor createInputCoderInfoDescriptor()

createOutputCoderInfoDescriptor

public FlinkFnApi.CoderInfoDescriptor createOutputCoderInfoDescriptor()

getLeftInputType

protected org.apache.flink.api.common.typeinfo.TypeInformation<IN1> getLeftInputType()

getRightInputType

protected org.apache.flink.api.common.typeinfo.TypeInformation<IN2> getRightInputType()