org.apache.flink.streaming.api.operators.python.process

类 AbstractExternalTwoInputPythonFunctionOperator<IN1,IN2,OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.process.AbstractExternalDataStreamPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.process.AbstractExternalTwoInputPythonFunctionOperator<IN1,IN2,OUT>

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.java.typeutils.ResultTypeQueryable<OUT>, org.apache.flink.streaming.api.operators.BoundedMultiInput, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, DataStreamPythonFunctionOperator<OUT>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>, org.apache.flink.streaming.api.operators.YieldingOperator<OUT>

直接已知子类:

ExternalPythonCoProcessOperator, ExternalPythonKeyedCoProcessOperator

@Internal
public abstract class AbstractExternalTwoInputPythonFunctionOperator<IN1,IN2,OUT>
extends AbstractExternalDataStreamPythonFunctionOperator<OUT>
implements org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>, org.apache.flink.streaming.api.operators.BoundedMultiInput

AbstractExternalTwoInputPythonFunctionOperator is responsible for launching beam runner which will start a python harness to execute two-input user defined python function.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected org.apache.flink.core.memory.ByteArrayOutputStreamWithPos	baos
protected org.apache.flink.core.memory.DataOutputViewStreamWrapper	baosWrapper

从类继承的字段 org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

bundleFinishedCallback, config, elementCount, lastFinishBundleTime, maxBundleSize, systemEnvEnabled

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

构造器概要

构造器

构造器和说明
AbstractExternalTwoInputPythonFunctionOperator(org.apache.flink.configuration.Configuration config, DataStreamPythonFunctionInfo pythonFunctionInfo, org.apache.flink.api.common.typeinfo.TypeInformation<IN1> inputTypeInfo1, org.apache.flink.api.common.typeinfo.TypeInformation<IN2> inputTypeInfo2, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> outputTypeInfo)

方法概要

限定符和类型	方法和说明
FlinkFnApi.CoderInfoDescriptor	createInputCoderInfoDescriptor()
FlinkFnApi.CoderInfoDescriptor	createOutputCoderInfoDescriptor()
void	emitResult(org.apache.flink.api.java.tuple.Tuple3<String,byte[],Integer> resultTuple) Sends the execution result to the downstream operator.
void	endInput(int inputId)
protected org.apache.flink.api.common.typeinfo.TypeInformation<IN1>	getLeftInputType()
protected org.apache.flink.api.common.typeinfo.TypeInformation<IN2>	getRightInputType()
void	open()
void	processElement(boolean isLeft, long timestamp, long watermark, Object element)

从类继承的方法 org.apache.flink.streaming.api.operators.python.process.AbstractExternalDataStreamPythonFunctionOperator

addSideOutputTags, createSideOutputCoderDescriptors, getInternalParameters, getOutputTagById, getProducedType, getPythonEnv, getPythonFunctionInfo, getSideOutputTags, getSideOutputTypeSerializerById, setNumPartitions

从类继承的方法 org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

close, createPythonEnvironmentManager, createPythonFunctionRunner, emitResults, invokeFinishBundle

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, finish, getConfiguration, getFlinkMetricContainer, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setCurrentKey

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, setup, snapshotState, snapshotState, useSplittableTimers

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.TwoInputStreamOperator

processElement1, processElement2, processLatencyMarker1, processLatencyMarker2, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark2, processWatermarkStatus1, processWatermarkStatus2

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.python.DataStreamPythonFunctionOperator

copy

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

字段详细资料

baos

protected transient org.apache.flink.core.memory.ByteArrayOutputStreamWithPos baos

baosWrapper

protected transient org.apache.flink.core.memory.DataOutputViewStreamWrapper baosWrapper

构造器详细资料

AbstractExternalTwoInputPythonFunctionOperator

public AbstractExternalTwoInputPythonFunctionOperator(org.apache.flink.configuration.Configuration config,
                                                      DataStreamPythonFunctionInfo pythonFunctionInfo,
                                                      org.apache.flink.api.common.typeinfo.TypeInformation<IN1> inputTypeInfo1,
                                                      org.apache.flink.api.common.typeinfo.TypeInformation<IN2> inputTypeInfo2,
                                                      org.apache.flink.api.common.typeinfo.TypeInformation<OUT> outputTypeInfo)

方法详细资料

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<OUT>

覆盖:

open 在类中 AbstractExternalDataStreamPythonFunctionOperator<OUT>

抛出:

Exception

endInput

public void endInput(int inputId)
              throws Exception

指定者:

endInput 在接口中 org.apache.flink.streaming.api.operators.BoundedMultiInput

抛出:

Exception

emitResult

public void emitResult(org.apache.flink.api.java.tuple.Tuple3<String,byte[],Integer> resultTuple)
                throws Exception

从类复制的说明: AbstractExternalPythonFunctionOperator

Sends the execution result to the downstream operator.

指定者:

emitResult 在类中 AbstractExternalPythonFunctionOperator<OUT>

抛出:

Exception

processElement

public void processElement(boolean isLeft,
                           long timestamp,
                           long watermark,
                           Object element)
                    throws Exception

抛出:

Exception

createInputCoderInfoDescriptor

public FlinkFnApi.CoderInfoDescriptor createInputCoderInfoDescriptor()

createOutputCoderInfoDescriptor

public FlinkFnApi.CoderInfoDescriptor createOutputCoderInfoDescriptor()

getLeftInputType

protected org.apache.flink.api.common.typeinfo.TypeInformation<IN1> getLeftInputType()

getRightInputType

protected org.apache.flink.api.common.typeinfo.TypeInformation<IN2> getRightInputType()