org.apache.flink.streaming.api.operators.python.process

类 ExternalPythonBatchCoBroadcastProcessOperator<IN1,IN2,OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.process.AbstractExternalDataStreamPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.process.AbstractExternalTwoInputPythonFunctionOperator<IN1,IN2,OUT>

org.apache.flink.streaming.api.operators.python.process.ExternalPythonCoProcessOperator<IN1,IN2,OUT>

org.apache.flink.streaming.api.operators.python.process.ExternalPythonBatchCoBroadcastProcessOperator<IN1,IN2,OUT>

类型参数:

IN1 - The input type of the regular stream

IN2 - The input type of the broadcast stream

OUT - The output type of the CoBroadcastProcess function

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.java.typeutils.ResultTypeQueryable<OUT>, org.apache.flink.streaming.api.operators.BoundedMultiInput, org.apache.flink.streaming.api.operators.InputSelectable, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, DataStreamPythonFunctionOperator<OUT>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>, org.apache.flink.streaming.api.operators.YieldingOperator<OUT>

@Internal
public class ExternalPythonBatchCoBroadcastProcessOperator<IN1,IN2,OUT>
extends ExternalPythonCoProcessOperator<IN1,IN2,OUT>
implements org.apache.flink.streaming.api.operators.BoundedMultiInput, org.apache.flink.streaming.api.operators.InputSelectable

The ExternalPythonBatchCoBroadcastProcessOperator is responsible for executing the Python CoBroadcastProcess Function under BATCH mode, ExternalPythonCoProcessOperator is used under STREAMING mode. This operator forces to run out data from broadcast side first, and then process data from regular side.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.streaming.api.operators.python.process.AbstractExternalTwoInputPythonFunctionOperator

baos, baosWrapper

从类继承的字段 org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

bundleFinishedCallback, config, elementCount, lastFinishBundleTime, maxBundleSize, systemEnvEnabled

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

构造器概要

构造器

构造器和说明
ExternalPythonBatchCoBroadcastProcessOperator(org.apache.flink.configuration.Configuration config, DataStreamPythonFunctionInfo pythonFunctionInfo, org.apache.flink.api.common.typeinfo.TypeInformation<IN1> inputTypeInfo1, org.apache.flink.api.common.typeinfo.TypeInformation<IN2> inputTypeInfo2, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> outputTypeInfo)

方法概要

限定符和类型	方法和说明
void	endInput(int inputId)
org.apache.flink.streaming.api.operators.InputSelection	nextSelection()
void	processElement1(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN1> element)

从类继承的方法 org.apache.flink.streaming.api.operators.python.process.ExternalPythonCoProcessOperator

copy, createPythonFunctionRunner, open, processElement2, processWatermark

从类继承的方法 org.apache.flink.streaming.api.operators.python.process.AbstractExternalTwoInputPythonFunctionOperator

createInputCoderInfoDescriptor, createOutputCoderInfoDescriptor, emitResult, getLeftInputType, getRightInputType, processElement

从类继承的方法 org.apache.flink.streaming.api.operators.python.process.AbstractExternalDataStreamPythonFunctionOperator

addSideOutputTags, createSideOutputCoderDescriptors, getInternalParameters, getOutputTagById, getProducedType, getPythonEnv, getPythonFunctionInfo, getSideOutputTags, getSideOutputTypeSerializerById, setNumPartitions

从类继承的方法 org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

close, createPythonEnvironmentManager, emitResults, invokeFinishBundle

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, finish, getConfiguration, getFlinkMetricContainer, isBundleFinished, prepareSnapshotPreBarrier, setCurrentKey

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, setup, snapshotState, snapshotState, useSplittableTimers

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.TwoInputStreamOperator

processLatencyMarker1, processLatencyMarker2, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark2, processWatermarkStatus1, processWatermarkStatus2

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

构造器详细资料

ExternalPythonBatchCoBroadcastProcessOperator

public ExternalPythonBatchCoBroadcastProcessOperator(org.apache.flink.configuration.Configuration config,
                                                     DataStreamPythonFunctionInfo pythonFunctionInfo,
                                                     org.apache.flink.api.common.typeinfo.TypeInformation<IN1> inputTypeInfo1,
                                                     org.apache.flink.api.common.typeinfo.TypeInformation<IN2> inputTypeInfo2,
                                                     org.apache.flink.api.common.typeinfo.TypeInformation<OUT> outputTypeInfo)

方法详细资料

endInput

public void endInput(int inputId)
              throws Exception

指定者:

endInput 在接口中 org.apache.flink.streaming.api.operators.BoundedMultiInput

覆盖:

endInput 在类中 AbstractExternalTwoInputPythonFunctionOperator<IN1,IN2,OUT>

抛出:

Exception

nextSelection

public org.apache.flink.streaming.api.operators.InputSelection nextSelection()

指定者:

nextSelection 在接口中 org.apache.flink.streaming.api.operators.InputSelectable

processElement1

public void processElement1(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN1> element)
                     throws Exception

指定者:

processElement1 在接口中 org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>

覆盖:

processElement1 在类中 ExternalPythonCoProcessOperator<IN1,IN2,OUT>

抛出:

Exception