org.apache.flink.streaming.api.operators.python

类 PythonPartitionCustomOperator<IN,OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator<IN,OUT>

org.apache.flink.streaming.api.operators.python.OneInputPythonFunctionOperator<IN,OUT,IN,OUT>

org.apache.flink.streaming.api.operators.python.PythonPartitionCustomOperator<IN,OUT>

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<IN>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,OUT>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.util.Disposable

@Internal
public class PythonPartitionCustomOperator<IN,OUT>
extends OneInputPythonFunctionOperator<IN,OUT,IN,OUT>

The PythonPartitionCustomOperator enables us to set the number of partitions for current operator dynamically when generating the StreamGraph before executing the job. The number of partitions will be set in environment variables for python Worker, so that we can obtain the number of partitions when executing user defined partitioner function.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.streaming.api.operators.python.OneInputPythonFunctionOperator

bais, baisWrapper, baos, baosWrapper, collector, DATA_STREAM_STATELESS_FUNCTION_URN, jobOptions

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

elementCount, maxBundleSize, pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
PythonPartitionCustomOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.api.common.typeinfo.TypeInformation<IN> inputTypeInfo, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> outputTypeInfo, DataStreamPythonFunctionInfo pythonFunctionInfo)

方法概要

限定符和类型	方法和说明
void	emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple) Sends the execution result to the downstream operator.
String	getCoderUrn()
Map<String,String>	getInternalParameters()
void	setNumPartitions(int numPartitions)

从类继承的方法 org.apache.flink.streaming.api.operators.python.OneInputPythonFunctionOperator

createPythonFunctionRunner, getFunctionUrn, getPythonEnv, open, processElement

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator

endInput

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, close, createPythonEnvironmentManager, dispose, emitResults, getConfig, getFlinkMetricContainer, getPythonConfig, invokeFinishBundle, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setPythonConfig

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, dispose, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processWatermark

构造器详细资料

PythonPartitionCustomOperator

public PythonPartitionCustomOperator(org.apache.flink.configuration.Configuration config,
                                     org.apache.flink.api.common.typeinfo.TypeInformation<IN> inputTypeInfo,
                                     org.apache.flink.api.common.typeinfo.TypeInformation<OUT> outputTypeInfo,
                                     DataStreamPythonFunctionInfo pythonFunctionInfo)

方法详细资料

emitResult

public void emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple)
                throws Exception

从类复制的说明: AbstractPythonFunctionOperator

Sends the execution result to the downstream operator.

指定者:

emitResult 在类中 AbstractPythonFunctionOperator<OUT>

抛出:

Exception

getInternalParameters

public Map<String,String> getInternalParameters()

覆盖:

getInternalParameters 在类中 OneInputPythonFunctionOperator<IN,OUT,IN,OUT>

getCoderUrn

public String getCoderUrn()

指定者:

getCoderUrn 在类中 OneInputPythonFunctionOperator<IN,OUT,IN,OUT>

setNumPartitions

public void setNumPartitions(int numPartitions)