org.apache.flink.streaming.api.operators.python

类 PythonTimestampsAndWatermarksOperator<IN>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator<IN,OUT>

org.apache.flink.streaming.api.operators.python.OneInputPythonFunctionOperator<IN,IN,org.apache.flink.types.Row,Long>

org.apache.flink.streaming.api.operators.python.PythonTimestampsAndWatermarksOperator<IN>

类型参数:

IN - The type of the input elements

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<IN>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,IN>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<IN>, org.apache.flink.streaming.api.operators.StreamOperator<IN>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.runtime.tasks.ProcessingTimeCallback, org.apache.flink.util.Disposable

@Internal
public class PythonTimestampsAndWatermarksOperator<IN>
extends OneInputPythonFunctionOperator<IN,IN,org.apache.flink.types.Row,Long>
implements org.apache.flink.streaming.runtime.tasks.ProcessingTimeCallback

A stream operator that may do one or both of the following: extract timestamps from events and generate watermarks by user specify TimestampAssigner and WatermarkStrategy.

These two responsibilities run in the same operator rather than in two different ones, because the implementation of the timestamp assigner and the watermark generator is frequently in the same class (and should be run in the same instance), even though the separate interfaces support the use of different classes.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
static String	STREAM_TIMESTAMP_AND_WATERMARK_OPERATOR_NAME

从类继承的字段 org.apache.flink.streaming.api.operators.python.OneInputPythonFunctionOperator

bais, baisWrapper, baos, baosWrapper, collector, DATA_STREAM_STATELESS_FUNCTION_URN, jobOptions

从类继承的字段 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

elementCount, maxBundleSize, pythonFunctionRunner

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
PythonTimestampsAndWatermarksOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.api.common.typeinfo.TypeInformation<IN> inputTypeInfo, DataStreamPythonFunctionInfo pythonFunctionInfo, org.apache.flink.api.common.eventtime.WatermarkStrategy<IN> watermarkStrategy)

方法概要

限定符和类型	方法和说明
void	close()
void	configureEmitProgressiveWatermarks(boolean emitProgressiveWatermarks)
void	emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple) Sends the execution result to the downstream operator.
String	getCoderUrn()
void	onProcessingTime(long timestamp)
void	open()
void	processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN> element)
void	processWatermark(org.apache.flink.streaming.api.watermark.Watermark mark)

从类继承的方法 org.apache.flink.streaming.api.operators.python.OneInputPythonFunctionOperator

createPythonFunctionRunner, getFunctionUrn, getInternalParameters, getPythonEnv

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator

endInput

从类继承的方法 org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, createPythonEnvironmentManager, dispose, emitResults, getConfig, getFlinkMetricContainer, getPythonConfig, invokeFinishBundle, isBundleFinished, prepareSnapshotPreBarrier, setPythonConfig

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

dispose, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker

字段详细资料

STREAM_TIMESTAMP_AND_WATERMARK_OPERATOR_NAME

public static final String STREAM_TIMESTAMP_AND_WATERMARK_OPERATOR_NAME

另请参阅:

常量字段值

构造器详细资料

PythonTimestampsAndWatermarksOperator

public PythonTimestampsAndWatermarksOperator(org.apache.flink.configuration.Configuration config,
                                             org.apache.flink.api.common.typeinfo.TypeInformation<IN> inputTypeInfo,
                                             DataStreamPythonFunctionInfo pythonFunctionInfo,
                                             org.apache.flink.api.common.eventtime.WatermarkStrategy<IN> watermarkStrategy)

方法详细资料

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<IN>

覆盖:

open 在类中 OneInputPythonFunctionOperator<IN,IN,org.apache.flink.types.Row,Long>

抛出:

Exception

processElement

public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN> element)
                    throws Exception

指定者:

processElement 在接口中 org.apache.flink.streaming.api.operators.Input<IN>

覆盖:

processElement 在类中 OneInputPythonFunctionOperator<IN,IN,org.apache.flink.types.Row,Long>

抛出:

Exception

emitResult

public void emitResult(org.apache.flink.api.java.tuple.Tuple2<byte[],Integer> resultTuple)
                throws Exception

从类复制的说明: AbstractPythonFunctionOperator

Sends the execution result to the downstream operator.

指定者:

emitResult 在类中 AbstractPythonFunctionOperator<IN>

抛出:

Exception

getCoderUrn

public String getCoderUrn()

指定者:

getCoderUrn 在类中 OneInputPythonFunctionOperator<IN,IN,org.apache.flink.types.Row,Long>

configureEmitProgressiveWatermarks

public void configureEmitProgressiveWatermarks(boolean emitProgressiveWatermarks)

onProcessingTime

public void onProcessingTime(long timestamp)

指定者:

onProcessingTime 在接口中 org.apache.flink.streaming.runtime.tasks.ProcessingTimeCallback

processWatermark

public void processWatermark(org.apache.flink.streaming.api.watermark.Watermark mark)

指定者:

processWatermark 在接口中 org.apache.flink.streaming.api.operators.Input<IN>

覆盖:

processWatermark 在类中 AbstractPythonFunctionOperator<IN>

close

public void close()
           throws Exception

指定者:

close 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<IN>

覆盖:

close 在类中 AbstractPythonFunctionOperator<IN>

抛出:

Exception