org.apache.flink.streaming.runtime.operators

类 TimestampsAndWatermarksOperator<T>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<T>

org.apache.flink.streaming.runtime.operators.TimestampsAndWatermarksOperator<T>

类型参数:

T - The type of the input elements

所有已实现的接口:

Serializable, org.apache.flink.runtime.state.CheckpointListener, KeyContext, OneInputStreamOperator<T,T>, SetupableStreamOperator<T>, StreamOperator<T>, StreamOperatorStateHandler.CheckpointedStreamOperator, ProcessingTimeCallback, org.apache.flink.util.Disposable

public class TimestampsAndWatermarksOperator<T>
extends AbstractStreamOperator<T>
implements OneInputStreamOperator<T,T>, ProcessingTimeCallback

A stream operator that may do one or both of the following: extract timestamps from events and generate watermarks.

These two responsibilities run in the same operator rather than in two different ones, because the implementation of the timestamp assigner and the watermark generator is frequently in the same class (and should be run in the same instance), even though the separate interfaces support the use of different classes.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
TimestampsAndWatermarksOperator(org.apache.flink.api.common.eventtime.WatermarkStrategy<T> watermarkStrategy)

方法概要

限定符和类型	方法和说明
void	close() This method is called after all records have been added to the operators via the methods OneInputStreamOperator.processElement(StreamRecord), or TwoInputStreamOperator.processElement1(StreamRecord) and TwoInputStreamOperator.processElement2(StreamRecord).
void	onProcessingTime(long timestamp) This method is invoked with the timestamp for which the trigger was scheduled.
void	open() This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g. state initialization.
void	processElement(StreamRecord<T> element) Processes one element that arrived at this operator.
void	processWatermark(Watermark mark) Override the base implementation to completely ignore watermarks propagated from upstream, except for the "end of time" watermark.

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

dispose, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, numEventTimeTimers, numProcessingTimeTimers, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

processLatencyMarker

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

dispose, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.runtime.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

构造器详细资料

TimestampsAndWatermarksOperator

public TimestampsAndWatermarksOperator(org.apache.flink.api.common.eventtime.WatermarkStrategy<T> watermarkStrategy)

方法详细资料

open

public void open()
          throws Exception

从类复制的说明: AbstractStreamOperator

This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g. state initialization.

The default implementation does nothing.

指定者:

open 在接口中 StreamOperator<T>

覆盖:

open 在类中 AbstractStreamOperator<T>

抛出:

Exception - An exception in this method causes the operator to fail.

processElement

public void processElement(StreamRecord<T> element)
                    throws Exception

从接口复制的说明: OneInputStreamOperator

Processes one element that arrived at this operator. This method is guaranteed to not be called concurrently with other methods of the operator.

指定者:

processElement 在接口中 OneInputStreamOperator<T,T>

抛出:

Exception

onProcessingTime

public void onProcessingTime(long timestamp)
                      throws Exception

从接口复制的说明: ProcessingTimeCallback

This method is invoked with the timestamp for which the trigger was scheduled.

If the triggering is delayed for whatever reason (trigger timer was blocked, JVM stalled due to a garbage collection), the timestamp supplied to this function will still be the original timestamp for which the trigger was scheduled.

指定者:

onProcessingTime 在接口中 ProcessingTimeCallback

参数:

timestamp - The timestamp for which the trigger event was scheduled.

抛出:

Exception

processWatermark

public void processWatermark(Watermark mark)
                      throws Exception

Override the base implementation to completely ignore watermarks propagated from upstream, except for the "end of time" watermark.

指定者:

processWatermark 在接口中 OneInputStreamOperator<T,T>

覆盖:

processWatermark 在类中 AbstractStreamOperator<T>

抛出:

Exception

另请参阅:

Watermark

close

public void close()
           throws Exception

从类复制的说明: AbstractStreamOperator

This method is called after all records have been added to the operators via the methods OneInputStreamOperator.processElement(StreamRecord), or TwoInputStreamOperator.processElement1(StreamRecord) and TwoInputStreamOperator.processElement2(StreamRecord).

The method is expected to flush all remaining buffered data. Exceptions during this flushing of buffered should be propagated, in order to cause the operation to be recognized asa failed, because the last data items are not processed properly.

指定者:

close 在接口中 StreamOperator<T>

覆盖:

close 在类中 AbstractStreamOperator<T>

抛出:

Exception - An exception in this method causes the operator to fail.