org.apache.flink.streaming.api.operators.async

类 AsyncWaitOperator<IN,OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator<OUT,AsyncFunction<IN,OUT>>

org.apache.flink.streaming.api.operators.async.AsyncWaitOperator<IN,OUT>

类型参数:

IN - Input type for the operator.

OUT - Output type for the operator.

所有已实现的接口:

Serializable, org.apache.flink.runtime.state.CheckpointListener, BoundedOneInput, KeyContext, OneInputStreamOperator<IN,OUT>, OutputTypeConfigurable<OUT>, SetupableStreamOperator<OUT>, StreamOperator<OUT>, StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.util.Disposable

@Internal
public class AsyncWaitOperator<IN,OUT>
extends AbstractUdfStreamOperator<OUT,AsyncFunction<IN,OUT>>
implements OneInputStreamOperator<IN,OUT>, BoundedOneInput

The AsyncWaitOperator allows to asynchronously process incoming stream records. For that the operator creates an ResultFuture which is passed to an AsyncFunction. Within the async function, the user can complete the async collector arbitrarily. Once the async collector has been completed, the result is emitted by the operator's emitter to downstream operators.

The operator offers different output modes depending on the chosen AsyncDataStream.OutputMode. In order to give exactly once processing guarantees, the operator stores all currently in-flight StreamElement in it's operator state. Upon recovery the recorded set of stream elements is replayed.

In case of chaining of this operator, it has to be made sure that the operators in the chain are opened tail to head. The reason for this is that an opened AsyncWaitOperator starts already emitting recovered StreamElement to downstream operators.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

userFunction

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
AsyncWaitOperator(AsyncFunction<IN,OUT> asyncFunction, long timeout, int capacity, AsyncDataStream.OutputMode outputMode, ProcessingTimeService processingTimeService, MailboxExecutor mailboxExecutor)

方法概要

限定符和类型	方法和说明
void	endInput() It is notified that no more data will arrive on the input.
void	initializeState(org.apache.flink.runtime.state.StateInitializationContext context) Stream operators with state which can be restored need to override this hook method.
void	open() This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g. state initialization.
void	processElement(StreamRecord<IN> element) Processes one element that arrived at this operator.
void	processWatermark(Watermark mark) Processes a Watermark.
void	setup(StreamTask<?,?> containingTask, StreamConfig config, Output<StreamRecord<OUT>> output) Initializes the operator.
void	snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context) Stream operators with state, which want to participate in a snapshot need to override this hook method.

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

close, dispose, getUserFunction, getUserFunctionParameters, notifyCheckpointAborted, notifyCheckpointComplete, setOutputType

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, isUsingCustomRawKeyedState, numEventTimeTimers, numProcessingTimeTimers, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

processLatencyMarker

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, dispose, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.runtime.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

构造器详细资料

AsyncWaitOperator

public AsyncWaitOperator(@Nonnull
                         AsyncFunction<IN,OUT> asyncFunction,
                         long timeout,
                         int capacity,
                         @Nonnull
                         AsyncDataStream.OutputMode outputMode,
                         @Nonnull
                         ProcessingTimeService processingTimeService,
                         @Nonnull
                         MailboxExecutor mailboxExecutor)

方法详细资料

setup

public void setup(StreamTask<?,?> containingTask,
                  StreamConfig config,
                  Output<StreamRecord<OUT>> output)

从接口复制的说明: SetupableStreamOperator

Initializes the operator. Sets access to the context and the output.

指定者:

setup 在接口中 SetupableStreamOperator<OUT>

覆盖:

setup 在类中 AbstractUdfStreamOperator<OUT,AsyncFunction<IN,OUT>>

open

public void open()
          throws Exception

从类复制的说明: AbstractStreamOperator

This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g. state initialization.

The default implementation does nothing.

指定者:

open 在接口中 StreamOperator<OUT>

覆盖:

open 在类中 AbstractUdfStreamOperator<OUT,AsyncFunction<IN,OUT>>

抛出:

Exception - An exception in this method causes the operator to fail.

processElement

public void processElement(StreamRecord<IN> element)
                    throws Exception

从接口复制的说明: OneInputStreamOperator

Processes one element that arrived at this operator. This method is guaranteed to not be called concurrently with other methods of the operator.

指定者:

processElement 在接口中 OneInputStreamOperator<IN,OUT>

抛出:

Exception

processWatermark

public void processWatermark(Watermark mark)
                      throws Exception

从接口复制的说明: OneInputStreamOperator

Processes a Watermark. This method is guaranteed to not be called concurrently with other methods of the operator.

指定者:

processWatermark 在接口中 OneInputStreamOperator<IN,OUT>

覆盖:

processWatermark 在类中 AbstractStreamOperator<OUT>

抛出:

Exception

另请参阅:

Watermark

snapshotState

public void snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)
                   throws Exception

从类复制的说明: AbstractStreamOperator

Stream operators with state, which want to participate in a snapshot need to override this hook method.

指定者:

snapshotState 在接口中 StreamOperatorStateHandler.CheckpointedStreamOperator

覆盖:

snapshotState 在类中 AbstractUdfStreamOperator<OUT,AsyncFunction<IN,OUT>>

参数:

context - context that provides information and means required for taking a snapshot

抛出:

Exception

initializeState

public void initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
                     throws Exception

从类复制的说明: AbstractStreamOperator

Stream operators with state which can be restored need to override this hook method.

指定者:

initializeState 在接口中 StreamOperatorStateHandler.CheckpointedStreamOperator

覆盖:

initializeState 在类中 AbstractUdfStreamOperator<OUT,AsyncFunction<IN,OUT>>

参数:

context - context that allows to register different states.

抛出:

Exception

endInput

public void endInput()
              throws Exception

从接口复制的说明: BoundedOneInput

It is notified that no more data will arrive on the input.

指定者:

endInput 在接口中 BoundedOneInput

抛出:

Exception