org.apache.flink.table.runtime.operators.bundle

类 AbstractMapBundleOperator<K,V,IN,OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.table.runtime.operators.bundle.AbstractMapBundleOperator<K,V,IN,OUT>

类型参数:

K - The type of the key in the bundle map

V - The type of the value in the bundle map

IN - Input type for the operator.

OUT - Output type for the operator.

所有已实现的接口:

Serializable, org.apache.flink.runtime.state.CheckpointListener, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,OUT>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, BundleTriggerCallback, org.apache.flink.util.Disposable

直接已知子类:

KeyedMapBundleOperator, MapBundleOperator

public abstract class AbstractMapBundleOperator<K,V,IN,OUT>
extends org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>
implements org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,OUT>, BundleTriggerCallback

The AbstractMapBundleOperator simply used a java Map to store the input elements in key-value form. The map key is typically the same with the state key, so we can do some optimizations before accessing states, like pre aggregate values for each key. And we will only need to access state every key we have, but not every element we processed.

NOTES: if all elements we processed have different keys, such operator will only increase memory footprint, and will not have any performance improvement.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService

方法概要

限定符和类型	方法和说明
void	close()
void	finishBundle() This method is invoked to finish current bundle and start a new one when the trigger was fired.
protected abstract K	getKey(IN input) Get the key for current processing element, which will be used as the map bundle's key.
void	open()
void	prepareSnapshotPreBarrier(long checkpointId)
void	processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN> element)
void	processWatermark(org.apache.flink.streaming.api.watermark.Watermark mark)

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

dispose, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, notifyCheckpointAborted, notifyCheckpointComplete, numEventTimeTimers, numProcessingTimeTimers, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

processLatencyMarker

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

dispose, getMetricGroup, getOperatorID, initializeState, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.runtime.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

方法详细资料

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<OUT>

覆盖:

open 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

抛出:

Exception

processElement

public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN> element)
                    throws Exception

指定者:

processElement 在接口中 org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,OUT>

抛出:

Exception

getKey

protected abstract K getKey(IN input)
                     throws Exception

Get the key for current processing element, which will be used as the map bundle's key.

抛出:

Exception

finishBundle

public void finishBundle()
                  throws Exception

从接口复制的说明: BundleTriggerCallback

This method is invoked to finish current bundle and start a new one when the trigger was fired.

指定者:

finishBundle 在接口中 BundleTriggerCallback

抛出:

Exception - This method may throw exceptions. Throwing an exception will cause the operation to fail and may trigger recovery.

processWatermark

public void processWatermark(org.apache.flink.streaming.api.watermark.Watermark mark)
                      throws Exception

指定者:

processWatermark 在接口中 org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,OUT>

覆盖:

processWatermark 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

抛出:

Exception

prepareSnapshotPreBarrier

public void prepareSnapshotPreBarrier(long checkpointId)
                               throws Exception

指定者:

prepareSnapshotPreBarrier 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<OUT>

覆盖:

prepareSnapshotPreBarrier 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

抛出:

Exception

close

public void close()
           throws Exception

指定者:

close 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<OUT>

覆盖:

close 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

抛出:

Exception