org.apache.flink.table.runtime.operators.deduplicate

类 RowTimeDeduplicateFunction

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.KeyedProcessFunction<K,IN,OUT>

org.apache.flink.table.runtime.operators.deduplicate.RowTimeDeduplicateFunction

所有已实现的接口:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

public class RowTimeDeduplicateFunction
extends org.apache.flink.streaming.api.functions.KeyedProcessFunction<K,IN,OUT>

This function is used to deduplicate on keys and keeps only first or last row on row time.

另请参阅:

序列化表格

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.streaming.api.functions.KeyedProcessFunction

org.apache.flink.streaming.api.functions.KeyedProcessFunction.Context, org.apache.flink.streaming.api.functions.KeyedProcessFunction.OnTimerContext

字段概要

字段

限定符和类型	字段和说明
protected org.apache.flink.api.common.typeutils.TypeSerializer<OUT>	serializer
protected org.apache.flink.api.common.state.ValueState<T>	state
protected long	stateRetentionTime
protected org.apache.flink.api.common.typeinfo.TypeInformation<T>	typeInfo

构造器概要

构造器

构造器和说明
RowTimeDeduplicateFunction(InternalTypeInfo<org.apache.flink.table.data.RowData> typeInfo, long minRetentionTime, int rowtimeIndex, boolean generateUpdateBefore, boolean generateInsert, boolean keepLastRow)

方法概要

限定符和类型	方法和说明
static void	deduplicateOnRowTime(org.apache.flink.api.common.state.ValueState<org.apache.flink.table.data.RowData> state, org.apache.flink.table.data.RowData currentRow, org.apache.flink.util.Collector<org.apache.flink.table.data.RowData> out, boolean generateUpdateBefore, boolean generateInsert, int rowtimeIndex, boolean keepLastRow) Processes element to deduplicate on keys with row time semantic, sends current element if it is last or first row, retracts previous element if needed.
void	open(org.apache.flink.configuration.Configuration configure)
void	processElement(org.apache.flink.table.data.RowData input, org.apache.flink.streaming.api.functions.KeyedProcessFunction.Context ctx, org.apache.flink.util.Collector<org.apache.flink.table.data.RowData> out)

从类继承的方法 org.apache.flink.streaming.api.functions.KeyedProcessFunction

onTimer

从类继承的方法 org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

typeInfo

protected final org.apache.flink.api.common.typeinfo.TypeInformation<T> typeInfo

stateRetentionTime

protected final long stateRetentionTime

serializer

protected final org.apache.flink.api.common.typeutils.TypeSerializer<OUT> serializer

state

protected org.apache.flink.api.common.state.ValueState<T> state

构造器详细资料

RowTimeDeduplicateFunction

public RowTimeDeduplicateFunction(InternalTypeInfo<org.apache.flink.table.data.RowData> typeInfo,
                                  long minRetentionTime,
                                  int rowtimeIndex,
                                  boolean generateUpdateBefore,
                                  boolean generateInsert,
                                  boolean keepLastRow)

方法详细资料

processElement

public void processElement(org.apache.flink.table.data.RowData input,
                           org.apache.flink.streaming.api.functions.KeyedProcessFunction.Context ctx,
                           org.apache.flink.util.Collector<org.apache.flink.table.data.RowData> out)
                    throws Exception

指定者:

processElement 在类中 org.apache.flink.streaming.api.functions.KeyedProcessFunction<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

抛出:

Exception

deduplicateOnRowTime

public static void deduplicateOnRowTime(org.apache.flink.api.common.state.ValueState<org.apache.flink.table.data.RowData> state,
                                        org.apache.flink.table.data.RowData currentRow,
                                        org.apache.flink.util.Collector<org.apache.flink.table.data.RowData> out,
                                        boolean generateUpdateBefore,
                                        boolean generateInsert,
                                        int rowtimeIndex,
                                        boolean keepLastRow)
                                 throws Exception

Processes element to deduplicate on keys with row time semantic, sends current element if it is last or first row, retracts previous element if needed.

参数:

state - state of function

currentRow - latest row received by deduplicate function

out - underlying collector

generateUpdateBefore - flag to generate UPDATE_BEFORE message or not

generateInsert - flag to gennerate INSERT message or not

rowtimeIndex - the index of rowtime field

keepLastRow - flag to keep last row or keep first row

抛出:

Exception

open

public void open(org.apache.flink.configuration.Configuration configure)
          throws Exception

指定者:

open 在接口中 org.apache.flink.api.common.functions.RichFunction

覆盖:

open 在类中 org.apache.flink.api.common.functions.AbstractRichFunction

抛出:

Exception