org.apache.flink.table.runtime.operators.deduplicate

Class DeduplicateKeepLastRowFunction

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.KeyedProcessFunction<K,IN,OUT>

org.apache.flink.table.runtime.functions.KeyedProcessFunctionWithCleanupState<BaseRow,BaseRow,BaseRow>

org.apache.flink.table.runtime.operators.deduplicate.DeduplicateKeepLastRowFunction

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, CleanupState

public class DeduplicateKeepLastRowFunction
extends KeyedProcessFunctionWithCleanupState<BaseRow,BaseRow,BaseRow>

This function is used to deduplicate on keys and keeps only last row.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.KeyedProcessFunction

org.apache.flink.streaming.api.functions.KeyedProcessFunction.Context, org.apache.flink.streaming.api.functions.KeyedProcessFunction.OnTimerContext

Field Summary

Fields inherited from class org.apache.flink.table.runtime.functions.KeyedProcessFunctionWithCleanupState

stateCleaningEnabled

Constructor Summary

Constructors

Constructor and Description
DeduplicateKeepLastRowFunction(long minRetentionTime, long maxRetentionTime, BaseRowTypeInfo rowTypeInfo, boolean generateRetraction)

Method Summary

Modifier and Type	Method and Description
void	onTimer(long timestamp, org.apache.flink.streaming.api.functions.KeyedProcessFunction.OnTimerContext ctx, org.apache.flink.util.Collector<BaseRow> out)
void	open(org.apache.flink.configuration.Configuration configure)
void	processElement(BaseRow input, org.apache.flink.streaming.api.functions.KeyedProcessFunction.Context ctx, org.apache.flink.util.Collector<BaseRow> out)

Methods inherited from class org.apache.flink.table.runtime.functions.KeyedProcessFunctionWithCleanupState

cleanupState, initCleanupTimeState, isProcessingTimeTimer, needToCleanupState, registerProcessingCleanupTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.runtime.functions.CleanupState

registerProcessingCleanupTimer

Constructor Detail

DeduplicateKeepLastRowFunction

public DeduplicateKeepLastRowFunction(long minRetentionTime,
                                      long maxRetentionTime,
                                      BaseRowTypeInfo rowTypeInfo,
                                      boolean generateRetraction)

Method Detail

open

public void open(org.apache.flink.configuration.Configuration configure)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

processElement

public void processElement(BaseRow input,
                           org.apache.flink.streaming.api.functions.KeyedProcessFunction.Context ctx,
                           org.apache.flink.util.Collector<BaseRow> out)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.KeyedProcessFunction<BaseRow,BaseRow,BaseRow>

Throws:

Exception

onTimer

public void onTimer(long timestamp,
                    org.apache.flink.streaming.api.functions.KeyedProcessFunction.OnTimerContext ctx,
                    org.apache.flink.util.Collector<BaseRow> out)
             throws Exception

Overrides:

onTimer in class org.apache.flink.streaming.api.functions.KeyedProcessFunction<BaseRow,BaseRow,BaseRow>

Throws:

Exception