org.apache.flink.table.runtime.operators.deduplicate

Class MiniBatchDeduplicateKeepFirstRowFunction

java.lang.Object

org.apache.flink.table.runtime.operators.bundle.MapBundleFunction<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

org.apache.flink.table.runtime.operators.deduplicate.MiniBatchDeduplicateKeepFirstRowFunction

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function

public class MiniBatchDeduplicateKeepFirstRowFunction
extends MapBundleFunction<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

This function is used to get the first row for every key partition in miniBatch mode.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.table.runtime.operators.bundle.MapBundleFunction

ctx

Constructor Summary

Constructors

Constructor and Description
MiniBatchDeduplicateKeepFirstRowFunction(org.apache.flink.api.common.typeutils.TypeSerializer<org.apache.flink.table.data.RowData> typeSerializer, long minRetentionTime)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.table.data.RowData	addInput(org.apache.flink.table.data.RowData value, org.apache.flink.table.data.RowData input) Adds the given input to the given value, returning the new bundle value.
void	finishBundle(Map<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData> buffer, org.apache.flink.util.Collector<org.apache.flink.table.data.RowData> out) Called when a bundle is finished.
void	open(ExecutionContext ctx)

Methods inherited from class org.apache.flink.table.runtime.operators.bundle.MapBundleFunction

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MiniBatchDeduplicateKeepFirstRowFunction

public MiniBatchDeduplicateKeepFirstRowFunction(org.apache.flink.api.common.typeutils.TypeSerializer<org.apache.flink.table.data.RowData> typeSerializer,
                                                long minRetentionTime)

Method Detail

open

public void open(ExecutionContext ctx)
          throws Exception

Overrides:

open in class MapBundleFunction<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

Throws:

Exception

addInput

public org.apache.flink.table.data.RowData addInput(@Nullable
                                                    org.apache.flink.table.data.RowData value,
                                                    org.apache.flink.table.data.RowData input)

Description copied from class: MapBundleFunction

Adds the given input to the given value, returning the new bundle value.

Specified by:

addInput in class MapBundleFunction<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

Parameters:

value - the existing bundle value, maybe null

input - the given input, not null

finishBundle

public void finishBundle(Map<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData> buffer,
                         org.apache.flink.util.Collector<org.apache.flink.table.data.RowData> out)
                  throws Exception

Description copied from class: MapBundleFunction

Called when a bundle is finished. Transform a bundle to zero, one, or more output elements.

Specified by:

finishBundle in class MapBundleFunction<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

Throws:

Exception