org.apache.flink.streaming.api.operators.windowing

Class ParallelMerge<OUT>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.co.RichCoFlatMapFunction<StreamWindow<OUT>,org.apache.flink.api.java.tuple.Tuple2<Integer,Integer>,StreamWindow<OUT>>

org.apache.flink.streaming.api.operators.windowing.ParallelMerge<OUT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, CoFlatMapFunction<StreamWindow<OUT>,org.apache.flink.api.java.tuple.Tuple2<Integer,Integer>,StreamWindow<OUT>>

Direct Known Subclasses:

ParallelGroupedMerge

public class ParallelMerge<OUT>
extends RichCoFlatMapFunction<StreamWindow<OUT>,org.apache.flink.api.java.tuple.Tuple2<Integer,Integer>,StreamWindow<OUT>>

Class that encapsulates the functionality necessary to merge windows created in parallel. This CoFlatMap uses the information received on the number of parts for each window to merge the different parts. It waits until it receives an indication on the number of parts from all the discretizers before producing any output.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected Integer	numberOfDiscretizers

Constructor Summary

Constructors

Constructor and Description
ParallelMerge(org.apache.flink.api.common.functions.ReduceFunction<OUT> reducer)

Method Summary

Modifier and Type	Method and Description
void	flatMap1(StreamWindow<OUT> nextWindow, org.apache.flink.util.Collector<StreamWindow<OUT>> out)
void	flatMap2(org.apache.flink.api.java.tuple.Tuple2<Integer,Integer> partInfo, org.apache.flink.util.Collector<StreamWindow<OUT>> out)
void	open(org.apache.flink.configuration.Configuration conf)
protected void	updateCurrent(StreamWindow<OUT> current, StreamWindow<OUT> nextWindow)

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

numberOfDiscretizers

protected Integer numberOfDiscretizers

Constructor Detail

ParallelMerge

public ParallelMerge(org.apache.flink.api.common.functions.ReduceFunction<OUT> reducer)

Method Detail

flatMap1

public void flatMap1(StreamWindow<OUT> nextWindow,
                     org.apache.flink.util.Collector<StreamWindow<OUT>> out)
              throws Exception

Throws:

Exception

flatMap2

public void flatMap2(org.apache.flink.api.java.tuple.Tuple2<Integer,Integer> partInfo,
                     org.apache.flink.util.Collector<StreamWindow<OUT>> out)
              throws Exception

Throws:

Exception

updateCurrent

protected void updateCurrent(StreamWindow<OUT> current,
                             StreamWindow<OUT> nextWindow)
                      throws Exception

Throws:

Exception

open

public void open(org.apache.flink.configuration.Configuration conf)

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction