org.apache.flink.streaming.api.operators.windowing

Class GroupedStreamDiscretizer<IN>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<WindowEvent<IN>>

org.apache.flink.streaming.api.operators.windowing.StreamDiscretizer<IN>

org.apache.flink.streaming.api.operators.windowing.GroupedStreamDiscretizer<IN>

All Implemented Interfaces:

Serializable, OneInputStreamOperator<IN,WindowEvent<IN>>, StreamOperator<WindowEvent<IN>>

Direct Known Subclasses:

GroupedActiveDiscretizer

public class GroupedStreamDiscretizer<IN>
extends StreamDiscretizer<IN>

This operator represents the grouped discretization step of a window transformation. The user supplied eviction and trigger policies are applied on a per group basis to create the StreamWindow that will be further transformed in the next stages.

To allow pre-aggregations supply an appropriate WindowBuffer

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

StreamOperator.ChainingStrategy

Field Summary

Fields

Modifier and Type	Field and Description
protected CloneableEvictionPolicy<IN>	evictionPolicy
protected Map<Object,StreamDiscretizer<IN>>	groupedDiscretizers
protected org.apache.flink.api.java.functions.KeySelector<IN,?>	keySelector
protected org.apache.flink.configuration.Configuration	parameters
protected CloneableTriggerPolicy<IN>	triggerPolicy

Fields inherited from class org.apache.flink.streaming.api.operators.windowing.StreamDiscretizer

windowEvent

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, executionConfig, inputCopyDisabled, output, runtimeContext

Constructor Summary

Constructors

Constructor and Description
GroupedStreamDiscretizer(org.apache.flink.api.java.functions.KeySelector<IN,?> keySelector, CloneableTriggerPolicy<IN> triggerPolicy, CloneableEvictionPolicy<IN> evictionPolicy)

Method Summary

Modifier and Type	Method and Description
void	close() This method is called after no more elements for can arrive for processing.
boolean	equals(Object other)
protected StreamDiscretizer<IN>	makeNewGroup(Object key) This method creates a new group.
void	processElement(IN element)
String	toString()

Methods inherited from class org.apache.flink.streaming.api.operators.windowing.StreamDiscretizer

emitWindow, getEviction, getTrigger, open, processRealElement, triggerOnFakeElement

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

disableInputCopy, getChainingStrategy, isInputCopyingDisabled, setChainingStrategy, setup

Methods inherited from class java.lang.Object

clone, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

getChainingStrategy, isInputCopyingDisabled, setChainingStrategy, setup

Field Detail

keySelector

protected org.apache.flink.api.java.functions.KeySelector<IN,?> keySelector

parameters

protected org.apache.flink.configuration.Configuration parameters

triggerPolicy

protected CloneableTriggerPolicy<IN> triggerPolicy

evictionPolicy

protected CloneableEvictionPolicy<IN> evictionPolicy

groupedDiscretizers

protected Map<Object,StreamDiscretizer<IN>> groupedDiscretizers

Constructor Detail

GroupedStreamDiscretizer

public GroupedStreamDiscretizer(org.apache.flink.api.java.functions.KeySelector<IN,?> keySelector,
                                CloneableTriggerPolicy<IN> triggerPolicy,
                                CloneableEvictionPolicy<IN> evictionPolicy)

Method Detail

close

public void close()
           throws Exception

Description copied from interface: StreamOperator

This method is called after no more elements for can arrive for processing.

Specified by:

close in interface StreamOperator<WindowEvent<IN>>

Overrides:

close in class StreamDiscretizer<IN>

Throws:

Exception

processElement

public void processElement(IN element)
                    throws Exception

Specified by:

processElement in interface OneInputStreamOperator<IN,WindowEvent<IN>>

Overrides:

processElement in class StreamDiscretizer<IN>

Throws:

Exception

makeNewGroup

protected StreamDiscretizer<IN> makeNewGroup(Object key)
                                      throws Exception

This method creates a new group. The method gets called in case an element arrives which has a key which was not seen before. The method created a nested StreamDiscretizer and therefore created clones of all distributed trigger and eviction policies.

Parameters:

key - The key of the new group.

Throws:

Exception

equals

public boolean equals(Object other)

Overrides:

equals in class StreamDiscretizer<IN>

toString

public String toString()

Overrides:

toString in class StreamDiscretizer<IN>