org.apache.flink.streaming.api.datastream

Class IterativeStream.ConnectedIterativeStreams<I,F>

java.lang.Object

org.apache.flink.streaming.api.datastream.ConnectedStreams<I,F>

org.apache.flink.streaming.api.datastream.IterativeStream.ConnectedIterativeStreams<I,F>

Type Parameters:

I - Type of the input of the iteration

F - Type of the feedback of the iteration

Enclosing class:

IterativeStream<T>

@Public
public static class IterativeStream.ConnectedIterativeStreams<I,F>
extends ConnectedStreams<I,F>

The IterativeStream.ConnectedIterativeStreams represent a start of an iterative part of a streaming program, where the original input of the iteration and the feedback of the iteration are connected as in a ConnectedStreams.

The user can distinguish between the two inputs using co-transformation, thus eliminating the need for mapping the inputs and outputs to a common type.

Field Summary

Fields inherited from class org.apache.flink.streaming.api.datastream.ConnectedStreams

environment, inputStream1, inputStream2

Constructor Summary

Constructors

Constructor and Description
ConnectedIterativeStreams(DataStream<I> input, org.apache.flink.api.common.typeinfo.TypeInformation<F> feedbackType, long waitTime)

Method Summary

Modifier and Type	Method and Description
DataStream<F>	closeWith(DataStream<F> feedbackStream) Closes the iteration.
ConnectedStreams<I,F>	keyBy(int[] keyPositions1, int[] keyPositions2) KeyBy operation for connected data stream.
ConnectedStreams<I,F>	keyBy(org.apache.flink.api.java.functions.KeySelector<I,?> keySelector1, org.apache.flink.api.java.functions.KeySelector<F,?> keySelector2) KeyBy operation for connected data stream.
ConnectedStreams<I,F>	keyBy(String[] fields1, String[] fields2) KeyBy operation for connected data stream using key expressions.
ConnectedStreams<I,F>	keyBy(String field1, String field2) KeyBy operation for connected data stream using key expressions.

Methods inherited from class org.apache.flink.streaming.api.datastream.ConnectedStreams

flatMap, getExecutionEnvironment, getFirstInput, getSecondInput, getType1, getType2, keyBy, map, transform

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ConnectedIterativeStreams

public ConnectedIterativeStreams(DataStream<I> input,
                                 org.apache.flink.api.common.typeinfo.TypeInformation<F> feedbackType,
                                 long waitTime)

Method Detail

closeWith

public DataStream<F> closeWith(DataStream<F> feedbackStream)

Closes the iteration. This method defines the end of the iterative program part that will be fed back to the start of the iteration as the second input in the ConnectedStreams.

Parameters:

feedbackStream - DataStream that will be used as second input to the iteration head.

Returns:

The feedback stream.

keyBy

public ConnectedStreams<I,F> keyBy(int[] keyPositions1,
                                   int[] keyPositions2)

Description copied from class: ConnectedStreams

KeyBy operation for connected data stream. Assigns keys to the elements of input1 and input2 according to keyPositions1 and keyPositions2.

Overrides:

keyBy in class ConnectedStreams<I,F>

Parameters:

keyPositions1 - The fields used to group the first input stream.

keyPositions2 - The fields used to group the second input stream.

Returns:

The grouped ConnectedStreams

keyBy

public ConnectedStreams<I,F> keyBy(String field1,
                                   String field2)

Description copied from class: ConnectedStreams

KeyBy operation for connected data stream using key expressions. Assigns keys to the elements of input1 and input2 according to field1 and field2. A field expression is either the name of a public field or a getter method with parentheses of the DataStreamS underlying type. A dot can be used to drill down into objects, as in "field1.getInnerField2()" .

Overrides:

keyBy in class ConnectedStreams<I,F>

Parameters:

field1 - The grouping expression for the first input

field2 - The grouping expression for the second input

Returns:

The grouped ConnectedStreams

keyBy

public ConnectedStreams<I,F> keyBy(String[] fields1,
                                   String[] fields2)

Description copied from class: ConnectedStreams

KeyBy operation for connected data stream using key expressions. the elements of input1 and input2 according to fields1 and fields2. A field expression is either the name of a public field or a getter method with parentheses of the DataStreamS underlying type. A dot can be used to drill down into objects, as in "field1.getInnerField2()" .

Overrides:

keyBy in class ConnectedStreams<I,F>

Parameters:

fields1 - The grouping expressions for the first input

fields2 - The grouping expressions for the second input

Returns:

The grouped ConnectedStreams

keyBy

public ConnectedStreams<I,F> keyBy(org.apache.flink.api.java.functions.KeySelector<I,?> keySelector1,
                                   org.apache.flink.api.java.functions.KeySelector<F,?> keySelector2)

Description copied from class: ConnectedStreams

KeyBy operation for connected data stream. Assigns keys to the elements of input1 and input2 using keySelector1 and keySelector2.

Overrides:

keyBy in class ConnectedStreams<I,F>

Parameters:

keySelector1 - The KeySelector used for grouping the first input

keySelector2 - The KeySelector used for grouping the second input

Returns:

The partitioned ConnectedStreams