org.apache.flink.api.java.operators

Class GroupReduceOperator<IN,OUT>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

org.apache.flink.api.java.operators.SingleInputOperator<IN,OUT,O>

org.apache.flink.api.java.operators.SingleInputUdfOperator<IN,OUT,GroupReduceOperator<IN,OUT>>

org.apache.flink.api.java.operators.GroupReduceOperator<IN,OUT>

Type Parameters:

IN - The type of the data set consumed by the operator.

OUT - The type of the data set created by the operator.

All Implemented Interfaces:

UdfOperator<GroupReduceOperator<IN,OUT>>

public class GroupReduceOperator<IN,OUT>
extends SingleInputUdfOperator<IN,OUT,GroupReduceOperator<IN,OUT>>

This operator represents the application of a "reduceGroup" function on a data set, and the result data set produced by the function.

Field Summary

Fields inherited from class org.apache.flink.api.java.operators.Operator

dop, name

Constructor Summary

Constructors

Constructor and Description
GroupReduceOperator(DataSet<IN> input, TypeInformation<OUT> resultType, GroupReduceFunction<IN,OUT> function, String defaultName) Constructor for a non-grouped reduce (all reduce).
GroupReduceOperator(Grouping<IN> input, TypeInformation<OUT> resultType, GroupReduceFunction<IN,OUT> function, String defaultName) Constructor for a grouped reduce.

Method Summary

Methods

Modifier and Type	Method and Description
boolean	isCombinable()
GroupReduceOperator<IN,OUT>	setCombinable(boolean combinable)
protected GroupReduceOperatorBase<?,OUT,?>	translateToDataFlow(Operator<IN> input) Translates this operation to a data flow operator of the common data flow API.

Methods inherited from class org.apache.flink.api.java.operators.SingleInputUdfOperator

extractSemanticAnnotationsFromUdf, getBroadcastSets, getParameters, getSemanticProperties, setSemanticProperties, withBroadcastSet, withConstantSet, withParameters

Methods inherited from class org.apache.flink.api.java.operators.SingleInputOperator

getInput, getInputType

Methods inherited from class org.apache.flink.api.java.operators.Operator

getName, getParallelism, getResultType, name, setParallelism

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, filter, first, flatMap, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionCustom, partitionCustom, partitionCustom, print, printToErr, project, rebalance, reduce, reduceGroup, runOperation, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GroupReduceOperator

public GroupReduceOperator(DataSet<IN> input,
                   TypeInformation<OUT> resultType,
                   GroupReduceFunction<IN,OUT> function,
                   String defaultName)

Constructor for a non-grouped reduce (all reduce).

Parameters:

input - The input data set to the groupReduce function.

function - The user-defined GroupReduce function.

GroupReduceOperator

public GroupReduceOperator(Grouping<IN> input,
                   TypeInformation<OUT> resultType,
                   GroupReduceFunction<IN,OUT> function,
                   String defaultName)

Constructor for a grouped reduce.

Parameters:

input - The grouped input to be processed group-wise by the groupReduce function.

function - The user-defined GroupReduce function.

Method Detail

isCombinable

public boolean isCombinable()

setCombinable

public GroupReduceOperator<IN,OUT> setCombinable(boolean combinable)

translateToDataFlow

protected GroupReduceOperatorBase<?,OUT,?> translateToDataFlow(Operator<IN> input)

Description copied from class: SingleInputOperator

Translates this operation to a data flow operator of the common data flow API.

Specified by:

translateToDataFlow in class SingleInputOperator<IN,OUT,GroupReduceOperator<IN,OUT>>

Parameters:

input - The data flow operator that produces this operation's input data.

Returns:

The translated data flow operator.