org.apache.flink.api.java.operators

Class SortPartitionOperator<T>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

org.apache.flink.api.java.operators.SingleInputOperator<T,T,SortPartitionOperator<T>>

org.apache.flink.api.java.operators.SortPartitionOperator<T>

Type Parameters:

T - The type of the DataSet with locally sorted partitions.

public class SortPartitionOperator<T>
extends SingleInputOperator<T,T,SortPartitionOperator<T>>

This operator represents a DataSet with locally sorted partitions.

Field Summary

Fields inherited from class org.apache.flink.api.java.operators.Operator

name, parallelism

Fields inherited from class org.apache.flink.api.java.DataSet

context

Constructor Summary

Constructors

Constructor and Description
SortPartitionOperator(DataSet<T> dataSet, int sortField, org.apache.flink.api.common.operators.Order sortOrder, String sortLocationName)
SortPartitionOperator(DataSet<T> dataSet, String sortField, org.apache.flink.api.common.operators.Order sortOrder, String sortLocationName)

Method Summary

Modifier and Type	Method and Description
SortPartitionOperator<T>	sortPartition(int field, org.apache.flink.api.common.operators.Order order) Appends an additional sort order with the specified field in the specified order to the local partition sorting of the DataSet.
SortPartitionOperator<T>	sortPartition(String field, org.apache.flink.api.common.operators.Order order) Appends an additional sort order with the specified field in the specified order to the local partition sorting of the DataSet.
protected org.apache.flink.api.common.operators.SingleInputOperator<?,T,?>	translateToDataFlow(org.apache.flink.api.common.operators.Operator<T> input) Translates this operation to a data flow operator of the common data flow API.

Methods inherited from class org.apache.flink.api.java.operators.SingleInputOperator

getInput, getInputType

Methods inherited from class org.apache.flink.api.java.operators.Operator

getName, getParallelism, getResultType, name, setParallelism

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, runOperation, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SortPartitionOperator

public SortPartitionOperator(DataSet<T> dataSet,
                             int sortField,
                             org.apache.flink.api.common.operators.Order sortOrder,
                             String sortLocationName)

SortPartitionOperator

public SortPartitionOperator(DataSet<T> dataSet,
                             String sortField,
                             org.apache.flink.api.common.operators.Order sortOrder,
                             String sortLocationName)

Method Detail

sortPartition

public SortPartitionOperator<T> sortPartition(int field,
                                              org.apache.flink.api.common.operators.Order order)

Appends an additional sort order with the specified field in the specified order to the local partition sorting of the DataSet.

Overrides:

sortPartition in class DataSet<T>

Parameters:

field - The field index of the additional sort order of the local partition sorting.

order - The order of the additional sort order of the local partition sorting.

Returns:

The DataSet with sorted local partitions.

sortPartition

public SortPartitionOperator<T> sortPartition(String field,
                                              org.apache.flink.api.common.operators.Order order)

Appends an additional sort order with the specified field in the specified order to the local partition sorting of the DataSet.

Overrides:

sortPartition in class DataSet<T>

Parameters:

field - The field expression referring to the field of the additional sort order of the local partition sorting.

order - The order of the additional sort order of the local partition sorting.

Returns:

The DataSet with sorted local partitions.

translateToDataFlow

protected org.apache.flink.api.common.operators.SingleInputOperator<?,T,?> translateToDataFlow(org.apache.flink.api.common.operators.Operator<T> input)

Description copied from class: SingleInputOperator

Translates this operation to a data flow operator of the common data flow API.

Specified by:

translateToDataFlow in class SingleInputOperator<T,T,SortPartitionOperator<T>>

Parameters:

input - The data flow operator that produces this operation's input data.

Returns:

The translated data flow operator.