org.apache.flink.api.java.operators

Class ProjectOperator<IN,OUT extends Tuple>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

org.apache.flink.api.java.operators.SingleInputOperator<IN,OUT,ProjectOperator<IN,OUT>>

org.apache.flink.api.java.operators.ProjectOperator<IN,OUT>

Type Parameters:

IN - The type of the data set projected by the operator.

OUT - The type of data set that is the result of the projection.

public class ProjectOperator<IN,OUT extends Tuple>
extends SingleInputOperator<IN,OUT,ProjectOperator<IN,OUT>>

This operator represents the application of a projection operation on a data set, and the result data set produced by the function.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ProjectOperator.Projection<T>

Field Summary

Fields

Modifier and Type	Field and Description
protected int[]	fields

Fields inherited from class org.apache.flink.api.java.operators.Operator

dop, name

Constructor Summary

Constructors

Constructor and Description
ProjectOperator(DataSet<IN> input, int[] fields, TupleTypeInfo<OUT> returnType)
ProjectOperator(DataSet<IN> input, int[] fields, TupleTypeInfo<OUT> returnType, ProjectOperator.Projection<IN> proj)

Method Summary

Methods

Modifier and Type	Method and Description
<OUT extends Tuple> ProjectOperator<?,OUT>	project(int... fieldIndexes) Continues a Project transformation on a Tuple DataSet. Note: Only Tuple DataSets can be projected using field indexes. The transformation projects each Tuple of the DataSet onto a (sub)set of fields. Additional fields can be added to the projection by calling project(int[]).
protected MapOperatorBase<IN,OUT,MapFunction<IN,OUT>>	translateToDataFlow(Operator<IN> input) Translates this operation to a data flow operator of the common data flow API.
<OUT extends Tuple> ProjectOperator<IN,OUT>	types(Class<?>... types) Deprecated.

Methods inherited from class org.apache.flink.api.java.operators.SingleInputOperator

getInput, getInputType

Methods inherited from class org.apache.flink.api.java.operators.Operator

getName, getParallelism, getResultType, name, setParallelism

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, filter, first, flatMap, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionCustom, partitionCustom, partitionCustom, print, printToErr, rebalance, reduce, reduceGroup, runOperation, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

fields

protected final int[] fields

Constructor Detail

ProjectOperator

public ProjectOperator(DataSet<IN> input,
               int[] fields,
               TupleTypeInfo<OUT> returnType)

ProjectOperator

public ProjectOperator(DataSet<IN> input,
               int[] fields,
               TupleTypeInfo<OUT> returnType,
               ProjectOperator.Projection<IN> proj)

Method Detail

translateToDataFlow

protected MapOperatorBase<IN,OUT,MapFunction<IN,OUT>> translateToDataFlow(Operator<IN> input)

Description copied from class: SingleInputOperator

Translates this operation to a data flow operator of the common data flow API.

Specified by:

translateToDataFlow in class SingleInputOperator<IN,OUT extends Tuple,ProjectOperator<IN,OUT extends Tuple>>

Parameters:

input - The data flow operator that produces this operation's input data.

Returns:

The translated data flow operator.

project

public <OUT extends Tuple> ProjectOperator<?,OUT> project(int... fieldIndexes)

Continues a Project transformation on a Tuple DataSet.
Note: Only Tuple DataSets can be projected using field indexes.
The transformation projects each Tuple of the DataSet onto a (sub)set of fields.
Additional fields can be added to the projection by calling project(int[]). Note: With the current implementation, the Project transformation looses type information.

Overrides:

project in class DataSet<OUT extends Tuple>

Parameters:

fieldIndexes - The field indexes which are added to the Project transformation. The order of fields in the output tuple corresponds to the order of field indexes.

Returns:

A ProjectOperator that represents the projected DataSet.

See Also:

Tuple, DataSet, ProjectOperator

types

@Deprecated
public <OUT extends Tuple> ProjectOperator<IN,OUT> types(Class<?>... types)

Deprecated.

Deprecated method only kept for compatibility.

Parameters:

types -

Returns: