org.apache.flink.api.java.operators

Class JoinOperator<I1,I2,OUT>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

org.apache.flink.api.java.operators.TwoInputOperator<IN1,IN2,OUT,O>

org.apache.flink.api.java.operators.TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

org.apache.flink.api.java.operators.JoinOperator<I1,I2,OUT>

Type Parameters:

I1 - The type of the first input DataSet of the Join transformation.

I2 - The type of the second input DataSet of the Join transformation.

OUT - The type of the result of the Join transformation.

All Implemented Interfaces:

UdfOperator<JoinOperator<I1,I2,OUT>>

Direct Known Subclasses:

JoinOperator.EquiJoin

public abstract class JoinOperator<I1,I2,OUT>
extends TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

A DataSet that is the result of a Join transformation.

See Also:

DataSet

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	JoinOperator.DefaultFlatJoinFunction<T1,T2>
static class	JoinOperator.DefaultJoin<I1,I2> A Join transformation that wraps pairs of joining elements into Tuple2. It also represents the DataSet that is the result of a Join transformation.
static class	JoinOperator.EquiJoin<I1,I2,OUT> A Join transformation that applies a JoinFunction on each pair of joining elements. It also represents the DataSet that is the result of a Join transformation.
static class	JoinOperator.JoinOperatorSets<I1,I2> Intermediate step of a Join transformation.
static class	JoinOperator.JoinProjection<I1,I2>
static class	JoinOperator.ProjectFlatJoinFunction<T1,T2,R extends Tuple>
static class	JoinOperator.ProjectJoin<I1,I2,OUT extends Tuple> A Join transformation that projects joining elements or fields of joining Tuples into result Tuples.

Field Summary

Fields

Modifier and Type	Field and Description
protected Keys<I1>	keys1
protected Keys<I2>	keys2

Fields inherited from class org.apache.flink.api.java.operators.Operator

dop, name

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	JoinOperator(DataSet<I1> input1, DataSet<I2> input2, Keys<I1> keys1, Keys<I2> keys2, TypeInformation<OUT> returnType, JoinOperatorBase.JoinHint hint)

Method Summary

Methods

Modifier and Type	Method and Description
JoinOperatorBase.JoinHint	getJoinHint() Gets the JoinHint that describes how the join is executed.
protected Keys<I1>	getKeys1()
protected Keys<I2>	getKeys2()
Partitioner<?>	getPartitioner() Gets the custom partitioner used by this join, or null, if none is set.
JoinOperator<I1,I2,OUT>	withPartitioner(Partitioner<?> partitioner) Sets a custom partitioner for this join.

Methods inherited from class org.apache.flink.api.java.operators.TwoInputUdfOperator

extractSemanticAnnotationsFromUdf, getBroadcastSets, getParameters, getSemanticProperties, setSemanticProperties, withBroadcastSet, withConstantSetFirst, withConstantSetSecond, withParameters

Methods inherited from class org.apache.flink.api.java.operators.TwoInputOperator

getInput1, getInput1Type, getInput2, getInput2Type, translateToDataFlow

Methods inherited from class org.apache.flink.api.java.operators.Operator

getName, getParallelism, getResultType, name, setParallelism

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, filter, first, flatMap, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionCustom, partitionCustom, partitionCustom, print, printToErr, project, rebalance, reduce, reduceGroup, runOperation, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

keys1

protected final Keys<I1> keys1

keys2

protected final Keys<I2> keys2

Constructor Detail

JoinOperator

protected JoinOperator(DataSet<I1> input1,
            DataSet<I2> input2,
            Keys<I1> keys1,
            Keys<I2> keys2,
            TypeInformation<OUT> returnType,
            JoinOperatorBase.JoinHint hint)

Method Detail

getKeys1

protected Keys<I1> getKeys1()

getKeys2

protected Keys<I2> getKeys2()

getJoinHint

public JoinOperatorBase.JoinHint getJoinHint()

Gets the JoinHint that describes how the join is executed.

Returns:

The JoinHint.

withPartitioner

public JoinOperator<I1,I2,OUT> withPartitioner(Partitioner<?> partitioner)

Sets a custom partitioner for this join. The partitioner will be called on the join keys to determine the partition a key should be assigned to. The partitioner is evaluated on both join inputs in the same way.

NOTE: A custom partitioner can only be used with single-field join keys, not with composite join keys.

Parameters:

partitioner - The custom partitioner to be used.

Returns:

This join operator, to allow for function chaining.

getPartitioner

public Partitioner<?> getPartitioner()

Gets the custom partitioner used by this join, or null, if none is set.

Returns:

The custom partitioner used by this join;