org.apache.flink.api.java.operators

Class JoinOperator.EquiJoin<I1,I2,OUT>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

org.apache.flink.api.java.operators.TwoInputOperator<IN1,IN2,OUT,O>

org.apache.flink.api.java.operators.TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

org.apache.flink.api.java.operators.JoinOperator<I1,I2,OUT>

org.apache.flink.api.java.operators.JoinOperator.EquiJoin<I1,I2,OUT>

Type Parameters:

I1 - The type of the first input DataSet of the Join transformation.

I2 - The type of the second input DataSet of the Join transformation.

OUT - The type of the result of the Join transformation.

All Implemented Interfaces:

UdfOperator<JoinOperator<I1,I2,OUT>>

Direct Known Subclasses:

JoinOperator.DefaultJoin, JoinOperator.ProjectJoin

Enclosing class:

JoinOperator<I1,I2,OUT>

@Public
public static class JoinOperator.EquiJoin<I1,I2,OUT>
extends JoinOperator<I1,I2,OUT>

A Join transformation that applies a JoinFunction on each pair of joining elements.
It also represents the DataSet that is the result of a Join transformation.

See Also:

RichFlatJoinFunction, DataSet

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.java.operators.JoinOperator

JoinOperator.DefaultFlatJoinFunction<T1,T2>, JoinOperator.DefaultJoin<I1,I2>, JoinOperator.EquiJoin<I1,I2,OUT>, JoinOperator.JoinOperatorSets<I1,I2>, JoinOperator.JoinProjection<I1,I2>, JoinOperator.ProjectFlatJoinFunction<T1,T2,R extends Tuple>, JoinOperator.ProjectJoin<I1,I2,OUT extends Tuple>

Field Summary

Fields inherited from class org.apache.flink.api.java.operators.JoinOperator

joinType, keys1, keys2

Fields inherited from class org.apache.flink.api.java.operators.Operator

name, parallelism

Fields inherited from class org.apache.flink.api.java.DataSet

context

Constructor Summary

Constructors

Constructor and Description
JoinOperator.EquiJoin(DataSet<I1> input1, DataSet<I2> input2, Keys<I1> keys1, Keys<I2> keys2, FlatJoinFunction<I1,I2,OUT> generatedFunction, JoinFunction<I1,I2,OUT> function, TypeInformation<OUT> returnType, JoinOperatorBase.JoinHint hint, String joinLocationName)
JoinOperator.EquiJoin(DataSet<I1> input1, DataSet<I2> input2, Keys<I1> keys1, Keys<I2> keys2, FlatJoinFunction<I1,I2,OUT> generatedFunction, JoinFunction<I1,I2,OUT> function, TypeInformation<OUT> returnType, JoinOperatorBase.JoinHint hint, String joinLocationName, JoinType type)
JoinOperator.EquiJoin(DataSet<I1> input1, DataSet<I2> input2, Keys<I1> keys1, Keys<I2> keys2, FlatJoinFunction<I1,I2,OUT> function, TypeInformation<OUT> returnType, JoinOperatorBase.JoinHint hint, String joinLocationName)
JoinOperator.EquiJoin(DataSet<I1> input1, DataSet<I2> input2, Keys<I1> keys1, Keys<I2> keys2, FlatJoinFunction<I1,I2,OUT> function, TypeInformation<OUT> returnType, JoinOperatorBase.JoinHint hint, String joinLocationName, JoinType type)

Method Summary

Methods

Modifier and Type	Method and Description
protected DualInputSemanticProperties	extractSemanticAnnotationsFromUdf(Class<?> udfClass)
protected FlatJoinFunction<I1,I2,OUT>	getFunction()
DualInputSemanticProperties	getSemanticProperties() Gets the semantic properties that have been set for the user-defined functions (UDF).
protected JoinOperatorBase<?,?,OUT,?>	translateToDataFlow(Operator<I1> input1, Operator<I2> input2) Translates this java API operator into a common API operator with two inputs.
protected boolean	udfWithForwardedFieldsFirstAnnotation(Class<?> udfClass)
protected boolean	udfWithForwardedFieldsSecondAnnotation(Class<?> udfClass)

Methods inherited from class org.apache.flink.api.java.operators.JoinOperator

getJoinHint, getJoinType, getKeys1, getKeys2, getPartitioner, withPartitioner

Methods inherited from class org.apache.flink.api.java.operators.TwoInputUdfOperator

getAnalyzedUdfSemanticsFlag, getBroadcastSets, getParameters, returns, returns, returns, returns, setAnalyzedUdfSemanticsFlag, setSemanticProperties, withBroadcastSet, withForwardedFieldsFirst, withForwardedFieldsSecond, withParameters

Methods inherited from class org.apache.flink.api.java.operators.TwoInputOperator

getInput1, getInput1Type, getInput2, getInput2Type

Methods inherited from class org.apache.flink.api.java.operators.Operator

getName, getParallelism, getResultType, name, setParallelism

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, rightOuterJoin, rightOuterJoin, runOperation, sortPartition, sortPartition, sortPartition, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JoinOperator.EquiJoin

public JoinOperator.EquiJoin(DataSet<I1> input1,
                     DataSet<I2> input2,
                     Keys<I1> keys1,
                     Keys<I2> keys2,
                     FlatJoinFunction<I1,I2,OUT> function,
                     TypeInformation<OUT> returnType,
                     JoinOperatorBase.JoinHint hint,
                     String joinLocationName)

JoinOperator.EquiJoin

public JoinOperator.EquiJoin(DataSet<I1> input1,
                     DataSet<I2> input2,
                     Keys<I1> keys1,
                     Keys<I2> keys2,
                     FlatJoinFunction<I1,I2,OUT> generatedFunction,
                     JoinFunction<I1,I2,OUT> function,
                     TypeInformation<OUT> returnType,
                     JoinOperatorBase.JoinHint hint,
                     String joinLocationName)

JoinOperator.EquiJoin

public JoinOperator.EquiJoin(DataSet<I1> input1,
                     DataSet<I2> input2,
                     Keys<I1> keys1,
                     Keys<I2> keys2,
                     FlatJoinFunction<I1,I2,OUT> function,
                     TypeInformation<OUT> returnType,
                     JoinOperatorBase.JoinHint hint,
                     String joinLocationName,
                     JoinType type)

JoinOperator.EquiJoin

public JoinOperator.EquiJoin(DataSet<I1> input1,
                     DataSet<I2> input2,
                     Keys<I1> keys1,
                     Keys<I2> keys2,
                     FlatJoinFunction<I1,I2,OUT> generatedFunction,
                     JoinFunction<I1,I2,OUT> function,
                     TypeInformation<OUT> returnType,
                     JoinOperatorBase.JoinHint hint,
                     String joinLocationName,
                     JoinType type)

Method Detail

getFunction

protected FlatJoinFunction<I1,I2,OUT> getFunction()

Specified by:

getFunction in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

getSemanticProperties

@Internal
public DualInputSemanticProperties getSemanticProperties()

Description copied from interface: UdfOperator

Gets the semantic properties that have been set for the user-defined functions (UDF).

Specified by:

getSemanticProperties in interface UdfOperator<JoinOperator<I1,I2,OUT>>

Overrides:

getSemanticProperties in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

Returns:

The semantic properties of the UDF.

extractSemanticAnnotationsFromUdf

protected DualInputSemanticProperties extractSemanticAnnotationsFromUdf(Class<?> udfClass)

Overrides:

extractSemanticAnnotationsFromUdf in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

udfWithForwardedFieldsFirstAnnotation

protected boolean udfWithForwardedFieldsFirstAnnotation(Class<?> udfClass)

Overrides:

udfWithForwardedFieldsFirstAnnotation in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

udfWithForwardedFieldsSecondAnnotation

protected boolean udfWithForwardedFieldsSecondAnnotation(Class<?> udfClass)

Overrides:

udfWithForwardedFieldsSecondAnnotation in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

translateToDataFlow

protected JoinOperatorBase<?,?,OUT,?> translateToDataFlow(Operator<I1> input1,
                                              Operator<I2> input2)

Description copied from class: TwoInputOperator

Translates this java API operator into a common API operator with two inputs.

Specified by:

translateToDataFlow in class TwoInputOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

Parameters:

input1 - The first input of the operation, as a common API operator.

input2 - The second input of the operation, as a common API operator.

Returns:

The created common API operator.