org.apache.flink.compiler.dag

Class WorksetIterationNode

java.lang.Object

org.apache.flink.compiler.dag.OptimizerNode

org.apache.flink.compiler.dag.TwoInputNode

org.apache.flink.compiler.dag.WorksetIterationNode

All Implemented Interfaces:

EstimateProvider, IterationNode, DumpableNode<OptimizerNode>, Visitable<OptimizerNode>

public class WorksetIterationNode
extends TwoInputNode
implements IterationNode

A node in the optimizer's program representation for a workset iteration.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WorksetIterationNode.SingleRootJoiner

Nested classes/interfaces inherited from class org.apache.flink.compiler.dag.OptimizerNode

OptimizerNode.UnclosedBranchDescriptor

Field Summary

Fields inherited from class org.apache.flink.compiler.dag.TwoInputNode

input1, input2, keys1, keys2

Fields inherited from class org.apache.flink.compiler.dag.OptimizerNode

cachedPlans, closedBranchingNodes, estimatedNumRecords, estimatedOutputSize, hereJoinedBranches, id, MAX_DYNAMIC_PATH_COST_WEIGHT, onDynamicPath, openBranches, remappedKeys, uniqueFields

Constructor Summary

Constructors

Constructor and Description
WorksetIterationNode(DeltaIterationBase<?,?> iteration) Creates a new node with a single input for the optimizer plan.

Method Summary

Modifier and Type	Method and Description
void	acceptForStepFunction(Visitor<OptimizerNode> visitor)
void	computeInterestingPropertiesForInputs(CostEstimator estimator) Tells the node to compute the interesting properties for its inputs.
protected void	computeOperatorSpecificDefaultEstimates(DataStatistics statistics)
void	computeUnclosedBranchStack() This method causes the node to compute the description of open branches in its sub-plan.
int	getCostWeight()
OptimizerNode	getInitialSolutionSetPredecessorNode()
OptimizerNode	getInitialWorksetPredecessorNode()
DeltaIterationBase<?,?>	getIterationContract()
String	getName() Gets the name of this node.
OptimizerNode	getNextWorkset()
protected List<OperatorDescriptorDual>	getPossibleProperties()
TwoInputNode	getSingleRootOfStepFunction()
OptimizerNode	getSolutionSetDelta()
FieldList	getSolutionSetKeyFields()
SolutionSetNode	getSolutionSetNode()
WorksetNode	getWorksetNode()
protected void	instantiate(OperatorDescriptorDual operator, Channel solutionSetIn, Channel worksetIn, List<Set<? extends NamedChannel>> broadcastPlanChannels, List<PlanNode> target, CostEstimator estimator, RequestedGlobalProperties globPropsReqSolutionSet, RequestedGlobalProperties globPropsReqWorkset, RequestedLocalProperties locPropsReqSolutionSet, RequestedLocalProperties locPropsReqWorkset)
boolean	isFieldConstant(int input, int fieldNumber) Checks whether a field is modified by the user code or whether it is kept unchanged.
protected void	readStubAnnotations() Reads all stub annotations, i.e.
void	setNextPartialSolution(OptimizerNode solutionSetDelta, OptimizerNode nextWorkset)
void	setPartialSolution(SolutionSetNode solutionSetNode, WorksetNode worksetNode)

Methods inherited from class org.apache.flink.compiler.dag.TwoInputNode

accept, addLocalCandidates, getAlternativePlans, getFirstIncomingConnection, getFirstPredecessorNode, getIncomingConnections, getInputKeySet, getPactContract, getSecondIncomingConnection, getSecondPredecessorNode, haveValidOutputEstimates, placePipelineBreakersIfNecessary, setInput

Methods inherited from class org.apache.flink.compiler.dag.OptimizerNode

addBroadcastConnection, addClosedBranch, addClosedBranches, addOutgoingConnection, areBranchCompatible, clearInterestingProperties, computeOutputEstimates, computeUnclosedBranchStackForBroadcastInputs, computeUnionOfInterestingPropertiesFromSuccessors, createUniqueFieldsForNode, getBranchesForParent, getBroadcastConnectionNames, getBroadcastConnections, getClosedBranchingNodes, getConstantKeySet, getDegreeOfParallelism, getDumpableInputs, getEstimatedAvgWidthPerOutputRecord, getEstimatedNumRecords, getEstimatedOutputSize, getId, getInterestingProperties, getMaxDepth, getMinimalMemoryAcrossAllSubTasks, getOpenBranches, getOptimizerNode, getOutgoingConnections, getPlanNode, getPredecessors, getRemappedKeys, getUniqueFields, hasUnclosedBranches, haveAllOutputConnectionInterestingProperties, identifyDynamicPath, initId, isBranching, isOnDynamicPath, mergeLists, prunePlanAlternatives, prunePlanAlternativesWithCommonBranching, readUniqueFieldsAnnotation, removeClosedBranches, setBroadcastInputs, setDegreeOfParallelism, setEstimatedNumRecords, setEstimatedOutputSize, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

WorksetIterationNode

public WorksetIterationNode(DeltaIterationBase<?,?> iteration)

Creates a new node with a single input for the optimizer plan.

Parameters:

iteration - The iteration operator that the node represents.

Method Detail

getIterationContract

public DeltaIterationBase<?,?> getIterationContract()

getSolutionSetNode

public SolutionSetNode getSolutionSetNode()

getWorksetNode

public WorksetNode getWorksetNode()

getNextWorkset

public OptimizerNode getNextWorkset()

getSolutionSetDelta

public OptimizerNode getSolutionSetDelta()

setPartialSolution

public void setPartialSolution(SolutionSetNode solutionSetNode,
                               WorksetNode worksetNode)

setNextPartialSolution

public void setNextPartialSolution(OptimizerNode solutionSetDelta,
                                   OptimizerNode nextWorkset)

getCostWeight

public int getCostWeight()

Overrides:

getCostWeight in class OptimizerNode

getSingleRootOfStepFunction

public TwoInputNode getSingleRootOfStepFunction()

getSolutionSetKeyFields

public FieldList getSolutionSetKeyFields()

getInitialSolutionSetPredecessorNode

public OptimizerNode getInitialSolutionSetPredecessorNode()

getInitialWorksetPredecessorNode

public OptimizerNode getInitialWorksetPredecessorNode()

getName

public String getName()

Description copied from class: OptimizerNode

Gets the name of this node. This returns either the name of the PACT, or a string marking the node as a data source or a data sink.

Specified by:

getName in class OptimizerNode

Returns:

The node name.

isFieldConstant

public boolean isFieldConstant(int input,
                               int fieldNumber)

Description copied from class: OptimizerNode

Checks whether a field is modified by the user code or whether it is kept unchanged.

Overrides:

isFieldConstant in class TwoInputNode

Parameters:

input - The input number.

fieldNumber - The position of the field.

Returns:

True if the field is not changed by the user function, false otherwise.

readStubAnnotations

protected void readStubAnnotations()

Description copied from class: OptimizerNode

Reads all stub annotations, i.e. which fields remain constant, what cardinality bounds the functions have, which fields remain unique.

Overrides:

readStubAnnotations in class OptimizerNode

computeOperatorSpecificDefaultEstimates

protected void computeOperatorSpecificDefaultEstimates(DataStatistics statistics)

Specified by:

computeOperatorSpecificDefaultEstimates in class OptimizerNode

getPossibleProperties

protected List<OperatorDescriptorDual> getPossibleProperties()

Specified by:

getPossibleProperties in class TwoInputNode

computeInterestingPropertiesForInputs

public void computeInterestingPropertiesForInputs(CostEstimator estimator)

Description copied from class: OptimizerNode

Tells the node to compute the interesting properties for its inputs. The interesting properties for the node itself must have been computed before. The node must then see how many of interesting properties it preserves and add its own.

Overrides:

computeInterestingPropertiesForInputs in class TwoInputNode

Parameters:

estimator - The CostEstimator instance to use for plan cost estimation.

instantiate

protected void instantiate(OperatorDescriptorDual operator,
                           Channel solutionSetIn,
                           Channel worksetIn,
                           List<Set<? extends NamedChannel>> broadcastPlanChannels,
                           List<PlanNode> target,
                           CostEstimator estimator,
                           RequestedGlobalProperties globPropsReqSolutionSet,
                           RequestedGlobalProperties globPropsReqWorkset,
                           RequestedLocalProperties locPropsReqSolutionSet,
                           RequestedLocalProperties locPropsReqWorkset)

Overrides:

instantiate in class TwoInputNode

computeUnclosedBranchStack

public void computeUnclosedBranchStack()

Description copied from class: OptimizerNode

This method causes the node to compute the description of open branches in its sub-plan. An open branch describes, that a (transitive) child node had multiple outputs, which have not all been re-joined in the sub-plan. This method needs to set the openBranches field to a stack of unclosed branches, the latest one top. A branch is considered closed, if some later node sees all of the branching node's outputs, no matter if there have been more branches to different paths in the meantime.

Overrides:

computeUnclosedBranchStack in class TwoInputNode

acceptForStepFunction

public void acceptForStepFunction(Visitor<OptimizerNode> visitor)

Specified by:

acceptForStepFunction in interface IterationNode