org.apache.flink.optimizer.dag

Class BulkIterationNode

java.lang.Object

org.apache.flink.optimizer.dag.OptimizerNode

org.apache.flink.optimizer.dag.SingleInputNode

org.apache.flink.optimizer.dag.BulkIterationNode

All Implemented Interfaces:

EstimateProvider, IterationNode, DumpableNode<OptimizerNode>, org.apache.flink.util.Visitable<OptimizerNode>

public class BulkIterationNode
extends SingleInputNode
implements IterationNode

A node in the optimizer's program representation for a bulk iteration.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.optimizer.dag.OptimizerNode

OptimizerNode.UnclosedBranchDescriptor

Field Summary

Fields inherited from class org.apache.flink.optimizer.dag.SingleInputNode

inConn, keys

Fields inherited from class org.apache.flink.optimizer.dag.OptimizerNode

cachedPlans, closedBranchingNodes, estimatedNumRecords, estimatedOutputSize, hereJoinedBranches, id, MAX_DYNAMIC_PATH_COST_WEIGHT, onDynamicPath, openBranches, uniqueFields

Constructor Summary

Constructors

Constructor and Description
BulkIterationNode(org.apache.flink.api.common.operators.base.BulkIterationBase<?> iteration) Creates a new node for the bulk iteration.

Method Summary

Modifier and Type	Method and Description
void	acceptForStepFunction(org.apache.flink.util.Visitor<OptimizerNode> visitor)
void	clearInterestingProperties()
void	computeInterestingPropertiesForInputs(CostEstimator estimator) Tells the node to compute the interesting properties for its inputs.
protected void	computeOperatorSpecificDefaultEstimates(DataStatistics statistics)
void	computeUnclosedBranchStack() This method causes the node to compute the description of open branches in its sub-plan.
int	getCostWeight()
org.apache.flink.api.common.operators.base.BulkIterationBase<?>	getIterationContract()
OptimizerNode	getNextPartialSolution() Gets the nextPartialSolution from this BulkIterationNode.
String	getOperatorName() Gets the name of this node, which is the name of the function/operator, or data source / data sink.
BulkPartialSolutionNode	getPartialSolution() Gets the partialSolution from this BulkIterationNode.
protected List<OperatorDescriptorSingle>	getPossibleProperties()
org.apache.flink.api.common.operators.SemanticProperties	getSemanticProperties()
OptimizerNode	getSingleRootOfStepFunction()
protected void	instantiateCandidate(OperatorDescriptorSingle dps, Channel in, List<Set<? extends NamedChannel>> broadcastPlanChannels, List<PlanNode> target, CostEstimator estimator, RequestedGlobalProperties globPropsReq, RequestedLocalProperties locPropsReq)
protected void	readStubAnnotations() Reads all stub annotations, i.e.
void	setNextPartialSolution(OptimizerNode nextPartialSolution, OptimizerNode terminationCriterion) Sets the nextPartialSolution for this BulkIterationNode.
void	setPartialSolution(BulkPartialSolutionNode partialSolution) Sets the partialSolution for this BulkIterationNode.

Methods inherited from class org.apache.flink.optimizer.dag.SingleInputNode

accept, addLocalCandidates, getAlternativePlans, getIncomingConnection, getIncomingConnections, getOperator, getPredecessorNode, getSemanticPropertiesForGlobalPropertyFiltering, getSemanticPropertiesForLocalPropertyFiltering, setIncomingConnection, setInput

Methods inherited from class org.apache.flink.optimizer.dag.OptimizerNode

addBroadcastConnection, addClosedBranch, addClosedBranches, addOutgoingConnection, areBranchCompatible, computeOutputEstimates, computeUnclosedBranchStackForBroadcastInputs, computeUnionOfInterestingPropertiesFromSuccessors, getBranchesForParent, getBroadcastConnectionNames, getBroadcastConnections, getClosedBranchingNodes, getDumpableInputs, getEstimatedAvgWidthPerOutputRecord, getEstimatedNumRecords, getEstimatedOutputSize, getId, getInterestingProperties, getMaxDepth, getMinimalMemoryAcrossAllSubTasks, getOpenBranches, getOptimizerNode, getOutgoingConnections, getParallelism, getPlanNode, getPredecessors, getUniqueFields, hasUnclosedBranches, haveAllOutputConnectionInterestingProperties, identifyDynamicPath, initId, isBranching, isOnDynamicPath, markAllOutgoingConnectionsAsPipelineBreaking, mergeLists, prunePlanAlternatives, prunePlanAlternativesWithCommonBranching, readUniqueFieldsAnnotation, removeClosedBranches, setBroadcastInputs, setEstimatedNumRecords, setEstimatedOutputSize, setParallelism, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

BulkIterationNode

public BulkIterationNode(org.apache.flink.api.common.operators.base.BulkIterationBase<?> iteration)

Creates a new node for the bulk iteration.

Parameters:

iteration - The bulk iteration the node represents.

Method Detail

getIterationContract

public org.apache.flink.api.common.operators.base.BulkIterationBase<?> getIterationContract()

getPartialSolution

public BulkPartialSolutionNode getPartialSolution()

Gets the partialSolution from this BulkIterationNode.

Returns:

The partialSolution.

setPartialSolution

public void setPartialSolution(BulkPartialSolutionNode partialSolution)

Sets the partialSolution for this BulkIterationNode.

Parameters:

partialSolution - The partialSolution to set.

getNextPartialSolution

public OptimizerNode getNextPartialSolution()

Gets the nextPartialSolution from this BulkIterationNode.

Returns:

The nextPartialSolution.

setNextPartialSolution

public void setNextPartialSolution(OptimizerNode nextPartialSolution,
                                   OptimizerNode terminationCriterion)

Sets the nextPartialSolution for this BulkIterationNode.

Parameters:

nextPartialSolution - The nextPartialSolution to set.

getCostWeight

public int getCostWeight()

Overrides:

getCostWeight in class OptimizerNode

getSingleRootOfStepFunction

public OptimizerNode getSingleRootOfStepFunction()

getOperatorName

public String getOperatorName()

Description copied from class: OptimizerNode

Gets the name of this node, which is the name of the function/operator, or data source / data sink.

Specified by:

getOperatorName in class OptimizerNode

Returns:

The node name.

getSemanticProperties

public org.apache.flink.api.common.operators.SemanticProperties getSemanticProperties()

Overrides:

getSemanticProperties in class SingleInputNode

readStubAnnotations

protected void readStubAnnotations()

Description copied from class: OptimizerNode

Reads all stub annotations, i.e. which fields remain constant, what cardinality bounds the functions have, which fields remain unique.

Overrides:

readStubAnnotations in class OptimizerNode

computeOperatorSpecificDefaultEstimates

protected void computeOperatorSpecificDefaultEstimates(DataStatistics statistics)

Specified by:

computeOperatorSpecificDefaultEstimates in class OptimizerNode

getPossibleProperties

protected List<OperatorDescriptorSingle> getPossibleProperties()

Specified by:

getPossibleProperties in class SingleInputNode

computeInterestingPropertiesForInputs

public void computeInterestingPropertiesForInputs(CostEstimator estimator)

Description copied from class: OptimizerNode

Tells the node to compute the interesting properties for its inputs. The interesting properties for the node itself must have been computed before. The node must then see how many of interesting properties it preserves and add its own.

Overrides:

computeInterestingPropertiesForInputs in class SingleInputNode

Parameters:

estimator - The CostEstimator instance to use for plan cost estimation.

clearInterestingProperties

public void clearInterestingProperties()

Overrides:

clearInterestingProperties in class OptimizerNode

computeUnclosedBranchStack

public void computeUnclosedBranchStack()

Description copied from class: OptimizerNode

This method causes the node to compute the description of open branches in its sub-plan. An open branch describes, that a (transitive) child node had multiple outputs, which have not all been re-joined in the sub-plan. This method needs to set the openBranches field to a stack of unclosed branches, the latest one top. A branch is considered closed, if some later node sees all of the branching node's outputs, no matter if there have been more branches to different paths in the meantime.

Overrides:

computeUnclosedBranchStack in class SingleInputNode

instantiateCandidate

protected void instantiateCandidate(OperatorDescriptorSingle dps,
                                    Channel in,
                                    List<Set<? extends NamedChannel>> broadcastPlanChannels,
                                    List<PlanNode> target,
                                    CostEstimator estimator,
                                    RequestedGlobalProperties globPropsReq,
                                    RequestedLocalProperties locPropsReq)

Overrides:

instantiateCandidate in class SingleInputNode

acceptForStepFunction

public void acceptForStepFunction(org.apache.flink.util.Visitor<OptimizerNode> visitor)

Specified by:

acceptForStepFunction in interface IterationNode