org.apache.flink.optimizer.dag

类 SingleInputNode

java.lang.Object

org.apache.flink.optimizer.dag.OptimizerNode

org.apache.flink.optimizer.dag.SingleInputNode

所有已实现的接口:

EstimateProvider, DumpableNode<OptimizerNode>, org.apache.flink.util.Visitable<OptimizerNode>

直接已知子类:

BulkIterationNode, FilterNode, FlatMapNode, GroupCombineNode, GroupReduceNode, MapNode, MapPartitionNode, PartitionNode, ReduceNode, SortPartitionNode, UnaryOperatorNode

public abstract class SingleInputNode
extends OptimizerNode

A node in the optimizer's program representation for an operation with a single input.

This class contains all the generic logic for handling branching flows, as well as to enumerate candidate execution plans. The subclasses for specific operators simply add logic for cost estimates and specify possible strategies for their execution.

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.optimizer.dag.OptimizerNode

OptimizerNode.UnclosedBranchDescriptor

字段概要

字段

限定符和类型	字段和说明
protected DagConnection	inConn
protected org.apache.flink.api.common.operators.util.FieldSet	keys

从类继承的字段 org.apache.flink.optimizer.dag.OptimizerNode

cachedPlans, closedBranchingNodes, costWeight, estimatedNumRecords, estimatedOutputSize, hereJoinedBranches, id, MAX_DYNAMIC_PATH_COST_WEIGHT, onDynamicPath, openBranches, uniqueFields

构造器概要

构造器

限定符	构造器和说明
protected	SingleInputNode()
protected	SingleInputNode(org.apache.flink.api.common.operators.util.FieldSet keys)
protected	SingleInputNode(SingleInputNode toCopy)
protected	SingleInputNode(org.apache.flink.api.common.operators.SingleInputOperator<?,?,?> programOperator) Creates a new node with a single input for the optimizer plan.

方法概要

限定符和类型	方法和说明
void	accept(org.apache.flink.util.Visitor<OptimizerNode> visitor) This method implements the visit of a depth-first graph traversing visitor.
protected void	addLocalCandidates(Channel template, List<Set<? extends NamedChannel>> broadcastPlanChannels, RequestedGlobalProperties rgps, List<PlanNode> target, CostEstimator estimator)
void	computeInterestingPropertiesForInputs(CostEstimator estimator) Tells the node to compute the interesting properties for its inputs.
void	computeUnclosedBranchStack() This method causes the node to compute the description of open branches in its sub-plan.
List<PlanNode>	getAlternativePlans(CostEstimator estimator) Computes the plan alternatives for this node, an implicitly for all nodes that are children of this node.
DagConnection	getIncomingConnection() Gets the input of this operator.
List<DagConnection>	getIncomingConnections() Gets all incoming connections of this node.
org.apache.flink.api.common.operators.SingleInputOperator<?,?,?>	getOperator() Gets the operator represented by this optimizer node.
protected abstract List<OperatorDescriptorSingle>	getPossibleProperties()
OptimizerNode	getPredecessorNode() Gets the predecessor of this node.
org.apache.flink.api.common.operators.SemanticProperties	getSemanticProperties()
protected org.apache.flink.api.common.operators.SemanticProperties	getSemanticPropertiesForGlobalPropertyFiltering()
protected org.apache.flink.api.common.operators.SemanticProperties	getSemanticPropertiesForLocalPropertyFiltering()
protected void	instantiateCandidate(OperatorDescriptorSingle dps, Channel in, List<Set<? extends NamedChannel>> broadcastPlanChannels, List<PlanNode> target, CostEstimator estimator, RequestedGlobalProperties globPropsReq, RequestedLocalProperties locPropsReq)
void	setIncomingConnection(DagConnection inConn) Sets the connection through which this node receives its input.
void	setInput(Map<org.apache.flink.api.common.operators.Operator<?>,OptimizerNode> contractToNode, org.apache.flink.api.common.ExecutionMode defaultExchangeMode) This function connects the predecessors to this operator.

从类继承的方法 org.apache.flink.optimizer.dag.OptimizerNode

addBroadcastConnection, addClosedBranch, addClosedBranches, addOutgoingConnection, areBranchCompatible, clearInterestingProperties, computeOperatorSpecificDefaultEstimates, computeOutputEstimates, computeUnclosedBranchStackForBroadcastInputs, computeUnionOfInterestingPropertiesFromSuccessors, getBranchesForParent, getBroadcastConnectionNames, getBroadcastConnections, getClosedBranchingNodes, getCostWeight, getDumpableInputs, getEstimatedAvgWidthPerOutputRecord, getEstimatedNumRecords, getEstimatedOutputSize, getId, getInterestingProperties, getMaxDepth, getMinimalMemoryAcrossAllSubTasks, getOpenBranches, getOperatorName, getOptimizerNode, getOutgoingConnections, getParallelism, getPlanNode, getPredecessors, getUniqueFields, hasUnclosedBranches, haveAllOutputConnectionInterestingProperties, identifyDynamicPath, initId, isBranching, isOnDynamicPath, markAllOutgoingConnectionsAsPipelineBreaking, mergeLists, prunePlanAlternatives, prunePlanAlternativesWithCommonBranching, readStubAnnotations, readUniqueFieldsAnnotation, removeClosedBranches, setBroadcastInputs, setEstimatedNumRecords, setEstimatedOutputSize, setParallelism, toString

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

字段详细资料

keys

protected final org.apache.flink.api.common.operators.util.FieldSet keys

inConn

protected DagConnection inConn

构造器详细资料

SingleInputNode

protected SingleInputNode(org.apache.flink.api.common.operators.SingleInputOperator<?,?,?> programOperator)

Creates a new node with a single input for the optimizer plan.

参数:

programOperator - The PACT that the node represents.

SingleInputNode

protected SingleInputNode(org.apache.flink.api.common.operators.util.FieldSet keys)

SingleInputNode

protected SingleInputNode()

SingleInputNode

protected SingleInputNode(SingleInputNode toCopy)

方法详细资料

getOperator

public org.apache.flink.api.common.operators.SingleInputOperator<?,?,?> getOperator()

从类复制的说明: OptimizerNode

Gets the operator represented by this optimizer node.

覆盖:

getOperator 在类中 OptimizerNode

返回:

This node's operator.

getIncomingConnection

public DagConnection getIncomingConnection()

Gets the input of this operator.

返回:

The input.

setIncomingConnection

public void setIncomingConnection(DagConnection inConn)

Sets the connection through which this node receives its input.

参数:

inConn - The input connection to set.

getPredecessorNode

public OptimizerNode getPredecessorNode()

Gets the predecessor of this node.

返回:

The predecessor of this node.

getIncomingConnections

public List<DagConnection> getIncomingConnections()

从类复制的说明: OptimizerNode

Gets all incoming connections of this node. This method needs to be overridden by subclasses to return the children.

指定者:

getIncomingConnections 在类中 OptimizerNode

返回:

The list of incoming connections.

getSemanticProperties

public org.apache.flink.api.common.operators.SemanticProperties getSemanticProperties()

指定者:

getSemanticProperties 在类中 OptimizerNode

getSemanticPropertiesForLocalPropertyFiltering

protected org.apache.flink.api.common.operators.SemanticProperties getSemanticPropertiesForLocalPropertyFiltering()

getSemanticPropertiesForGlobalPropertyFiltering

protected org.apache.flink.api.common.operators.SemanticProperties getSemanticPropertiesForGlobalPropertyFiltering()

setInput

public void setInput(Map<org.apache.flink.api.common.operators.Operator<?>,OptimizerNode> contractToNode,
                     org.apache.flink.api.common.ExecutionMode defaultExchangeMode)
              throws CompilerException

从类复制的说明: OptimizerNode

This function connects the predecessors to this operator.

指定者:

setInput 在类中 OptimizerNode

参数:

contractToNode - The map from program operators to optimizer nodes.

defaultExchangeMode - The data exchange mode to use, if the operator does not specify one.

抛出:

CompilerException

getPossibleProperties

protected abstract List<OperatorDescriptorSingle> getPossibleProperties()

computeInterestingPropertiesForInputs

public void computeInterestingPropertiesForInputs(CostEstimator estimator)

从类复制的说明: OptimizerNode

Tells the node to compute the interesting properties for its inputs. The interesting properties for the node itself must have been computed before. The node must then see how many of interesting properties it preserves and add its own.

指定者:

computeInterestingPropertiesForInputs 在类中 OptimizerNode

参数:

estimator - The CostEstimator instance to use for plan cost estimation.

getAlternativePlans

public List<PlanNode> getAlternativePlans(CostEstimator estimator)

从类复制的说明: OptimizerNode

Computes the plan alternatives for this node, an implicitly for all nodes that are children of this node. This method must determine for each alternative the global and local properties and the costs. This method may recursively call getAlternatives() on its children to get their plan alternatives, and build its own alternatives on top of those.

指定者:

getAlternativePlans 在类中 OptimizerNode

参数:

estimator - The cost estimator used to estimate the costs of each plan alternative.

返回:

A list containing all plan alternatives.

addLocalCandidates

protected void addLocalCandidates(Channel template,
                                  List<Set<? extends NamedChannel>> broadcastPlanChannels,
                                  RequestedGlobalProperties rgps,
                                  List<PlanNode> target,
                                  CostEstimator estimator)

instantiateCandidate

protected void instantiateCandidate(OperatorDescriptorSingle dps,
                                    Channel in,
                                    List<Set<? extends NamedChannel>> broadcastPlanChannels,
                                    List<PlanNode> target,
                                    CostEstimator estimator,
                                    RequestedGlobalProperties globPropsReq,
                                    RequestedLocalProperties locPropsReq)

computeUnclosedBranchStack

public void computeUnclosedBranchStack()

从类复制的说明: OptimizerNode

This method causes the node to compute the description of open branches in its sub-plan. An open branch describes, that a (transitive) child node had multiple outputs, which have not all been re-joined in the sub-plan. This method needs to set the openBranches field to a stack of unclosed branches, the latest one top. A branch is considered closed, if some later node sees all of the branching node's outputs, no matter if there have been more branches to different paths in the meantime.

指定者:

computeUnclosedBranchStack 在类中 OptimizerNode

accept

public void accept(org.apache.flink.util.Visitor<OptimizerNode> visitor)

从类复制的说明: OptimizerNode

This method implements the visit of a depth-first graph traversing visitor. Implementers must first call the preVisit() method, then hand the visitor to their children, and finally call the postVisit() method.

指定者:

accept 在接口中 org.apache.flink.util.Visitable<OptimizerNode>

指定者:

accept 在类中 OptimizerNode

参数:

visitor - The graph traversing visitor.

另请参阅:

Visitable.accept(org.apache.flink.util.Visitor)