org.apache.flink.table.planner.plan.rules.physical.stream

类 TwoStageOptimizedWindowAggregateRule

java.lang.Object

org.apache.calcite.plan.RelOptRule

org.apache.flink.table.planner.plan.rules.physical.stream.TwoStageOptimizedWindowAggregateRule

public class TwoStageOptimizedWindowAggregateRule
extends org.apache.calcite.plan.RelOptRule

Rule that matches StreamPhysicalWindowAggregate on StreamPhysicalExchange with following condition:

• the applied windowing is not on processing-time, because processing-time should be materialized in a single node.
• two-phase aggregation is enabled in given TableConfig.
• all aggregate functions support merge() method.
• the input of exchange does not satisfy the shuffle distribution

This optimization is as known as local-global optimization for reducing data-shuffling. It splits window aggregation into two-stage window aggregation, i.e. local-aggregation and global-aggregation. The local-aggregation produces a partial result for each group and window slice before shuffle in stage 1, and then the partially aggregated results are shuffled by group key to global-aggregation which produces the final result in stage 2.

嵌套类概要

从类继承的嵌套类/接口 org.apache.calcite.plan.RelOptRule

org.apache.calcite.plan.RelOptRule.ConverterRelOptRuleOperand

字段概要

字段

限定符和类型	字段和说明
static TwoStageOptimizedWindowAggregateRule	INSTANCE

从类继承的字段 org.apache.calcite.plan.RelOptRule

description, operands, relBuilderFactory

方法概要

限定符和类型	方法和说明
boolean	matches(org.apache.calcite.plan.RelOptRuleCall call)
void	onMatch(org.apache.calcite.plan.RelOptRuleCall call)

从类继承的方法 org.apache.calcite.plan.RelOptRule

any, convert, convert, convertList, convertOperand, convertOperand, equals, equals, getOperand, getOperands, getOutConvention, getOutTrait, hashCode, none, operand, operand, operand, operand, operand, operandJ, operandJ, some, toString, unordered

从类继承的方法 java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

字段详细资料

INSTANCE

public static final TwoStageOptimizedWindowAggregateRule INSTANCE

方法详细资料

matches

public boolean matches(org.apache.calcite.plan.RelOptRuleCall call)

覆盖:

matches 在类中 org.apache.calcite.plan.RelOptRule

onMatch

public void onMatch(org.apache.calcite.plan.RelOptRuleCall call)

指定者:

onMatch 在类中 org.apache.calcite.plan.RelOptRule