org.apache.flink.table.planner.plan.nodes.exec.common

类 CommonExecLookupJoin

java.lang.Object

org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase<org.apache.flink.table.data.RowData>

org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecLookupJoin

所有已实现的接口:

ExecNode<org.apache.flink.table.data.RowData>, ExecNodeTranslator<org.apache.flink.table.data.RowData>, SingleTransformationTranslator<org.apache.flink.table.data.RowData>

直接已知子类:

BatchExecLookupJoin, StreamExecLookupJoin

public abstract class CommonExecLookupJoin
extends ExecNodeBase<org.apache.flink.table.data.RowData>
implements SingleTransformationTranslator<org.apache.flink.table.data.RowData>

Base ExecNode for temporal table join which shares most methods.

For a lookup join query:

 SELECT T.id, T.content, D.age
 FROM T JOIN userTable FOR SYSTEM_TIME AS OF T.proctime AS D
 ON T.content = concat(D.name, '!') AND D.age = 11 AND T.id = D.id
 WHERE D.name LIKE 'Jack%'
 

The LookupJoin physical node encapsulates the following RelNode tree:

      Join (l.name = r.name)
    /     \
 RelNode  Calc (concat(name, "!") as name, name LIKE 'Jack%')
           |
        DimTable (lookup-keys: age=11, id=l.id)
     (age, id, name)
 

• lookupKeys: [$0=11, $1=l.id] ($0 and $1 is the indexes of age and id in dim table)
• calcOnTemporalTable: calc on temporal table rows before join
• joinCondition: join condition on temporal table rows after calc

The workflow of lookup join:

1) lookup records dimension table using the lookup-keys
2) project & filter on the lookup-ed records
3) join left input record and lookup-ed records
4) only outputs the rows which match to the condition

字段概要

字段

限定符和类型	字段和说明
static String	FIELD_NAME_FILTER_ON_TEMPORAL_TABLE
static String	FIELD_NAME_JOIN_CONDITION
static String	FIELD_NAME_JOIN_TYPE
static String	FIELD_NAME_LOOKUP_KEYS
static String	FIELD_NAME_PROJECTION_ON_TEMPORAL_TABLE
static String	FIELD_NAME_TEMPORAL_TABLE
static String	LOOKUP_JOIN_TRANSFORMATION

从接口继承的字段 org.apache.flink.table.planner.plan.nodes.exec.ExecNode

FIELD_NAME_CONFIGURATION, FIELD_NAME_DESCRIPTION, FIELD_NAME_ID, FIELD_NAME_INPUT_PROPERTIES, FIELD_NAME_OUTPUT_TYPE, FIELD_NAME_TYPE

构造器概要

构造器

限定符

构造器和说明

protected

CommonExecLookupJoin(int id, ExecNodeContext context, org.apache.flink.configuration.ReadableConfig persistedConfig, org.apache.flink.table.runtime.operators.join.FlinkJoinType joinType, org.apache.calcite.rex.RexNode joinCondition, TemporalTableSourceSpec temporalTableSourceSpec, Map<Integer,LookupJoinUtil.LookupKey> lookupKeys, List<org.apache.calcite.rex.RexNode> projectionOnTemporalTable, org.apache.calcite.rex.RexNode filterOnTemporalTable, List<InputProperty> inputProperties, org.apache.flink.table.types.logical.RowType outputType, String description)

方法概要

限定符和类型	方法和说明
TemporalTableSourceSpec	getTemporalTableSourceSpec()
org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData>	translateToPlanInternal(org.apache.flink.table.planner.delegation.PlannerBase planner, ExecNodeConfig config) Internal method, translates this node into a Flink operator.
protected void	validateLookupKeyType(Map<Integer,LookupJoinUtil.LookupKey> lookupKeys, org.apache.flink.table.types.logical.RowType inputRowType, org.apache.flink.table.types.logical.RowType tableSourceRowType)

从类继承的方法 org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase

accept, createFormattedTransformationDescription, createFormattedTransformationName, createTransformationDescription, createTransformationMeta, createTransformationMeta, createTransformationName, createTransformationUid, getContextFromAnnotation, getDescription, getId, getInputEdges, getInputProperties, getOutputType, getPersistedConfig, getSimplifiedName, inputsContainSingleton, replaceInputEdge, setInputEdges, translateToPlan

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.table.planner.plan.nodes.exec.ExecNodeTranslator

translateToPlan

字段详细资料

LOOKUP_JOIN_TRANSFORMATION

public static final String LOOKUP_JOIN_TRANSFORMATION

另请参阅:

常量字段值

FIELD_NAME_JOIN_TYPE

public static final String FIELD_NAME_JOIN_TYPE

另请参阅:

常量字段值

FIELD_NAME_JOIN_CONDITION

public static final String FIELD_NAME_JOIN_CONDITION

另请参阅:

常量字段值

FIELD_NAME_TEMPORAL_TABLE

public static final String FIELD_NAME_TEMPORAL_TABLE

另请参阅:

常量字段值

FIELD_NAME_LOOKUP_KEYS

public static final String FIELD_NAME_LOOKUP_KEYS

另请参阅:

常量字段值

FIELD_NAME_PROJECTION_ON_TEMPORAL_TABLE

public static final String FIELD_NAME_PROJECTION_ON_TEMPORAL_TABLE

另请参阅:

常量字段值

FIELD_NAME_FILTER_ON_TEMPORAL_TABLE

public static final String FIELD_NAME_FILTER_ON_TEMPORAL_TABLE

另请参阅:

常量字段值

构造器详细资料

CommonExecLookupJoin

protected CommonExecLookupJoin(int id,
                               ExecNodeContext context,
                               org.apache.flink.configuration.ReadableConfig persistedConfig,
                               org.apache.flink.table.runtime.operators.join.FlinkJoinType joinType,
                               @Nullable
                               org.apache.calcite.rex.RexNode joinCondition,
                               TemporalTableSourceSpec temporalTableSourceSpec,
                               Map<Integer,LookupJoinUtil.LookupKey> lookupKeys,
                               @Nullable
                               List<org.apache.calcite.rex.RexNode> projectionOnTemporalTable,
                               @Nullable
                               org.apache.calcite.rex.RexNode filterOnTemporalTable,
                               List<InputProperty> inputProperties,
                               org.apache.flink.table.types.logical.RowType outputType,
                               String description)

方法详细资料

getTemporalTableSourceSpec

public TemporalTableSourceSpec getTemporalTableSourceSpec()

translateToPlanInternal

public org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData> translateToPlanInternal(org.apache.flink.table.planner.delegation.PlannerBase planner,
                                                                                                            ExecNodeConfig config)

从类复制的说明: ExecNodeBase

Internal method, translates this node into a Flink operator.

指定者:

translateToPlanInternal 在类中 ExecNodeBase<org.apache.flink.table.data.RowData>

参数:

planner - The planner.

config - per-ExecNode configuration that contains the merged configuration from various layers which all the nodes implementing this method should use, instead of retrieving configuration from the planner. For more details check ExecNodeConfig.

validateLookupKeyType

protected void validateLookupKeyType(Map<Integer,LookupJoinUtil.LookupKey> lookupKeys,
                                     org.apache.flink.table.types.logical.RowType inputRowType,
                                     org.apache.flink.table.types.logical.RowType tableSourceRowType)