org.apache.flink.table.planner.plan.nodes.exec.stream

类 StreamExecDeduplicate

java.lang.Object

org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase<org.apache.flink.table.data.RowData>

org.apache.flink.table.planner.plan.nodes.exec.stream.StreamExecDeduplicate

所有已实现的接口:

ExecNode<org.apache.flink.table.data.RowData>, ExecNodeTranslator<org.apache.flink.table.data.RowData>, SingleTransformationTranslator<org.apache.flink.table.data.RowData>, StreamExecNode<org.apache.flink.table.data.RowData>

@ExecNodeMetadata(name="stream-exec-deduplicate",
                  version=1,
                  consumedOptions={"table.exec.mini-batch.enabled","table.exec.mini-batch.size","table.exec.deduplicate.insert-update-after-sensitive-enabled","table.exec.deduplicate.mini-batch.compact-changes-enabled"},
                  producedTransformations="deduplicate",
                  minPlanVersion=v1_15,
                  minStateVersion=v1_15)
public class StreamExecDeduplicate
extends ExecNodeBase<org.apache.flink.table.data.RowData>
implements StreamExecNode<org.apache.flink.table.data.RowData>, SingleTransformationTranslator<org.apache.flink.table.data.RowData>

Stream ExecNode which deduplicate on keys and keeps only first row or last row. This node is an optimization of StreamExecRank for some special cases. Compared to StreamExecRank, this node could use mini-batch and access less state.

字段概要

字段

限定符和类型	字段和说明
static String	DEDUPLICATE_TRANSFORMATION
static String	FIELD_NAME_GENERATE_UPDATE_BEFORE
static String	FIELD_NAME_IS_ROWTIME
static String	FIELD_NAME_KEEP_LAST_ROW
static String	FIELD_NAME_UNIQUE_KEYS

从接口继承的字段 org.apache.flink.table.planner.plan.nodes.exec.ExecNode

FIELD_NAME_CONFIGURATION, FIELD_NAME_DESCRIPTION, FIELD_NAME_ID, FIELD_NAME_INPUT_PROPERTIES, FIELD_NAME_OUTPUT_TYPE, FIELD_NAME_TYPE

构造器概要

构造器

构造器和说明
StreamExecDeduplicate(int id, ExecNodeContext context, org.apache.flink.configuration.ReadableConfig persistedConfig, int[] uniqueKeys, boolean isRowtime, boolean keepLastRow, boolean generateUpdateBefore, List<InputProperty> inputProperties, org.apache.flink.table.types.logical.RowType outputType, String description)
StreamExecDeduplicate(org.apache.flink.configuration.ReadableConfig tableConfig, int[] uniqueKeys, boolean isRowtime, boolean keepLastRow, boolean generateUpdateBefore, InputProperty inputProperty, org.apache.flink.table.types.logical.RowType outputType, String description)

方法概要

限定符和类型	方法和说明
protected org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData>	translateToPlanInternal(org.apache.flink.table.planner.delegation.PlannerBase planner, ExecNodeConfig config) Internal method, translates this node into a Flink operator.

从类继承的方法 org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase

accept, createFormattedTransformationDescription, createFormattedTransformationName, createTransformationDescription, createTransformationMeta, createTransformationMeta, createTransformationName, createTransformationUid, getContextFromAnnotation, getDescription, getId, getInputEdges, getInputProperties, getOutputType, getPersistedConfig, getSimplifiedName, inputsContainSingleton, replaceInputEdge, setInputEdges, translateToPlan

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.table.planner.plan.nodes.exec.ExecNode

accept, getDescription, getId, getInputEdges, getInputProperties, getOutputType, replaceInputEdge, setInputEdges

从接口继承的方法 org.apache.flink.table.planner.plan.nodes.exec.ExecNodeTranslator

translateToPlan

字段详细资料

DEDUPLICATE_TRANSFORMATION

public static final String DEDUPLICATE_TRANSFORMATION

另请参阅:

常量字段值

FIELD_NAME_UNIQUE_KEYS

public static final String FIELD_NAME_UNIQUE_KEYS

另请参阅:

常量字段值

FIELD_NAME_IS_ROWTIME

public static final String FIELD_NAME_IS_ROWTIME

另请参阅:

常量字段值

FIELD_NAME_KEEP_LAST_ROW

public static final String FIELD_NAME_KEEP_LAST_ROW

另请参阅:

常量字段值

FIELD_NAME_GENERATE_UPDATE_BEFORE

public static final String FIELD_NAME_GENERATE_UPDATE_BEFORE

另请参阅:

常量字段值

构造器详细资料

StreamExecDeduplicate

public StreamExecDeduplicate(org.apache.flink.configuration.ReadableConfig tableConfig,
                             int[] uniqueKeys,
                             boolean isRowtime,
                             boolean keepLastRow,
                             boolean generateUpdateBefore,
                             InputProperty inputProperty,
                             org.apache.flink.table.types.logical.RowType outputType,
                             String description)

StreamExecDeduplicate

public StreamExecDeduplicate(int id,
                             ExecNodeContext context,
                             org.apache.flink.configuration.ReadableConfig persistedConfig,
                             int[] uniqueKeys,
                             boolean isRowtime,
                             boolean keepLastRow,
                             boolean generateUpdateBefore,
                             List<InputProperty> inputProperties,
                             org.apache.flink.table.types.logical.RowType outputType,
                             String description)

方法详细资料

translateToPlanInternal

protected org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData> translateToPlanInternal(org.apache.flink.table.planner.delegation.PlannerBase planner,
                                                                                                               ExecNodeConfig config)

从类复制的说明: ExecNodeBase

Internal method, translates this node into a Flink operator.

指定者:

translateToPlanInternal 在类中 ExecNodeBase<org.apache.flink.table.data.RowData>

参数:

planner - The planner.

config - per-ExecNode configuration that contains the merged configuration from various layers which all the nodes implementing this method should use, instead of retrieving configuration from the planner. For more details check ExecNodeConfig.