@ExecNodeMetadata(name="stream-exec-mini-batch-assigner", version=1, producedTransformations="mini-batch-assigner", minPlanVersion=v1_15, minStateVersion=v1_15) public class StreamExecMiniBatchAssigner extends ExecNodeBase<org.apache.flink.table.data.RowData> implements StreamExecNode<org.apache.flink.table.data.RowData>, SingleTransformationTranslator<org.apache.flink.table.data.RowData>
ExecNode which injects a mini-batch event in the streaming data. The mini-batch
event will be recognized as a boundary between two mini-batches. The following operators will
keep track of the mini-batch events and trigger mini-batch once the mini-batch id is advanced.
NOTE: currently, we leverage the runtime watermark mechanism to achieve the mini-batch, because runtime doesn't support customized events and the watermark mechanism fully meets mini-batch needs.
| 限定符和类型 | 字段和说明 |
|---|---|
static String |
FIELD_NAME_MINI_BATCH_INTERVAL |
static String |
MINI_BATCH_ASSIGNER_TRANSFORMATION |
FIELD_NAME_CONFIGURATION, FIELD_NAME_DESCRIPTION, FIELD_NAME_ID, FIELD_NAME_INPUT_PROPERTIES, FIELD_NAME_OUTPUT_TYPE, FIELD_NAME_TYPE| 构造器和说明 |
|---|
StreamExecMiniBatchAssigner(int id,
ExecNodeContext context,
org.apache.flink.configuration.ReadableConfig persistedConfig,
MiniBatchInterval miniBatchInterval,
List<InputProperty> inputProperties,
org.apache.flink.table.types.logical.RowType outputType,
String description) |
StreamExecMiniBatchAssigner(org.apache.flink.configuration.ReadableConfig tableConfig,
MiniBatchInterval miniBatchInterval,
InputProperty inputProperty,
org.apache.flink.table.types.logical.RowType outputType,
String description) |
| 限定符和类型 | 方法和说明 |
|---|---|
protected org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData> |
translateToPlanInternal(org.apache.flink.table.planner.delegation.PlannerBase planner,
ExecNodeConfig config)
Internal method, translates this node into a Flink operator.
|
accept, createFormattedTransformationDescription, createFormattedTransformationName, createTransformationDescription, createTransformationMeta, createTransformationMeta, createTransformationName, createTransformationUid, getContextFromAnnotation, getDescription, getId, getInputEdges, getInputProperties, getOutputType, getPersistedConfig, getSimplifiedName, inputsContainSingleton, replaceInputEdge, setInputEdges, translateToPlanclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitaccept, getDescription, getId, getInputEdges, getInputProperties, getOutputType, replaceInputEdge, setInputEdgestranslateToPlanpublic static final String MINI_BATCH_ASSIGNER_TRANSFORMATION
public StreamExecMiniBatchAssigner(org.apache.flink.configuration.ReadableConfig tableConfig,
MiniBatchInterval miniBatchInterval,
InputProperty inputProperty,
org.apache.flink.table.types.logical.RowType outputType,
String description)
public StreamExecMiniBatchAssigner(int id,
ExecNodeContext context,
org.apache.flink.configuration.ReadableConfig persistedConfig,
MiniBatchInterval miniBatchInterval,
List<InputProperty> inputProperties,
org.apache.flink.table.types.logical.RowType outputType,
String description)
protected org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData> translateToPlanInternal(org.apache.flink.table.planner.delegation.PlannerBase planner,
ExecNodeConfig config)
ExecNodeBasetranslateToPlanInternal 在类中 ExecNodeBase<org.apache.flink.table.data.RowData>planner - The planner.config - per-ExecNode configuration that contains the merged configuration from
various layers which all the nodes implementing this method should use, instead of
retrieving configuration from the planner. For more details check ExecNodeConfig.Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.