org.apache.flink.cdc.runtime.operators.schema.common

类 SchemaDerivator

java.lang.Object

org.apache.flink.cdc.runtime.operators.schema.common.SchemaDerivator

public class SchemaDerivator
extends Object

A utility class to derive how evolved schemas should change.

构造器概要

构造器

构造器和说明
SchemaDerivator()

方法概要

限定符和类型	方法和说明
Optional<org.apache.flink.cdc.common.event.DataChangeEvent>	coerceDataRecord(String timezone, org.apache.flink.cdc.common.event.DataChangeEvent dataChangeEvent, org.apache.flink.cdc.common.schema.Schema upstreamSchema, org.apache.flink.cdc.common.schema.Schema evolvedSchema) Coerce a DataChangeEvent from upstream to expected downstream schema.
static Set<org.apache.flink.cdc.common.event.TableId>	getAffectedEvolvedTables(TableIdRouter tableIdRouter, Set<org.apache.flink.cdc.common.event.TableId> changedUpstreamTables) Get affected evolved table IDs based on changed upstream tables.
static List<org.apache.flink.cdc.common.event.SchemaChangeEvent>	normalizeSchemaChangeEvents(org.apache.flink.cdc.common.schema.Schema oldSchema, List<org.apache.flink.cdc.common.event.SchemaChangeEvent> schemaChangeEvents, org.apache.flink.cdc.common.pipeline.SchemaChangeBehavior schemaChangeBehavior, org.apache.flink.cdc.common.sink.MetadataApplier metadataApplier) Rewrite SchemaChangeEvents by current SchemaChangeBehavior and include / exclude them by fine-grained schema change event configurations.
static Set<org.apache.flink.cdc.common.schema.Schema>	reverseLookupDependingUpstreamSchemas(TableIdRouter tableIdRouter, org.apache.flink.cdc.common.event.TableId evolvedTableId, SchemaManager schemaManager) For an evolved table ID, reverse lookup all upstream schemas that needs to be fit in.
static Set<org.apache.flink.cdc.common.schema.Schema>	reverseLookupDependingUpstreamSchemas(TableIdRouter tableIdRouter, org.apache.flink.cdc.common.event.TableId evolvedTableId, org.apache.flink.shaded.guava31.com.google.common.collect.Table<org.apache.flink.cdc.common.event.TableId,Integer,org.apache.flink.cdc.common.schema.Schema> upstreamSchemaTable) For an evolved table ID, reverse lookup all upstream schemas that needs to be fit in.
static Set<org.apache.flink.cdc.common.event.TableId>	reverseLookupDependingUpstreamTables(TableIdRouter tableIdRouter, org.apache.flink.cdc.common.event.TableId evolvedTableId, Set<org.apache.flink.cdc.common.event.TableId> upstreamSchemaTables) For an evolved table ID, reverse lookup all upstream tables that it depends on.
static Set<org.apache.flink.cdc.common.event.TableId>	reverseLookupDependingUpstreamTables(TableIdRouter tableIdRouter, org.apache.flink.cdc.common.event.TableId evolvedTableId, org.apache.flink.shaded.guava31.com.google.common.collect.Table<org.apache.flink.cdc.common.event.TableId,Integer,org.apache.flink.cdc.common.schema.Schema> upstreamSchemaTable) For an evolved table ID, reverse lookup all upstream tables that it depends on.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SchemaDerivator

public SchemaDerivator()

方法详细资料

getAffectedEvolvedTables

public static Set<org.apache.flink.cdc.common.event.TableId> getAffectedEvolvedTables(TableIdRouter tableIdRouter,
                                                                                      Set<org.apache.flink.cdc.common.event.TableId> changedUpstreamTables)

Get affected evolved table IDs based on changed upstream tables.

reverseLookupDependingUpstreamTables

public static Set<org.apache.flink.cdc.common.event.TableId> reverseLookupDependingUpstreamTables(TableIdRouter tableIdRouter,
                                                                                                  org.apache.flink.cdc.common.event.TableId evolvedTableId,
                                                                                                  Set<org.apache.flink.cdc.common.event.TableId> upstreamSchemaTables)

For an evolved table ID, reverse lookup all upstream tables that it depends on.

reverseLookupDependingUpstreamTables

public static Set<org.apache.flink.cdc.common.event.TableId> reverseLookupDependingUpstreamTables(TableIdRouter tableIdRouter,
                                                                                                  org.apache.flink.cdc.common.event.TableId evolvedTableId,
                                                                                                  org.apache.flink.shaded.guava31.com.google.common.collect.Table<org.apache.flink.cdc.common.event.TableId,Integer,org.apache.flink.cdc.common.schema.Schema> upstreamSchemaTable)

For an evolved table ID, reverse lookup all upstream tables that it depends on.

reverseLookupDependingUpstreamSchemas

public static Set<org.apache.flink.cdc.common.schema.Schema> reverseLookupDependingUpstreamSchemas(TableIdRouter tableIdRouter,
                                                                                                   org.apache.flink.cdc.common.event.TableId evolvedTableId,
                                                                                                   SchemaManager schemaManager)

For an evolved table ID, reverse lookup all upstream schemas that needs to be fit in.

reverseLookupDependingUpstreamSchemas

public static Set<org.apache.flink.cdc.common.schema.Schema> reverseLookupDependingUpstreamSchemas(TableIdRouter tableIdRouter,
                                                                                                   org.apache.flink.cdc.common.event.TableId evolvedTableId,
                                                                                                   org.apache.flink.shaded.guava31.com.google.common.collect.Table<org.apache.flink.cdc.common.event.TableId,Integer,org.apache.flink.cdc.common.schema.Schema> upstreamSchemaTable)

For an evolved table ID, reverse lookup all upstream schemas that needs to be fit in.

normalizeSchemaChangeEvents

public static List<org.apache.flink.cdc.common.event.SchemaChangeEvent> normalizeSchemaChangeEvents(org.apache.flink.cdc.common.schema.Schema oldSchema,
                                                                                                    List<org.apache.flink.cdc.common.event.SchemaChangeEvent> schemaChangeEvents,
                                                                                                    org.apache.flink.cdc.common.pipeline.SchemaChangeBehavior schemaChangeBehavior,
                                                                                                    org.apache.flink.cdc.common.sink.MetadataApplier metadataApplier)

Rewrite SchemaChangeEvents by current SchemaChangeBehavior and include / exclude them by fine-grained schema change event configurations.

coerceDataRecord

public Optional<org.apache.flink.cdc.common.event.DataChangeEvent> coerceDataRecord(String timezone,
                                                                                    org.apache.flink.cdc.common.event.DataChangeEvent dataChangeEvent,
                                                                                    org.apache.flink.cdc.common.schema.Schema upstreamSchema,
                                                                                    @Nullable
                                                                                    org.apache.flink.cdc.common.schema.Schema evolvedSchema)

Coerce a DataChangeEvent from upstream to expected downstream schema.