org.apache.flink.cdc.runtime.operators.schema

Class SchemaOperator

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.cdc.common.event.Event>

org.apache.flink.cdc.runtime.operators.schema.SchemaOperator

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.Input<org.apache.flink.cdc.common.event.Event>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.cdc.common.event.Event,org.apache.flink.cdc.common.event.Event>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.cdc.common.event.Event>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.cdc.common.event.Event>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

@Internal
public class SchemaOperator
extends org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.cdc.common.event.Event>
implements org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.cdc.common.event.Event,org.apache.flink.cdc.common.event.Event>

The operator will evolve schemas in SchemaRegistry for incoming SchemaChangeEvents and block the stream for tables before their schema changes finish.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, metrics, output, processingTimeService

Constructor Summary

Constructors

Constructor and Description
SchemaOperator(List<org.apache.flink.api.java.tuple.Tuple2<String,org.apache.flink.cdc.common.event.TableId>> routingRules)
SchemaOperator(List<org.apache.flink.api.java.tuple.Tuple2<String,org.apache.flink.cdc.common.event.TableId>> routingRules, java.time.Duration rpcTimeOut)

Method Summary

Modifier and Type	Method and Description
void	initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
void	processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.cdc.common.event.Event> streamRecord) This method is guaranteed to not be called concurrently with other methods of the operator.
void	setup(org.apache.flink.streaming.runtime.tasks.StreamTask<?,?> containingTask, org.apache.flink.streaming.api.graph.StreamConfig config, org.apache.flink.streaming.api.operators.Output<org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.cdc.common.event.Event>> output)

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

close, finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, open, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, snapshotState, snapshotState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

Methods inherited from interface org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processWatermark, processWatermarkStatus

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

Constructor Detail

SchemaOperator

public SchemaOperator(List<org.apache.flink.api.java.tuple.Tuple2<String,org.apache.flink.cdc.common.event.TableId>> routingRules)

SchemaOperator

public SchemaOperator(List<org.apache.flink.api.java.tuple.Tuple2<String,org.apache.flink.cdc.common.event.TableId>> routingRules,
                      java.time.Duration rpcTimeOut)

Method Detail

setup

public void setup(org.apache.flink.streaming.runtime.tasks.StreamTask<?,?> containingTask,
                  org.apache.flink.streaming.api.graph.StreamConfig config,
                  org.apache.flink.streaming.api.operators.Output<org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.cdc.common.event.Event>> output)

Specified by:

setup in interface org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.cdc.common.event.Event>

Overrides:

setup in class org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.cdc.common.event.Event>

initializeState

public void initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
                     throws Exception

Specified by:

initializeState in interface org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

Overrides:

initializeState in class org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.cdc.common.event.Event>

Throws:

Exception

processElement

public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.cdc.common.event.Event> streamRecord)
                    throws InterruptedException,
                           TimeoutException

This method is guaranteed to not be called concurrently with other methods of the operator.

Specified by:

processElement in interface org.apache.flink.streaming.api.operators.Input<org.apache.flink.cdc.common.event.Event>

Throws:

InterruptedException

TimeoutException