Package org.apache.flink.runtime.asyncprocessing.operators.co

Class AsyncKeyedCoProcessOperatorWithWatermarkDelay<K,IN1,IN2,OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncKeyOrderedStreamOperator<OUT>

org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateStreamOperator<OUT>

org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator<OUT,KeyedCoProcessFunction<K,IN1,IN2,OUT>>

org.apache.flink.runtime.asyncprocessing.operators.co.AsyncKeyedCoProcessOperator<K,IN1,IN2,OUT>

org.apache.flink.runtime.asyncprocessing.operators.co.AsyncKeyedCoProcessOperatorWithWatermarkDelay<K,IN1,IN2,OUT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, KeyContext, KeyContextHandler, org.apache.flink.streaming.api.operators.OutputTypeConfigurable<OUT>, StreamOperator<OUT>, StreamOperatorStateHandler.CheckpointedStreamOperator, Triggerable<K,VoidNamespace>, TwoInputStreamOperator<IN1,IN2,OUT>, UserFunctionProvider<KeyedCoProcessFunction<K,IN1,IN2,OUT>>, YieldingOperator<OUT>, AsyncKeyOrderedProcessing, AsyncKeyOrderedProcessingOperator

public class AsyncKeyedCoProcessOperatorWithWatermarkDelay<K,IN1,IN2,OUT>
extends AsyncKeyedCoProcessOperator<K,IN1,IN2,OUT>

A KeyedCoProcessOperator that supports holding back watermarks with a static delay.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.runtime.asyncprocessing.operators.co.AsyncKeyedCoProcessOperator

AsyncKeyedCoProcessOperator.ContextImpl<K,IN1,IN2,OUT>

Field Summary

Fields inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator

declarationContext, userFunction

Fields inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncKeyOrderedStreamOperator

asyncExecutionController, currentProcessingContext, declarationManager, environment

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

combinedWatermark, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

Constructor Summary

Constructors

Constructor	Description
AsyncKeyedCoProcessOperatorWithWatermarkDelay(KeyedCoProcessFunction<K,IN1,IN2,OUT> keyedCoProcessFunction, long watermarkDelay)

Method Summary

Modifier and Type	Method	Description
Watermark	postProcessWatermark(Watermark watermark)	A hook that will be invoked after finishing advancing the watermark and right before the watermark being emitting downstream.

Methods inherited from class org.apache.flink.runtime.asyncprocessing.operators.co.AsyncKeyedCoProcessOperator

onEventTime, onProcessingTime, open, processElement1, processElement2

Methods inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator

close, finish, getUserFunction, initializeState, notifyCheckpointAborted, notifyCheckpointComplete, setOutputType, setup, snapshotState

Methods inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateStreamOperator

createAsyncExecutionController, getKeySelectorForAsyncKeyedContext

Methods inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncKeyOrderedStreamOperator

asyncProcessWithKey, beforeInitializeStateHandler, drainStateRequests, getAsyncKeyedStateBackend, getCurrentKey, getDeclarationManager, getElementOrder, getInternalTimerService, getOrCreateKeyedState, getRecordProcessor, handleAsyncException, isAsyncKeyOrderedProcessingEnabled, newKeySelected, postProcessElement, prepareSnapshotPreBarrier, preProcessWatermark, preserveRecordOrderAndProcess, processNonRecord, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark, processWatermark1, processWatermark1Internal, processWatermark2, processWatermark2Internal, processWatermarkInternal, processWatermarkStatus, processWatermarkStatus, reportOrForwardLatencyMarker, setAsyncKeyedContextElement, setKeyContextElement1, setKeyContextElement2

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

getContainingTask, getExecutionConfig, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, isUsingCustomRawKeyedState, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus1, processWatermarkStatus2, setCurrentKey, setMailboxExecutor, setProcessingTimeService, snapshotState, useSplittableTimers

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncKeyOrderedProcessing

getRecordProcessor, isAsyncKeyOrderedProcessingEnabled

Methods inherited from interface org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncKeyOrderedProcessingOperator

asyncProcessWithKey, getDeclarationManager, getElementOrder, postProcessElement, preserveRecordOrderAndProcess, setAsyncKeyedContextElement

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

Methods inherited from interface org.apache.flink.streaming.api.operators.TwoInputStreamOperator

processLatencyMarker1, processLatencyMarker2, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark1, processWatermark2, processWatermark2, processWatermarkStatus1, processWatermarkStatus2

Constructor Detail

AsyncKeyedCoProcessOperatorWithWatermarkDelay

public AsyncKeyedCoProcessOperatorWithWatermarkDelay(KeyedCoProcessFunction<K,IN1,IN2,OUT> keyedCoProcessFunction,
                                                     long watermarkDelay)

Method Detail

postProcessWatermark

public Watermark postProcessWatermark(Watermark watermark)
                               throws Exception

Description copied from class: AbstractAsyncKeyOrderedStreamOperator

A hook that will be invoked after finishing advancing the watermark and right before the watermark being emitting downstream. Here is a chance for customization of the emitting watermark. It is not recommended to perform async state here. Only some synchronous logic is suggested.

Overrides:

postProcessWatermark in class AbstractAsyncKeyOrderedStreamOperator<OUT>

Parameters:

watermark - the advanced watermark.

Returns:

the watermark that should be emitted to downstream. Null if there is no need for following emitting.

Throws:

Exception