Package org.apache.flink.streaming.api.operators.co

Class BatchCoBroadcastWithKeyedOperator<KS,IN1,IN2,OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator<OUT,KeyedBroadcastProcessFunction<KS,IN1,IN2,OUT>>

org.apache.flink.streaming.api.operators.co.CoBroadcastWithKeyedOperator<KS,IN1,IN2,OUT>

org.apache.flink.streaming.api.operators.co.BatchCoBroadcastWithKeyedOperator<KS,IN1,IN2,OUT>

Type Parameters:

KS - The key type of the input keyed stream.

IN1 - The input type of the keyed (non-broadcast) side.

IN2 - The input type of the broadcast side.

OUT - The output type of the operator.

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, BoundedMultiInput, KeyContext, KeyContextHandler, org.apache.flink.streaming.api.operators.OutputTypeConfigurable<OUT>, StreamOperator<OUT>, StreamOperatorStateHandler.CheckpointedStreamOperator, Triggerable<KS,VoidNamespace>, TwoInputStreamOperator<IN1,IN2,OUT>, UserFunctionProvider<KeyedBroadcastProcessFunction<KS,IN1,IN2,OUT>>, YieldingOperator<OUT>

@Internal
public class BatchCoBroadcastWithKeyedOperator<KS,IN1,IN2,OUT>
extends CoBroadcastWithKeyedOperator<KS,IN1,IN2,OUT>
implements BoundedMultiInput

A TwoInputStreamOperator for executing KeyedBroadcastProcessFunctions in RuntimeExecutionMode.BATCH execution mode.

Compared to CoBroadcastWithKeyedOperator this does an additional sanity check on the input processing order requirement.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

userFunction

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

combinedWatermark, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

Constructor Summary

Constructors

Constructor	Description
BatchCoBroadcastWithKeyedOperator(KeyedBroadcastProcessFunction<KS,IN1,IN2,OUT> function, List<org.apache.flink.api.common.state.MapStateDescriptor<?,?>> broadcastStateDescriptors)

Method Summary

Modifier and Type	Method	Description
void	endInput(int inputId)	It is notified that no more data will arrive from the input identified by the inputId.
void	processElement1(StreamRecord<IN1> element)	Processes one element that arrived on the first input of this two-input operator.

Methods inherited from class org.apache.flink.streaming.api.operators.co.CoBroadcastWithKeyedOperator

onEventTime, onProcessingTime, open, processElement2

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

close, finish, getUserFunction, getUserFunctionParameters, initializeState, notifyCheckpointAborted, notifyCheckpointComplete, setOutputType, setup, snapshotState

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

beforeInitializeStateHandler, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, isAsyncKeyOrderedProcessingEnabled, isUsingCustomRawKeyedState, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark, processWatermark1, processWatermark1, processWatermark2, processWatermark2, processWatermarkStatus, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, snapshotState, useSplittableTimers

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

Methods inherited from interface org.apache.flink.streaming.api.operators.TwoInputStreamOperator

processLatencyMarker1, processLatencyMarker2, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark1, processWatermark2, processWatermark2, processWatermarkStatus1, processWatermarkStatus2

Constructor Detail

BatchCoBroadcastWithKeyedOperator

public BatchCoBroadcastWithKeyedOperator(KeyedBroadcastProcessFunction<KS,IN1,IN2,OUT> function,
                                         List<org.apache.flink.api.common.state.MapStateDescriptor<?,?>> broadcastStateDescriptors)

Method Detail

endInput

public void endInput(int inputId)
              throws Exception

Description copied from interface: BoundedMultiInput

It is notified that no more data will arrive from the input identified by the inputId. The inputId is numbered starting from 1, and `1` indicates the first input.

WARNING: It is not safe to use this method to commit any transactions or other side effects! You can use this method to e.g. flush data buffered for the given input or implement an ordered reading from multiple inputs via InputSelectable.

Specified by:

endInput in interface BoundedMultiInput

Throws:

Exception

processElement1

public void processElement1(StreamRecord<IN1> element)
                     throws Exception

Description copied from interface: TwoInputStreamOperator

Processes one element that arrived on the first input of this two-input operator. This method is guaranteed to not be called concurrently with other methods of the operator.

Specified by:

processElement1 in interface TwoInputStreamOperator<KS,IN1,IN2>

Overrides:

processElement1 in class CoBroadcastWithKeyedOperator<KS,IN1,IN2,OUT>

Throws:

Exception