Package org.apache.flink.datastream.impl.operators

Class TwoInputBroadcastProcessOperator<IN1,​IN2,​OUT>

  • All Implemented Interfaces:
    Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedMultiInput, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.OutputTypeConfigurable<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,​IN2,​OUT>, org.apache.flink.streaming.api.operators.UserFunctionProvider<org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<IN1,​IN2,​OUT>>, org.apache.flink.streaming.api.operators.YieldingOperator<OUT>, org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncKeyOrderedProcessing, org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncKeyOrderedProcessingOperator
    Direct Known Subclasses:
    KeyedTwoInputBroadcastProcessOperator
    public class TwoInputBroadcastProcessOperator<IN1,​IN2,​OUT>
extends org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator<OUT,​org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<IN1,​IN2,​OUT>>
implements org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,​IN2,​OUT>, org.apache.flink.streaming.api.operators.BoundedMultiInput
    Operator for TwoInputBroadcastStreamProcessFunction.
    See Also:
    Serialized Form

    • Field Summary

      Fields 
      Modifier and Type Field Description
      protected TimestampCollector<OUT> collector  
      protected DefaultRuntimeContext context  
      protected org.apache.flink.streaming.runtime.watermark.extension.eventtime.EventTimeWatermarkHandler eventTimeWatermarkHandler  
      protected org.apache.flink.datastream.api.context.NonPartitionedContext<OUT> nonPartitionedContext  
      protected DefaultPartitionedContext<OUT> partitionedContext  
      protected Map<String,​org.apache.flink.streaming.runtime.watermark.AbstractInternalWatermarkDeclaration<?>> watermarkDeclarationMap  

      • Fields inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator

        declarationContext, userFunction

      • Fields inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncKeyOrderedStreamOperator

        asyncExecutionController, currentProcessingContext, declarationManager, environment

      • Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

        combinedWatermark, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

    • Constructor Summary

      Constructors 
      Constructor Description
      TwoInputBroadcastProcessOperator​(org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<IN1,​IN2,​OUT> userFunction)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void close()  
      protected Object currentKey()  
      void endInput​(int inputId)  
      protected Supplier<Long> getEventTimeSupplier()  
      protected org.apache.flink.datastream.api.context.NonPartitionedContext<OUT> getNonPartitionedContext()  
      protected TimestampCollector<OUT> getOutputCollector()  
      protected org.apache.flink.datastream.api.context.ProcessingTimeManager getProcessingTimeManager()  
      protected BiConsumer<Runnable,​Object> getProcessorWithKey()  
      protected org.apache.flink.streaming.api.operators.InternalTimerService<org.apache.flink.runtime.state.VoidNamespace> getTimerService()  
      boolean isAsyncKeyOrderedProcessingEnabled()  
      void open()  
      void processElement1​(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN1> element)  
      void processElement2​(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN2> element)  
      void processWatermark1Internal​(org.apache.flink.runtime.event.WatermarkEvent watermark)  
      void processWatermark2Internal​(org.apache.flink.runtime.event.WatermarkEvent watermark)  

      • Methods inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator

        finish, getUserFunction, initializeState, notifyCheckpointAborted, notifyCheckpointComplete, setOutputType, setup, snapshotState

      • Methods inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateStreamOperator

        createAsyncExecutionController, getKeySelectorForAsyncKeyedContext

      • Methods inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncKeyOrderedStreamOperator

        asyncProcessWithKey, beforeInitializeStateHandler, drainStateRequests, getAsyncKeyedStateBackend, getCurrentKey, getDeclarationManager, getElementOrder, getInternalTimerService, getOrCreateKeyedState, getRecordProcessor, handleAsyncException, newKeySelected, postProcessElement, postProcessWatermark, prepareSnapshotPreBarrier, preProcessWatermark, preserveRecordOrderAndProcess, processNonRecord, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark, processWatermark1, processWatermark2, processWatermarkInternal, processWatermarkStatus, processWatermarkStatus, reportOrForwardLatencyMarker, setAsyncKeyedContextElement, setKeyContextElement1, setKeyContextElement2

      • Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

        getContainingTask, getExecutionConfig, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, isUsingCustomRawKeyedState, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus1, processWatermarkStatus2, setCurrentKey, setMailboxExecutor, setProcessingTimeService, snapshotState, useSplittableTimers

      • Methods inherited from interface org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncKeyOrderedProcessing

        getRecordProcessor

      • Methods inherited from interface org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncKeyOrderedProcessingOperator

        asyncProcessWithKey, getDeclarationManager, getElementOrder, postProcessElement, preserveRecordOrderAndProcess, setAsyncKeyedContextElement

      • Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

        notifyCheckpointAborted, notifyCheckpointComplete

      • Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

        getCurrentKey, setCurrentKey

      • Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

        hasKeyContext

      • Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

        finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

      • Methods inherited from interface org.apache.flink.streaming.api.operators.TwoInputStreamOperator

        processLatencyMarker1, processLatencyMarker2, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark1, processWatermark2, processWatermark2, processWatermarkStatus1, processWatermarkStatus2

    • Field Detail

      • nonPartitionedContext

        protected transient org.apache.flink.datastream.api.context.NonPartitionedContext<OUT> nonPartitionedContext

      • watermarkDeclarationMap

        protected transient Map<String,​org.apache.flink.streaming.runtime.watermark.AbstractInternalWatermarkDeclaration<?>> watermarkDeclarationMap

      • eventTimeWatermarkHandler

        protected transient org.apache.flink.streaming.runtime.watermark.extension.eventtime.EventTimeWatermarkHandler eventTimeWatermarkHandler

    • Constructor Detail

      • TwoInputBroadcastProcessOperator

        public TwoInputBroadcastProcessOperator​(org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<IN1,​IN2,​OUT> userFunction)

    • Method Detail

      • open

        public void open()
          throws Exception
        Specified by:
        open in interface org.apache.flink.streaming.api.operators.StreamOperator<IN1>
        Overrides:
        open in class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator<OUT,​org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<IN1,​IN2,​OUT>>
        Throws:
        Exception

      • processElement1

        public void processElement1​(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN1> element)
                     throws Exception
        Specified by:
        processElement1 in interface org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,​IN2,​OUT>
        Throws:
        Exception

      • processElement2

        public void processElement2​(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN2> element)
                     throws Exception
        Specified by:
        processElement2 in interface org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,​IN2,​OUT>
        Throws:
        Exception

      • processWatermark1Internal

        public void processWatermark1Internal​(org.apache.flink.runtime.event.WatermarkEvent watermark)
                               throws Exception
        Overrides:
        processWatermark1Internal in class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncKeyOrderedStreamOperator<OUT>
        Throws:
        Exception

      • processWatermark2Internal

        public void processWatermark2Internal​(org.apache.flink.runtime.event.WatermarkEvent watermark)
                               throws Exception
        Overrides:
        processWatermark2Internal in class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncKeyOrderedStreamOperator<OUT>
        Throws:
        Exception

      • getNonPartitionedContext

        protected org.apache.flink.datastream.api.context.NonPartitionedContext<OUT> getNonPartitionedContext()

      • endInput

        public void endInput​(int inputId)
              throws Exception
        Specified by:
        endInput in interface org.apache.flink.streaming.api.operators.BoundedMultiInput
        Throws:
        Exception

      • currentKey

        protected Object currentKey()

      • getProcessingTimeManager

        protected org.apache.flink.datastream.api.context.ProcessingTimeManager getProcessingTimeManager()

      • close

        public void close()
           throws Exception
        Specified by:
        close in interface org.apache.flink.streaming.api.operators.StreamOperator<IN1>
        Overrides:
        close in class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator<OUT,​org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<IN1,​IN2,​OUT>>
        Throws:
        Exception

      • isAsyncKeyOrderedProcessingEnabled

        public boolean isAsyncKeyOrderedProcessingEnabled()
        Specified by:
        isAsyncKeyOrderedProcessingEnabled in interface org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncKeyOrderedProcessing
        Overrides:
        isAsyncKeyOrderedProcessingEnabled in class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncKeyOrderedStreamOperator<OUT>

      • getTimerService

        protected org.apache.flink.streaming.api.operators.InternalTimerService<org.apache.flink.runtime.state.VoidNamespace> getTimerService()

      • getEventTimeSupplier

        protected Supplier<Long> getEventTimeSupplier()