org.apache.flink.streaming.runtime.io

Class StreamTaskNetworkInput<T>

java.lang.Object

org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput<T,org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer<org.apache.flink.runtime.plugable.DeserializationDelegate<StreamElement>>>

org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput<T>

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.flink.runtime.io.AvailabilityProvider, PushingAsyncDataInput<T>, StreamTaskInput<T>

@Internal
public final class StreamTaskNetworkInput<T>
extends AbstractStreamTaskNetworkInput<T,org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer<org.apache.flink.runtime.plugable.DeserializationDelegate<StreamElement>>>

Implementation of StreamTaskInput that wraps an input from network taken from CheckpointedInputGate.

This internally uses a StatusWatermarkValve to keep track of Watermark and WatermarkStatus events, and forwards them to event subscribers once the StatusWatermarkValve determines the Watermark from all inputs has advanced, or that a WatermarkStatus needs to be propagated downstream to denote a status change.

Forwarding elements, watermarks, or status elements must be protected by synchronizing on the given lock object. This ensures that we don't call methods on a StreamInputProcessor concurrently with the timer callback or other things.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.runtime.io.PushingAsyncDataInput

PushingAsyncDataInput.DataOutput<T>

Nested classes/interfaces inherited from interface org.apache.flink.runtime.io.AvailabilityProvider

org.apache.flink.runtime.io.AvailabilityProvider.AvailabilityHelper

Field Summary

Fields inherited from class org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput

canEmitBatchOfRecords, checkpointedInputGate, deserializationDelegate, flattenedChannelIndices, inputIndex, inputSerializer, recordDeserializers, statusWatermarkValve

Fields inherited from interface org.apache.flink.streaming.runtime.io.StreamTaskInput

UNSPECIFIED

Fields inherited from interface org.apache.flink.runtime.io.AvailabilityProvider

AVAILABLE

Constructor Summary

Constructors

Constructor and Description
StreamTaskNetworkInput(CheckpointedInputGate checkpointedInputGate, org.apache.flink.api.common.typeutils.TypeSerializer<T> inputSerializer, org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager, StatusWatermarkValve statusWatermarkValve, int inputIndex, StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords)

Method Summary

Modifier and Type	Method and Description
void	close()
CompletableFuture<Void>	prepareSnapshot(org.apache.flink.runtime.checkpoint.channel.ChannelStateWriter channelStateWriter, long checkpointId) Prepares to spill the in-flight input buffers as checkpoint snapshot.

Methods inherited from class org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput

emitNext, getActiveSerializer, getAvailableFuture, getInputIndex, processBuffer, processEvent, releaseDeserializer

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.runtime.io.AvailabilityProvider

and, isApproximatelyAvailable, isAvailable, or

Constructor Detail

StreamTaskNetworkInput

public StreamTaskNetworkInput(CheckpointedInputGate checkpointedInputGate,
                              org.apache.flink.api.common.typeutils.TypeSerializer<T> inputSerializer,
                              org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager,
                              StatusWatermarkValve statusWatermarkValve,
                              int inputIndex,
                              StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords)

Method Detail

prepareSnapshot

public CompletableFuture<Void> prepareSnapshot(org.apache.flink.runtime.checkpoint.channel.ChannelStateWriter channelStateWriter,
                                               long checkpointId)
                                        throws org.apache.flink.runtime.checkpoint.CheckpointException

Description copied from interface: StreamTaskInput

Prepares to spill the in-flight input buffers as checkpoint snapshot.

Throws:

org.apache.flink.runtime.checkpoint.CheckpointException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class AbstractStreamTaskNetworkInput<T,org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer<org.apache.flink.runtime.plugable.DeserializationDelegate<StreamElement>>>

Throws:

IOException