org.apache.flink.streaming.runtime.io.checkpointing

Class CheckpointBarrierTracker

java.lang.Object

org.apache.flink.streaming.runtime.io.checkpointing.CheckpointBarrierHandler

org.apache.flink.streaming.runtime.io.checkpointing.CheckpointBarrierTracker

All Implemented Interfaces:

Closeable, AutoCloseable

@Internal
public class CheckpointBarrierTracker
extends CheckpointBarrierHandler

The CheckpointBarrierTracker keeps track of what checkpoint barriers have been received from which input channels. Once it has observed all checkpoint barriers for a checkpoint ID, it notifies its listener of a completed checkpoint.

Unlike the SingleCheckpointBarrierHandler, the BarrierTracker does not block the input channels that have sent barriers, so it cannot be used to gain "exactly-once" processing guarantees. It can, however, be used to gain "at least once" processing guarantees.

NOTE: This implementation strictly assumes that newer checkpoints have higher checkpoint IDs.

Constructor Summary

Constructors

Constructor and Description
CheckpointBarrierTracker(int totalNumberOfInputChannels, org.apache.flink.runtime.jobgraph.tasks.CheckpointableTask toNotifyOnCheckpoint, org.apache.flink.util.clock.Clock clock, boolean enableCheckpointAfterTasksFinished)

Method Summary

Modifier and Type	Method and Description
long	getLatestCheckpointId()
boolean	isCheckpointPending()
void	processBarrier(org.apache.flink.runtime.io.network.api.CheckpointBarrier receivedBarrier, org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo, boolean isRpcTriggered)
void	processBarrierAnnouncement(org.apache.flink.runtime.io.network.api.CheckpointBarrier announcedBarrier, int sequenceNumber, org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)
void	processCancellationBarrier(org.apache.flink.runtime.io.network.api.CancelCheckpointMarker cancelBarrier, org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)
void	processEndOfPartition(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)

Methods inherited from class org.apache.flink.streaming.runtime.io.checkpointing.CheckpointBarrierHandler

addProcessedBytes, close, getAlignmentDurationNanos, getAllBarriersReceivedFuture, getCheckpointStartDelayNanos, getClock, markAlignmentEnd, markAlignmentEnd, markAlignmentStart, markAlignmentStartAndEnd, notifyAbort, notifyAbortOnCancellationBarrier, notifyCheckpoint, resetAlignment

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CheckpointBarrierTracker

public CheckpointBarrierTracker(int totalNumberOfInputChannels,
                                org.apache.flink.runtime.jobgraph.tasks.CheckpointableTask toNotifyOnCheckpoint,
                                org.apache.flink.util.clock.Clock clock,
                                boolean enableCheckpointAfterTasksFinished)

Method Detail

processBarrier

public void processBarrier(org.apache.flink.runtime.io.network.api.CheckpointBarrier receivedBarrier,
                           org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo,
                           boolean isRpcTriggered)
                    throws IOException

Specified by:

processBarrier in class CheckpointBarrierHandler

Throws:

IOException

processBarrierAnnouncement

public void processBarrierAnnouncement(org.apache.flink.runtime.io.network.api.CheckpointBarrier announcedBarrier,
                                       int sequenceNumber,
                                       org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)
                                throws IOException

Specified by:

processBarrierAnnouncement in class CheckpointBarrierHandler

Throws:

IOException

processCancellationBarrier

public void processCancellationBarrier(org.apache.flink.runtime.io.network.api.CancelCheckpointMarker cancelBarrier,
                                       org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)
                                throws IOException

Specified by:

processCancellationBarrier in class CheckpointBarrierHandler

Throws:

IOException

processEndOfPartition

public void processEndOfPartition(org.apache.flink.runtime.checkpoint.channel.InputChannelInfo channelInfo)
                           throws IOException

Specified by:

processEndOfPartition in class CheckpointBarrierHandler

Throws:

IOException

getLatestCheckpointId

public long getLatestCheckpointId()

Specified by:

getLatestCheckpointId in class CheckpointBarrierHandler

isCheckpointPending

public boolean isCheckpointPending()

Specified by:

isCheckpointPending in class CheckpointBarrierHandler