org.apache.flink.runtime.checkpoint.filemerging

Class NonBlockingPhysicalFilePool

java.lang.Object

org.apache.flink.runtime.checkpoint.filemerging.PhysicalFilePool

org.apache.flink.runtime.checkpoint.filemerging.NonBlockingPhysicalFilePool

All Implemented Interfaces:

Closeable, AutoCloseable

public class NonBlockingPhysicalFilePool
extends PhysicalFilePool

A Non-Blocking PhysicalFilePool which will always provide usable physical file without blocking. It may create many physical files if pollFile(FileMergingSnapshotManager.SubtaskKey, CheckpointedStateScope) frequently.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.runtime.checkpoint.filemerging.PhysicalFilePool

PhysicalFilePool.Type

Field Summary

Fields inherited from class org.apache.flink.runtime.checkpoint.filemerging.PhysicalFilePool

exclusivePhysicalFilePool, maxFileSize, physicalFileCreator, sharedPhysicalFilePoolBySubtask

Constructor Summary

Constructors

Constructor and Description
NonBlockingPhysicalFilePool(long maxFileSize, PhysicalFile.PhysicalFileCreator physicalFileCreator)

Method Summary

Modifier and Type	Method and Description
protected Queue<PhysicalFile>	createFileQueue() Create and return a file queue.
PhysicalFile	pollFile(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) Poll a physical file from the pool.
boolean	tryPutFile(FileMergingSnapshotManager.SubtaskKey subtaskKey, PhysicalFile physicalFile) Try to put a physical file into file pool.

Methods inherited from class org.apache.flink.runtime.checkpoint.filemerging.PhysicalFilePool

close, close, getFileQueue, isEmpty

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NonBlockingPhysicalFilePool

public NonBlockingPhysicalFilePool(long maxFileSize,
                                   PhysicalFile.PhysicalFileCreator physicalFileCreator)

Method Detail

tryPutFile

public boolean tryPutFile(FileMergingSnapshotManager.SubtaskKey subtaskKey,
                          PhysicalFile physicalFile)

Description copied from class: PhysicalFilePool

Try to put a physical file into file pool.

Specified by:

tryPutFile in class PhysicalFilePool

Parameters:

subtaskKey - the key of current subtask.

physicalFile - target physical file.

Returns:

true if file is in the pool, false otherwise.

pollFile

@Nonnull
public PhysicalFile pollFile(FileMergingSnapshotManager.SubtaskKey subtaskKey,
                                      CheckpointedStateScope scope)
                               throws IOException

Description copied from class: PhysicalFilePool

Poll a physical file from the pool.

Specified by:

pollFile in class PhysicalFilePool

Parameters:

subtaskKey - the key of current subtask.

scope - the scope of the checkpoint.

Returns:

a physical file.

Throws:

IOException

createFileQueue

protected Queue<PhysicalFile> createFileQueue()

Description copied from class: PhysicalFilePool

Create and return a file queue.

Specified by:

createFileQueue in class PhysicalFilePool

Returns:

a created file queue.