org.apache.flink.runtime.state.filesystem

类 FsMergingCheckpointStorageLocation

java.lang.Object

org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory

org.apache.flink.runtime.state.filesystem.FsCheckpointStorageLocation

org.apache.flink.runtime.state.filesystem.FsMergingCheckpointStorageLocation

所有已实现的接口:

CheckpointStorageLocation, CheckpointStreamFactory

public class FsMergingCheckpointStorageLocation
extends FsCheckpointStorageLocation

An implementation of checkpoint storage location for file merging checkpoints.

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory

FsCheckpointStreamFactory.FsCheckpointStateOutputStream

字段概要

从类继承的字段 org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory

MAX_FILE_STATE_THRESHOLD

构造器概要

构造器

构造器和说明

FsMergingCheckpointStorageLocation(FileMergingSnapshotManager.SubtaskKey subtaskKey, org.apache.flink.core.fs.FileSystem fileSystem, org.apache.flink.core.fs.Path checkpointDir, org.apache.flink.core.fs.Path sharedStateDir, org.apache.flink.core.fs.Path taskOwnedStateDir, CheckpointStorageLocationReference reference, int fileStateSizeThreshold, int writeBufferSize, FileMergingSnapshotManager fileMergingSnapshotManager, long checkpointId)

方法概要

限定符和类型	方法和说明
boolean	canFastDuplicate(StreamStateHandle stateHandle, CheckpointedStateScope scope) Tells if we can duplicate the given StreamStateHandle into the path corresponding to the given CheckpointedStateScope.
boolean	couldReuseStateHandle(StreamStateHandle stateHandle) A pre-check hook before the checkpoint writer want to reuse a state handle, if this returns false, it is not recommended for the writer to rewrite the state file considering the space amplification.
FileMergingCheckpointStateOutputStream	createCheckpointStateOutputStream(CheckpointedStateScope scope) Creates an new CheckpointStateOutputStream.
List<StreamStateHandle>	duplicate(List<StreamStateHandle> stateHandles, CheckpointedStateScope scope) Duplicates StreamStateHandle into the path corresponding to * the given CheckpointedStateScope.
DirectoryStreamStateHandle	getExclusiveStateHandle()
DirectoryStreamStateHandle	getSharedStateHandle()
void	reusePreviousStateHandle(Collection<? extends StreamStateHandle> previousHandle) A callback method when some previous handle is reused.
CheckpointStreamFactory	toNonFileMerging()
String	toString()

从类继承的方法 org.apache.flink.runtime.state.filesystem.FsCheckpointStorageLocation

createMetadataOutputStream, disposeOnFailure, getCheckpointDirectory, getLocationReference, getMetadataFilePath, getSharedStateDirectory, getTaskOwnedStateDirectory

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

构造器详细资料

FsMergingCheckpointStorageLocation

public FsMergingCheckpointStorageLocation(FileMergingSnapshotManager.SubtaskKey subtaskKey,
                                          org.apache.flink.core.fs.FileSystem fileSystem,
                                          org.apache.flink.core.fs.Path checkpointDir,
                                          org.apache.flink.core.fs.Path sharedStateDir,
                                          org.apache.flink.core.fs.Path taskOwnedStateDir,
                                          CheckpointStorageLocationReference reference,
                                          int fileStateSizeThreshold,
                                          int writeBufferSize,
                                          FileMergingSnapshotManager fileMergingSnapshotManager,
                                          long checkpointId)

方法详细资料

toNonFileMerging

public CheckpointStreamFactory toNonFileMerging()

getExclusiveStateHandle

public DirectoryStreamStateHandle getExclusiveStateHandle()

getSharedStateHandle

public DirectoryStreamStateHandle getSharedStateHandle()

canFastDuplicate

public boolean canFastDuplicate(StreamStateHandle stateHandle,
                                CheckpointedStateScope scope)
                         throws IOException

从接口复制的说明: CheckpointStreamFactory

Tells if we can duplicate the given StreamStateHandle into the path corresponding to the given CheckpointedStateScope.

This should be a rather cheap operation, preferably not involving any remote accesses.

指定者:

canFastDuplicate 在接口中 CheckpointStreamFactory

覆盖:

canFastDuplicate 在类中 FsCheckpointStreamFactory

参数:

stateHandle - The handle to duplicate

scope - Scope determining the location to duplicate into

返回:

true, if we can perform the duplication

抛出:

IOException

duplicate

public List<StreamStateHandle> duplicate(List<StreamStateHandle> stateHandles,
                                         CheckpointedStateScope scope)
                                  throws IOException

从接口复制的说明: CheckpointStreamFactory

Duplicates StreamStateHandle into the path corresponding to * the given CheckpointedStateScope.

You should first check if you can duplicate with CheckpointStreamFactory.canFastDuplicate(StreamStateHandle, CheckpointedStateScope).

指定者:

duplicate 在接口中 CheckpointStreamFactory

覆盖:

duplicate 在类中 FsCheckpointStreamFactory

参数:

stateHandles - The handles to duplicate

scope - Scope determining the location to duplicate into

返回:

The duplicated handle

抛出:

IOException

createCheckpointStateOutputStream

public FileMergingCheckpointStateOutputStream createCheckpointStateOutputStream(CheckpointedStateScope scope)
                                                                         throws IOException

从接口复制的说明: CheckpointStreamFactory

Creates an new CheckpointStateOutputStream. When the stream is closed, it returns a state handle that can retrieve the state back.

指定者:

createCheckpointStateOutputStream 在接口中 CheckpointStreamFactory

覆盖:

createCheckpointStateOutputStream 在类中 FsCheckpointStreamFactory

参数:

scope - The state's scope, whether it is exclusive or shared.

返回:

An output stream that writes state for the given checkpoint.

抛出:

IOException - Exceptions may occur while creating the stream and should be forwarded.

reusePreviousStateHandle

public void reusePreviousStateHandle(Collection<? extends StreamStateHandle> previousHandle)

从接口复制的说明: CheckpointStreamFactory

A callback method when some previous handle is reused. It is needed by the file merging mechanism (FLIP-306) which will manage the life cycle of underlying files by file-reusing information.

参数:

previousHandle - the previous handles that will be reused.

couldReuseStateHandle

public boolean couldReuseStateHandle(StreamStateHandle stateHandle)

从接口复制的说明: CheckpointStreamFactory

A pre-check hook before the checkpoint writer want to reuse a state handle, if this returns false, it is not recommended for the writer to rewrite the state file considering the space amplification.

参数:

stateHandle - the handle to be reused.

返回:

true if it can be reused.

toString

public String toString()

覆盖:

toString 在类中 FsCheckpointStorageLocation