org.apache.flink.runtime.state.filesystem

类 FileMergingCheckpointStateOutputStream

java.lang.Object

java.io.OutputStream

org.apache.flink.core.fs.FSDataOutputStream

org.apache.flink.runtime.state.CheckpointStateOutputStream

org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory.FsCheckpointStateOutputStream

org.apache.flink.runtime.state.filesystem.FileMergingCheckpointStateOutputStream

所有已实现的接口:

Closeable, Flushable, AutoCloseable

public class FileMergingCheckpointStateOutputStream
extends FsCheckpointStreamFactory.FsCheckpointStateOutputStream

A CheckpointStateOutputStream that writes into a segment of a file and returns a SegmentFileStateHandle upon closing. Multiple FileMergingCheckpointStateOutputStream objects can reuse the same underlying file, so that the checkpoint files are merged.

Important: This implementation is NOT thread-safe. Multiple data streams multiplexing the same file should NOT write concurrently. Instead, it is expected that only after one data stream is closed, will other data streams reuse and write to the same underlying file.

嵌套类概要

嵌套类

限定符和类型	类和说明
static interface	FileMergingCheckpointStateOutputStream.FileMergingSnapshotManagerProxy A proxy of the FileMergingSnapshotManager that owns this FileMergingCheckpointStateOutputStream, with the interfaces for dealing with physical files.

构造器概要

构造器

构造器和说明
FileMergingCheckpointStateOutputStream(int bufferSize, FileMergingCheckpointStateOutputStream.FileMergingSnapshotManagerProxy fileMergingSnapshotManagerProxy)

方法概要

限定符和类型	方法和说明
void	close() This method throws no exception if the close fails, but only logs the error.
SegmentFileStateHandle	closeAndGetHandle() Closes the stream and gets a state handle that can create an input stream producing the data written to this stream.
void	flush() Flush buffers to file if their size is above FsCheckpointStreamFactory.FsCheckpointStateOutputStream.localStateThreshold.
void	flushToFile()
org.apache.flink.core.fs.Path	getFilePath()
long	getPos()
void	sync()
void	write(byte[] b, int off, int len)
void	write(int b)

从类继承的方法 org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory.FsCheckpointStateOutputStream

isClosed

从类继承的方法 java.io.OutputStream

write

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

FileMergingCheckpointStateOutputStream

public FileMergingCheckpointStateOutputStream(int bufferSize,
                                              FileMergingCheckpointStateOutputStream.FileMergingSnapshotManagerProxy fileMergingSnapshotManagerProxy)

方法详细资料

getPos

public long getPos()
            throws IOException

覆盖:

getPos 在类中 FsCheckpointStreamFactory.FsCheckpointStateOutputStream

抛出:

IOException

write

public void write(int b)
           throws IOException

覆盖:

write 在类中 FsCheckpointStreamFactory.FsCheckpointStateOutputStream

抛出:

IOException

write

public void write(byte[] b,
                  int off,
                  int len)
           throws IOException

覆盖:

write 在类中 FsCheckpointStreamFactory.FsCheckpointStateOutputStream

抛出:

IOException

flush

public void flush()
           throws IOException

从类复制的说明: FsCheckpointStreamFactory.FsCheckpointStateOutputStream

Flush buffers to file if their size is above FsCheckpointStreamFactory.FsCheckpointStateOutputStream.localStateThreshold.

指定者:

flush 在接口中 Flushable

覆盖:

flush 在类中 FsCheckpointStreamFactory.FsCheckpointStateOutputStream

抛出:

IOException

sync

public void sync()
          throws IOException

覆盖:

sync 在类中 FsCheckpointStreamFactory.FsCheckpointStateOutputStream

抛出:

IOException

closeAndGetHandle

@Nullable
public SegmentFileStateHandle closeAndGetHandle()
                                                   throws IOException

从类复制的说明: CheckpointStateOutputStream

Closes the stream and gets a state handle that can create an input stream producing the data written to this stream.

This closing must be called (also when the caller is not interested in the handle) to successfully close the stream and retain the produced resource. In contrast, the CheckpointStateOutputStream.close() method removes the target resource when called.

覆盖:

closeAndGetHandle 在类中 FsCheckpointStreamFactory.FsCheckpointStateOutputStream

返回:

A state handle that can create an input stream producing the data written to this stream.

抛出:

IOException - Thrown, if the stream cannot be closed.

close

public void close()

This method throws no exception if the close fails, but only logs the error. This is to be consistent with FsCheckpointStreamFactory.FsCheckpointStateOutputStream.close().

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

覆盖:

close 在类中 FsCheckpointStreamFactory.FsCheckpointStateOutputStream

flushToFile

public void flushToFile()
                 throws IOException

覆盖:

flushToFile 在类中 FsCheckpointStreamFactory.FsCheckpointStateOutputStream

抛出:

IOException

getFilePath

@VisibleForTesting
 @Nullable
public org.apache.flink.core.fs.Path getFilePath()