org.apache.flink.streaming.api.functions.sink.filesystem

Class OutputStreamBasedPartFileWriter<IN,BucketID>

java.lang.Object

org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter<IN,BucketID>

org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter<IN,BucketID>

Type Parameters:

IN - the element type

BucketID - the bucket type

All Implemented Interfaces:

InProgressFileWriter<IN,BucketID>, PartFileInfo<BucketID>

public abstract class OutputStreamBasedPartFileWriter<IN,BucketID>
extends AbstractPartFileWriter<IN,BucketID>

The base class for all the part file writer that use RecoverableFsDataOutputStream.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable The InProgressFileRecoverable implementation for OutputStreamBasedBucketWriter.
static class	OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer The serializer for OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable.
static class	OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable The PendingFileRecoverable implementation for OutputStreamBasedBucketWriter.
static class	OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer The serializer for OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable.

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter

InProgressFileWriter.InProgressFileRecoverable, InProgressFileWriter.PendingFileRecoverable

Method Summary

Modifier and Type	Method and Description
InProgressFileWriter.PendingFileRecoverable	closeForCommit()
void	dispose() Dispose the part file.
long	getSize()
InProgressFileWriter.InProgressFileRecoverable	persist()

Methods inherited from class org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter

getBucketId, getCreationTime, getLastUpdateTime, markWrite

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter

write

Method Detail

persist

public InProgressFileWriter.InProgressFileRecoverable persist()
                                                       throws IOException

Returns:

The state of the current part file.

Throws:

IOException - Thrown if persisting the part file fails.

closeForCommit

public InProgressFileWriter.PendingFileRecoverable closeForCommit()
                                                           throws IOException

Returns:

The state of the pending part file. Bucket uses this to commit the pending file.

Throws:

IOException - Thrown if an I/O error occurs.

dispose

public void dispose()

Description copied from interface: InProgressFileWriter

Dispose the part file.

getSize

public long getSize()
             throws IOException

Returns:

The size of the currently open part file.

Throws:

IOException