org.apache.flink.runtime.io.network.partition.hybrid.tiered.file

Class ProducerMergedPartitionFileWriter

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.file.ProducerMergedPartitionFileWriter

All Implemented Interfaces:

PartitionFileWriter

public class ProducerMergedPartitionFileWriter
extends Object
implements PartitionFileWriter

The implementation of PartitionFileWriter with producer-side merge mode. In this mode, the shuffle data is written in the producer side, the consumer side need to read multiple producers to get its partition data.

Note that one partition file written by the ProducerMergedPartitionFileWriter may contain the data of multiple subpartitions.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.runtime.io.network.partition.hybrid.tiered.file.PartitionFileWriter

PartitionFileWriter.SegmentBufferContext, PartitionFileWriter.SubpartitionBufferContext

Method Summary

Modifier and Type	Method and Description
void	release() Release all the resources of the PartitionFileWriter.
CompletableFuture<Void>	write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite) Write the buffers to the partition file.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

write

public CompletableFuture<Void> write(TieredStoragePartitionId partitionId,
                                     List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)

Description copied from interface: PartitionFileWriter

Write the buffers to the partition file. The written buffers may belong to multiple subpartitions, but these buffers will be consecutive in the file.

Specified by:

write in interface PartitionFileWriter

Parameters:

partitionId - the partition id

buffersToWrite - the buffers to be written to the partition file

Returns:

the completable future indicating whether the writing file process has finished. If the CompletableFuture is completed, the written process is completed.

release

public void release()

Description copied from interface: PartitionFileWriter

Release all the resources of the PartitionFileWriter.

Specified by:

release in interface PartitionFileWriter