Package org.apache.flink.runtime.io.network.partition.hybrid.tiered.file

Class ProducerMergedPartitionFileIndex

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.file.ProducerMergedPartitionFileIndex

public class ProducerMergedPartitionFileIndex
extends Object

The ProducerMergedPartitionFileIndex is used by ProducerMergedPartitionFileWriter and ProducerMergedPartitionFileReader, to maintain the offset of each buffer in the physical file.

For efficiency, buffers from the same subpartition that are both logically (i.e. index in the subpartition) and physically (i.e. offset in the file) consecutive are combined into a ProducerMergedPartitionFileIndex.FixedSizeRegion.

For example, the following buffers (indicated by subpartitionId-bufferIndex):
   1-1, 1-2, 1-3, 2-1, 2-2, 2-5, 1-4, 1-5, 2-6
 will be combined into 5 regions (separated by '|'):
   1-1, 1-2, 1-3 | 2-1, 2-2 | 2-5 | 1-4, 1-5 | 2-6
 

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ProducerMergedPartitionFileIndex.FixedSizeRegion	Represents a series of buffers that are: From the same subpartition Logically (i.e. buffer index) consecutive Physically (i.e. offset in the file) consecutive

Constructor Summary

Constructors

Constructor	Description
ProducerMergedPartitionFileIndex(int numSubpartitions, Path indexFilePath, int regionGroupSizeInBytes, long numRetainedInMemoryRegionsMax)

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ProducerMergedPartitionFileIndex

public ProducerMergedPartitionFileIndex(int numSubpartitions,
                                        Path indexFilePath,
                                        int regionGroupSizeInBytes,
                                        long numRetainedInMemoryRegionsMax)