| Interface | Description |
|---|---|
| PartitionFileReader |
PartitionFileReader defines the read logic for different types of shuffle files. |
| PartitionFileReader.ReadProgress |
This
PartitionFileReader.ReadProgress defines the read progress of the PartitionFileReader. |
| PartitionFileWriter |
The
PartitionFileWriter interface defines the write logic for different types of shuffle
files. |
| Class | Description |
|---|---|
| PartitionFileReader.ReadBufferResult |
A wrapper class of the reading buffer result, including the read buffers, the hint of
continue reading, and the read progress, etc.
|
| PartitionFileWriter.SegmentBufferContext |
The
PartitionFileWriter.SegmentBufferContext contains all the buffers belonging to the segment. |
| PartitionFileWriter.SubpartitionBufferContext |
The
PartitionFileWriter.SubpartitionBufferContext contains all the buffers belonging to one subpartition. |
| ProducerMergedPartitionFile |
The partition file in the producer-merge mode.
|
| ProducerMergedPartitionFileIndex |
The
ProducerMergedPartitionFileIndex is used by ProducerMergedPartitionFileWriter
and ProducerMergedPartitionFileReader, to maintain the offset of each buffer in the
physical file. |
| ProducerMergedPartitionFileIndex.FixedSizeRegion |
Represents a series of buffers that are:
From the same subpartition
Logically (i.e. buffer index) consecutive
Physically (i.e. offset in the file) consecutive
Note that the region has a fixed size.
|
| ProducerMergedPartitionFileReader |
The implementation of
PartitionFileReader with producer-merge mode. |
| ProducerMergedPartitionFileReader.ProducerMergedReadProgress |
The implementation of
PartitionFileReader.ReadProgress mainly includes current
reading offset, end of read offset, etc. |
| ProducerMergedPartitionFileWriter |
The implementation of
PartitionFileWriter with producer-side merge mode. |
| SegmentPartitionFile |
The partition file with segment file mode.
|
| SegmentPartitionFileReader |
The implementation of
PartitionFileReader with segment file mode. |
| SegmentPartitionFileWriter |
The implementation of
PartitionFileWriter with segment file mode. |
Copyright © 2014–2025 The Apache Software Foundation. All rights reserved.