| Class and Description |
|---|
| BufferIndexAndChannel
Integrate the buffer index and the channel id which it belongs.
|
| BufferWithIdentity
Integrate the buffer with index and the channel information to which it belongs.
|
| HsBufferContext
This class maintains the buffer's reference count and its status for hybrid shuffle mode.
|
| HsConsumerId
This class represents the identifier of hybrid shuffle's consumer.
|
| HsDataView
A view for
HsSubpartitionConsumer to find out what data exists in memory or disk and
polling the data. |
| HsFileDataIndex
Index of spilled data.
|
| HsFileDataIndex.ReadableRegion
Represents a series of physically continuous buffers in the file, which are readable, from
the same subpartition, and has sequential buffer index.
|
| HsFileDataIndex.SpilledBuffer
Represents a spilled buffer.
|
| HsFileDataIndexImpl.HsFileDataIndexRegionHelper
The implementation of
FileDataIndexRegionHelper to writing a region to the file or
reading a region from the file. |
| HsFileDataIndexImpl.InternalRegion
A
HsFileDataIndexImpl.InternalRegion is an implementation of FileDataIndexRegionHelper.Region. |
| HsMemoryDataManagerOperation
This interface is used by
HsSubpartitionMemoryDataManager to operate HsMemoryDataManager. |
| HsOutputMetrics
All metrics that
HsResultPartition needs to count, except numBytesProduced. |
| HsSpillingInfoProvider
This component is responsible for providing some information needed for the spill decision.
|
| HsSpillingInfoProvider.ConsumeStatus
This enum represents buffer status of consume in hybrid shuffle mode.
|
| HsSpillingInfoProvider.ConsumeStatusWithId
This class represents a pair of
HsSpillingInfoProvider.ConsumeStatus and consumer id. |
| HsSpillingInfoProvider.SpillStatus
This enum represents buffer status of spill in hybrid shuffle mode.
|
| HsSpillingStrategy
Spilling strategy for hybrid shuffle mode.
|
| HsSpillingStrategy.Decision
This class represents the spill and release decision made by
HsSpillingStrategy, in
other words, which data is to be spilled and which data is to be released. |
| HsSubpartitionConsumerInternalOperations
Operations provided by
HsSubpartitionConsumer that are used by other internal components
of hybrid result partition. |
| HsSubpartitionConsumerMemoryDataManager
This class is responsible for managing the data of a single consumer.
|
| HsSubpartitionFileReader
This component is responsible for reading data from disk for a specific subpartition.
|
| HsSubpartitionFileReader.Factory
Factory to create
HsSubpartitionFileReader. |
| HsSubpartitionFileReaderImpl.BufferIndexOrError
Indicates a buffer with index or an error.
|
| HsSubpartitionFileReaderImpl.Factory
Factory of
HsSubpartitionFileReader. |
| HybridShuffleConfiguration
Configuration for hybrid shuffle mode.
|
| HybridShuffleConfiguration.Builder
Builder for
HybridShuffleConfiguration. |
| HybridShuffleConfiguration.SpillingStrategyType
Type of
HsSpillingStrategy. |
| Class and Description |
|---|
| HsFileDataIndexImpl.InternalRegion
A
HsFileDataIndexImpl.InternalRegion is an implementation of FileDataIndexRegionHelper.Region. |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.