org.apache.flink.runtime.io.network.partition.hybrid

Class HsSubpartitionMemoryDataManager

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.HsSubpartitionMemoryDataManager

public class HsSubpartitionMemoryDataManager
extends Object

This class is responsible for managing the data in a single subpartition. One HsMemoryDataManager will hold multiple HsSubpartitionMemoryDataManager.

Method Summary

Modifier and Type	Method and Description
void	append(ByteBuffer record, Buffer.DataType dataType) Append record to HsSubpartitionMemoryDataManager.
Deque<BufferIndexAndChannel>	getBuffersSatisfyStatus(HsSpillingInfoProvider.SpillStatus spillStatus, HsSpillingInfoProvider.ConsumeStatusWithId consumeStatusWithId) Get buffers in allBuffers that satisfy expected HsSpillingInfoProvider.SpillStatus and HsSpillingInfoProvider.ConsumeStatus.
HsSubpartitionConsumerMemoryDataManager	registerNewConsumer(HsConsumerId consumerId)
void	releaseConsumer(HsConsumerId consumerId)
void	releaseSubpartitionBuffers(List<BufferIndexAndChannel> toRelease) Release this subpartition's buffers in a decision.
void	setOutputMetrics(HsOutputMetrics outputMetrics)
List<BufferWithIdentity>	spillSubpartitionBuffers(List<BufferIndexAndChannel> toSpill, CompletableFuture<Void> spillDoneFuture) Spill this subpartition's buffers in a decision.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

append

public void append(ByteBuffer record,
                   Buffer.DataType dataType)
            throws InterruptedException

Append record to HsSubpartitionMemoryDataManager.

Parameters:

record - to be managed by this class.

dataType - the type of this record. In other words, is it data or event.

Throws:

InterruptedException

getBuffersSatisfyStatus

public Deque<BufferIndexAndChannel> getBuffersSatisfyStatus(HsSpillingInfoProvider.SpillStatus spillStatus,
                                                            HsSpillingInfoProvider.ConsumeStatusWithId consumeStatusWithId)

Get buffers in allBuffers that satisfy expected HsSpillingInfoProvider.SpillStatus and HsSpillingInfoProvider.ConsumeStatus.

Parameters:

spillStatus - the status of spilling expected.

consumeStatusWithId - the status and consumerId expected.

Returns:

buffers satisfy expected status in order.

spillSubpartitionBuffers

public List<BufferWithIdentity> spillSubpartitionBuffers(List<BufferIndexAndChannel> toSpill,
                                                         CompletableFuture<Void> spillDoneFuture)

Spill this subpartition's buffers in a decision.

Parameters:

toSpill - All buffers that need to be spilled belong to this subpartition in a decision.

spillDoneFuture - completed when spill is finished.

Returns:

BufferWithIdentitys about these spill buffers.

releaseSubpartitionBuffers

public void releaseSubpartitionBuffers(List<BufferIndexAndChannel> toRelease)

Release this subpartition's buffers in a decision.

Parameters:

toRelease - All buffers that need to be released belong to this subpartition in a decision.

setOutputMetrics

public void setOutputMetrics(HsOutputMetrics outputMetrics)

registerNewConsumer

public HsSubpartitionConsumerMemoryDataManager registerNewConsumer(HsConsumerId consumerId)

releaseConsumer

public void releaseConsumer(HsConsumerId consumerId)