org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk

Class DiskIOScheduler

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk.DiskIOScheduler

All Implemented Interfaces:

Runnable, BufferRecycler, NettyServiceProducer

public class DiskIOScheduler
extends Object
implements Runnable, BufferRecycler, NettyServiceProducer

The DiskIOScheduler is a scheduler that controls the reading of data from shuffle files. It ensures the correct order of buffers in each subpartition during file reading. The scheduler implements the NettyServiceProducer interface to send the buffers to the Netty server through the NettyConnectionWriter.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.runtime.io.network.buffer.BufferRecycler

BufferRecycler.DummyBufferRecycler

Constructor Summary

Constructors

Constructor and Description
DiskIOScheduler(TieredStoragePartitionId partitionId, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout, java.util.function.BiFunction<Integer,Integer,Integer> segmentIdGetter, PartitionFileReader partitionFileReader)

Method Summary

Modifier and Type	Method and Description
void	connectionBroken(NettyConnectionId id) NettyConnectionWriter related to a connection id will be notified when the netty connection is broken.
void	connectionEstablished(TieredStorageSubpartitionId subpartitionId, NettyConnectionWriter nettyConnectionWriter) NettyConnectionWriter will be created when a netty connection is established for a subpartition.
void	recycle(org.apache.flink.core.memory.MemorySegment segment) Recycles the MemorySegment to its original BufferPool instance.
void	release()
void	run()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DiskIOScheduler

public DiskIOScheduler(TieredStoragePartitionId partitionId,
                       BatchShuffleReadBufferPool bufferPool,
                       ScheduledExecutorService ioExecutor,
                       int maxRequestedBuffers,
                       java.time.Duration bufferRequestTimeout,
                       java.util.function.BiFunction<Integer,Integer,Integer> segmentIdGetter,
                       PartitionFileReader partitionFileReader)

Method Detail

run

public void run()

Specified by:

run in interface Runnable

connectionEstablished

public void connectionEstablished(TieredStorageSubpartitionId subpartitionId,
                                  NettyConnectionWriter nettyConnectionWriter)

Description copied from interface: NettyServiceProducer

NettyConnectionWriter will be created when a netty connection is established for a subpartition.

Specified by:

connectionEstablished in interface NettyServiceProducer

Parameters:

subpartitionId - subpartition id indicates the id of subpartition.

nettyConnectionWriter - writer is used to write buffers to netty connection.

connectionBroken

public void connectionBroken(NettyConnectionId id)

Description copied from interface: NettyServiceProducer

NettyConnectionWriter related to a connection id will be notified when the netty connection is broken.

Specified by:

connectionBroken in interface NettyServiceProducer

Parameters:

id - connection id is the id of connection.

recycle

public void recycle(org.apache.flink.core.memory.MemorySegment segment)

Description copied from interface: BufferRecycler

Recycles the MemorySegment to its original BufferPool instance.

Specified by:

recycle in interface BufferRecycler

Parameters:

segment - The memory segment to be recycled.

release

public void release()