Uses of Class
org.apache.flink.runtime.io.network.partition.hybrid.tiered.common.TieredStoragePartitionId

Packages that use TieredStoragePartitionId

Package	Description
org.apache.flink.runtime.io.network.partition.hybrid.tiered.common
org.apache.flink.runtime.io.network.partition.hybrid.tiered.file
org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty
org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common that return TieredStoragePartitionId

Modifier and Type	Method and Description
static TieredStoragePartitionId	TieredStorageIdMappingUtils.convertId(ResultPartitionID resultPartitionId)

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
static ResultPartitionID	TieredStorageIdMappingUtils.convertId(TieredStoragePartitionId partitionId)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
static String	SegmentPartitionFile.getPartitionPath(TieredStoragePartitionId partitionId, String basePath)
long	PartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress) Get the priority for reading a particular buffer from the partitioned file.
long	ProducerMergedPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)
long	SegmentPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)
static org.apache.flink.core.fs.Path	SegmentPartitionFile.getSegmentFinishDirPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId)
static org.apache.flink.core.fs.Path	SegmentPartitionFile.getSegmentPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, long segmentId)
static String	SegmentPartitionFile.getSubpartitionPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId)
PartitionFileReader.ReadBufferResult	PartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer) Read a buffer from the partition file.
PartitionFileReader.ReadBufferResult	ProducerMergedPartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)
PartitionFileReader.ReadBufferResult	SegmentPartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)
CompletableFuture<Void>	SegmentPartitionFileWriter.write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)
CompletableFuture<Void>	ProducerMergedPartitionFileWriter.write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)
CompletableFuture<Void>	PartitionFileWriter.write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite) Write the buffers to the partition file.
static void	SegmentPartitionFile.writeSegmentFinishFile(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, int segmentId)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
ResultSubpartitionView	TieredStorageNettyServiceImpl.createResultSubpartitionView(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, BufferAvailabilityListener availabilityListener) Create a ResultSubpartitionView for the netty server.
CompletableFuture<NettyConnectionReader>	TieredStorageNettyServiceImpl.registerConsumer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)
CompletableFuture<NettyConnectionReader>	TieredStorageNettyService.registerConsumer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) TierConsumerAgent will register to TieredStorageNettyService and get a future of NettyConnectionReader.
void	TieredStorageNettyServiceImpl.registerProducer(TieredStoragePartitionId partitionId, NettyServiceProducer serviceProducer)
void	TieredStorageNettyService.registerProducer(TieredStoragePartitionId partitionId, NettyServiceProducer serviceProducer) TierProducerAgent will provide a callback named NettyServiceProducer to register to TieredStorageNettyService.

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage that return TieredStoragePartitionId

Modifier and Type	Method and Description
TieredStoragePartitionId	TieredStorageConsumerSpec.getPartitionId()

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
void	TieredStorageMasterClient.addPartition(TieredStoragePartitionId partitionId)
Optional<Buffer>	TieredStorageConsumerClient.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)
void	AvailabilityNotifier.notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId) Notify that the data for the specific partition and input channel is available in tiered storage.
void	AvailabilityNotifier.notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) Notify that the data from the specific partition and subpartition is available in tiered storage.
int	TieredStorageConsumerClient.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.
void	TieredStorageMasterClient.releasePartition(TieredStoragePartitionId partitionId)

Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionId

Constructor and Description
TieredStorageConsumerSpec(TieredStoragePartitionId tieredStoragePartitionId, TieredStorageInputChannelId tieredStorageInputChannelId, ResultSubpartitionIndexSet tieredStorageSubpartitionIds)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
void	NoOpMasterAgent.addPartition(TieredStoragePartitionId partitionId)
void	TierMasterAgent.addPartition(TieredStoragePartitionId partitionId) Add a new tiered storage partition.
TierProducerAgent	TierFactory.createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout) Creates the producer-side agent of a Tier.
Optional<Buffer>	TierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) Get buffer from the consumer agent.
int	TierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.
void	NoOpMasterAgent.releasePartition(TieredStoragePartitionId partitionId)
void	TierMasterAgent.releasePartition(TieredStoragePartitionId partitionId) Release a tiered storage partition.

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
TierProducerAgent	DiskTierFactory.createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionId, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout)
Optional<Buffer>	DiskTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)
int	DiskTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet)

Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStoragePartitionId

Constructor and Description
DiskIOScheduler(TieredStoragePartitionId partitionId, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout, java.util.function.BiFunction<Integer,Integer,Integer> segmentIdGetter, PartitionFileReader partitionFileReader)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
TierProducerAgent	MemoryTierFactory.createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout)
Optional<Buffer>	MemoryTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)
int	MemoryTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet)

Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStoragePartitionId

Constructor and Description
MemoryTierProducerAgent(TieredStoragePartitionId partitionId, int numSubpartitions, int bufferSizeBytes, int segmentSizeBytes, int subpartitionMaxQueuedBuffers, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
void	RemoteTierMasterAgent.addPartition(TieredStoragePartitionId partitionID)
TierProducerAgent	RemoteTierFactory.createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout)
Optional<Buffer>	RemoteTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)
void	RemoteTierConsumerAgent.notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId)
void	RemoteTierConsumerAgent.notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)
int	RemoteTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet)
void	RemoteTierMasterAgent.releasePartition(TieredStoragePartitionId partitionID)
void	RemoteStorageScanner.watchSegment(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) Watch the segment for a specific subpartition in the RemoteStorageScanner.