Uses of Class
org.apache.flink.runtime.io.network.partition.hybrid.tiered.common.TieredStoragePartitionId

Packages that use TieredStoragePartitionId

Package	Description
org.apache.flink.runtime.io.network.partition.hybrid.tiered.common
org.apache.flink.runtime.io.network.partition.hybrid.tiered.file
org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty
org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common that return TieredStoragePartitionId

Modifier and Type	Method and Description
static TieredStoragePartitionId	TieredStorageIdMappingUtils.convertId(ResultPartitionID resultPartitionId)

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
static ResultPartitionID	TieredStorageIdMappingUtils.convertId(TieredStoragePartitionId partitionId)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
static String	SegmentPartitionFile.getPartitionPath(TieredStoragePartitionId partitionId, String basePath)
long	PartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress) Get the priority for reading a particular buffer from the partitioned file.
long	ProducerMergedPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)
long	SegmentPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)
static org.apache.flink.core.fs.Path	SegmentPartitionFile.getSegmentFinishDirPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId)
static org.apache.flink.core.fs.Path	SegmentPartitionFile.getSegmentPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, long segmentId)
static String	SegmentPartitionFile.getSubpartitionPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId)
PartitionFileReader.ReadBufferResult	PartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer) Read a buffer from the partition file.
PartitionFileReader.ReadBufferResult	ProducerMergedPartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)
PartitionFileReader.ReadBufferResult	SegmentPartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)
CompletableFuture<Void>	PartitionFileWriter.write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite) Write the buffers to the partition file.
CompletableFuture<Void>	ProducerMergedPartitionFileWriter.write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)
CompletableFuture<Void>	SegmentPartitionFileWriter.write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)
static void	SegmentPartitionFile.writeSegmentFinishFile(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, int segmentId)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
ResultSubpartitionView	TieredStorageNettyServiceImpl.createResultSubpartitionView(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, BufferAvailabilityListener availabilityListener) Create a ResultSubpartitionView for the netty server.
CompletableFuture<NettyConnectionReader>	TieredStorageNettyServiceImpl.registerConsumer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)
CompletableFuture<NettyConnectionReader>	TieredStorageNettyService.registerConsumer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) TierConsumerAgent will register to TieredStorageNettyService and get a future of NettyConnectionReader.
void	TieredStorageNettyServiceImpl.registerProducer(TieredStoragePartitionId partitionId, NettyServiceProducer serviceProducer)
void	TieredStorageNettyService.registerProducer(TieredStoragePartitionId partitionId, NettyServiceProducer serviceProducer) TierProducerAgent will provide a callback named NettyServiceProducer to register to TieredStorageNettyService.

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage that return TieredStoragePartitionId

Modifier and Type	Method and Description
TieredStoragePartitionId	TieredStorageConsumerSpec.getPartitionId()

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
Optional<Buffer>	TieredStorageConsumerClient.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)
void	AvailabilityNotifier.notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId) Notify that the data for the specific partition and input channel is available in tiered storage.
int	TieredStorageConsumerClient.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.
void	TieredStorageConsumerClient.updateTierShuffleDescriptors(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, List<TierShuffleDescriptor> tierShuffleDescriptors)

Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionId

Constructor and Description
TieredStorageConsumerSpec(int gateIndex, TieredStoragePartitionId tieredStoragePartitionId, TieredStorageInputChannelId tieredStorageInputChannelId, ResultSubpartitionIndexSet tieredStorageSubpartitionIds)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
TierProducerAgent	TierFactory.createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffer) Creates the producer-side agent of a Tier.
Optional<Buffer>	TierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) Get buffer from the consumer agent.
int	TierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.
void	TierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor) Update the TierShuffleDescriptor for the consumer agent.

Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with type arguments of type TieredStoragePartitionId

Modifier and Type	Method and Description
CompletableFuture<?>	TierShuffleHandler.onReleasePartitions(Collection<TieredStoragePartitionId> partitionIds) A callback to process the event of releasing a collection of tiered result partitions.

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
TierProducerAgent	DiskTierFactory.createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionId, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffers)
Optional<Buffer>	DiskTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)
int	DiskTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet)
void	DiskTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor)

Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStoragePartitionId

Constructor and Description
DiskIOScheduler(TieredStoragePartitionId partitionId, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, Duration bufferRequestTimeout, BiFunction<Integer,Integer,Integer> segmentIdGetter, PartitionFileReader partitionFileReader)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
TierProducerAgent	MemoryTierFactory.createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffers)
Optional<Buffer>	MemoryTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)
int	MemoryTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet)
void	MemoryTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor)

Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStoragePartitionId

Constructor and Description
MemoryTierProducerAgent(TieredStoragePartitionId partitionId, int numSubpartitions, int bufferSizeBytes, int segmentSizeBytes, int subpartitionMaxQueuedBuffers, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BufferCompressor bufferCompressor)

Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote that return TieredStoragePartitionId

Modifier and Type	Method and Description
TieredStoragePartitionId	RemoteTierShuffleDescriptor.getPartitionId()

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type TieredStoragePartitionId

Modifier and Type	Method and Description
TierProducerAgent	RemoteTierFactory.createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffers)
Optional<Buffer>	RemoteTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)
void	RemoteTierConsumerAgent.notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)
int	RemoteTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet)
void	RemoteTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor)
void	RemoteStorageScanner.watchSegment(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) Watch the segment for a specific subpartition in the RemoteStorageScanner.

Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with type arguments of type TieredStoragePartitionId

Modifier and Type	Method and Description
void	RemoteStorageScanner.registerAvailabilityAndPriorityNotifier(BiConsumer<TieredStoragePartitionId,TieredStorageSubpartitionId> availabilityNotifier)

Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type TieredStoragePartitionId

Constructor and Description
RemoteTierShuffleDescriptor(TieredStoragePartitionId partitionId)