Uses of Class
org.apache.flink.runtime.io.network.partition.hybrid.tiered.common.TieredStoragePartitionId
-
-
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common that return TieredStoragePartitionId Modifier and Type Method Description static TieredStoragePartitionIdTieredStorageIdMappingUtils. convertId(ResultPartitionID resultPartitionId)Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common with parameters of type TieredStoragePartitionId Modifier and Type Method Description static ResultPartitionIDTieredStorageIdMappingUtils. convertId(TieredStoragePartitionId partitionId) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file with parameters of type TieredStoragePartitionId Modifier and Type Method Description static StringSegmentPartitionFile. getPartitionPath(TieredStoragePartitionId partitionId, String basePath)longPartitionFileReader. getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)Get the priority for reading a particular buffer from the partitioned file.longProducerMergedPartitionFileReader. getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)longSegmentPartitionFileReader. getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)static org.apache.flink.core.fs.PathSegmentPartitionFile. getSegmentFinishDirPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId)static org.apache.flink.core.fs.PathSegmentPartitionFile. getSegmentPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, long segmentId)static StringSegmentPartitionFile. getSubpartitionPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId)PartitionFileReader.ReadBufferResultPartitionFileReader. readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)Read a buffer from the partition file.PartitionFileReader.ReadBufferResultProducerMergedPartitionFileReader. readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)PartitionFileReader.ReadBufferResultSegmentPartitionFileReader. readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)CompletableFuture<Void>PartitionFileWriter. write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)Write the buffers to the partition file.CompletableFuture<Void>ProducerMergedPartitionFileWriter. write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)CompletableFuture<Void>SegmentPartitionFileWriter. write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)static voidSegmentPartitionFile. writeSegmentFinishFile(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, int segmentId) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty
-
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage that return TieredStoragePartitionId Modifier and Type Method Description TieredStoragePartitionIdTieredStorageConsumerSpec. getPartitionId()Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionId Modifier and Type Method Description Optional<Buffer>TieredStorageConsumerClient. getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)voidAvailabilityNotifier. notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId)Notify that the data for the specific partition and input channel is available in tiered storage.intTieredStorageConsumerClient. peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet)Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.voidTieredStorageConsumerClient. updateTierShuffleDescriptors(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, List<TierShuffleDescriptor> tierShuffleDescriptors)Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionId Constructor Description TieredStorageConsumerSpec(int gateIndex, TieredStoragePartitionId tieredStoragePartitionId, TieredStorageInputChannelId tieredStorageInputChannelId, ResultSubpartitionIndexSet tieredStorageSubpartitionIds) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with parameters of type TieredStoragePartitionId Modifier and Type Method Description TierProducerAgentTierFactory. createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffer, BufferCompressor bufferCompressor)Creates the producer-side agent of a Tier.Optional<Buffer>TierConsumerAgent. getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)Get buffer from the consumer agent.intTierConsumerAgent. peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet)Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.voidTierConsumerAgent. updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor)Update theTierShuffleDescriptorfor the consumer agent.Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with type arguments of type TieredStoragePartitionId Modifier and Type Method Description CompletableFuture<?>TierShuffleHandler. onReleasePartitions(Collection<TieredStoragePartitionId> partitionIds)A callback to process the event of releasing a collection of tiered result partitions. -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk
Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStoragePartitionId Constructor Description DiskIOScheduler(TieredStoragePartitionId partitionId, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, Duration bufferRequestTimeout, BiFunction<Integer,Integer,Integer> segmentIdGetter, PartitionFileReader partitionFileReader) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory
Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStoragePartitionId Constructor Description MemoryTierProducerAgent(TieredStoragePartitionId partitionId, int numSubpartitions, int bufferSizeBytes, int segmentSizeBytes, int subpartitionMaxQueuedBuffers, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BufferCompressor bufferCompressor) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote that return TieredStoragePartitionId Modifier and Type Method Description TieredStoragePartitionIdRemoteTierShuffleDescriptor. getPartitionId()Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type TieredStoragePartitionId Modifier and Type Method Description TierProducerAgentRemoteTierFactory. createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffers, BufferCompressor bufferCompressor)Optional<Buffer>RemoteTierConsumerAgent. getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)voidRemoteTierConsumerAgent. notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)intRemoteTierConsumerAgent. peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet)voidRemoteTierConsumerAgent. updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor)voidRemoteStorageScanner. watchSegment(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)Watch the segment for a specific subpartition in theRemoteStorageScanner.Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with type arguments of type TieredStoragePartitionId Modifier and Type Method Description voidRemoteStorageScanner. registerAvailabilityAndPriorityNotifier(BiConsumer<TieredStoragePartitionId,TieredStorageSubpartitionId> availabilityNotifier)Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type TieredStoragePartitionId Constructor Description RemoteTierShuffleDescriptor(TieredStoragePartitionId partitionId)
-