org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage

Class TieredStorageConsumerClient

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage.TieredStorageConsumerClient

public class TieredStorageConsumerClient
extends Object

TieredStorageConsumerClient is used to read buffer from tiered store.

Constructor Summary

Constructors

Constructor and Description
TieredStorageConsumerClient(List<TierFactory> tierFactories, List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs, List<List<TierShuffleDescriptor>> tierShuffleDescriptors, TieredStorageNettyService nettyService)

Method Summary

Modifier and Type	Method and Description
void	close()
Optional<Buffer>	getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)
int	peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.
void	registerAvailabilityNotifier(AvailabilityNotifier notifier)
void	setup(BufferPool bufferPool)
void	start()
void	updateTierShuffleDescriptors(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, List<TierShuffleDescriptor> tierShuffleDescriptors)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TieredStorageConsumerClient

public TieredStorageConsumerClient(List<TierFactory> tierFactories,
                                   List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
                                   List<List<TierShuffleDescriptor>> tierShuffleDescriptors,
                                   TieredStorageNettyService nettyService)

Method Detail

setup

public void setup(BufferPool bufferPool)

start

public void start()

peekNextBufferSubpartitionId

public int peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId,
                                        ResultSubpartitionIndexSet indexSet)
                                 throws IOException

Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.

Parameters:

partitionId - The index of the partition which the returned subpartition should belong to.

indexSet - The indexes of the subpartitions expected.

Throws:

IOException

getNextBuffer

public Optional<Buffer> getNextBuffer(TieredStoragePartitionId partitionId,
                                      TieredStorageSubpartitionId subpartitionId)
                               throws IOException

Throws:

IOException

registerAvailabilityNotifier

public void registerAvailabilityNotifier(AvailabilityNotifier notifier)

updateTierShuffleDescriptors

public void updateTierShuffleDescriptors(TieredStoragePartitionId partitionId,
                                         TieredStorageInputChannelId inputChannelId,
                                         TieredStorageSubpartitionId subpartitionId,
                                         List<TierShuffleDescriptor> tierShuffleDescriptors)

close

public void close()
           throws IOException

Throws:

IOException