org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty

Class TieredStorageNettyServiceImpl

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty.TieredStorageNettyServiceImpl

All Implemented Interfaces:

TieredStorageNettyService

public class TieredStorageNettyServiceImpl
extends Object
implements TieredStorageNettyService

The default implementation of TieredStorageNettyService.

Constructor Summary

Constructors

Constructor and Description
TieredStorageNettyServiceImpl(TieredStorageResourceRegistry resourceRegistry)

Method Summary

Modifier and Type	Method and Description
ResultSubpartitionView	createResultSubpartitionView(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, BufferAvailabilityListener availabilityListener) Create a ResultSubpartitionView for the netty server.
CompletableFuture<NettyConnectionReader>	registerConsumer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) TierConsumerAgent will register to TieredStorageNettyService and get a future of NettyConnectionReader.
void	registerProducer(TieredStoragePartitionId partitionId, NettyServiceProducer serviceProducer) TierProducerAgent will provide a callback named NettyServiceProducer to register to TieredStorageNettyService.
void	setupInputChannels(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs, List<Supplier<InputChannel>> inputChannelProviders) Set up input channels in SingleInputGate.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TieredStorageNettyServiceImpl

public TieredStorageNettyServiceImpl(TieredStorageResourceRegistry resourceRegistry)

Method Detail

registerProducer

public void registerProducer(TieredStoragePartitionId partitionId,
                             NettyServiceProducer serviceProducer)

Description copied from interface: TieredStorageNettyService

TierProducerAgent will provide a callback named NettyServiceProducer to register to TieredStorageNettyService.

Specified by:

registerProducer in interface TieredStorageNettyService

Parameters:

partitionId - partition id indicates the unique id of TieredResultPartition.

serviceProducer - serviceProducer is a callback from TierProducerAgent and used to register a NettyConnectionWriter and disconnect the netty connection.

registerConsumer

public CompletableFuture<NettyConnectionReader> registerConsumer(TieredStoragePartitionId partitionId,
                                                                 TieredStorageSubpartitionId subpartitionId)

Description copied from interface: TieredStorageNettyService

TierConsumerAgent will register to TieredStorageNettyService and get a future of NettyConnectionReader.

Specified by:

registerConsumer in interface TieredStorageNettyService

Parameters:

partitionId - partition id indicates the unique id of TieredResultPartition.

subpartitionId - subpartition id indicates the unique id of subpartition.

Returns:

the future of netty connection reader.

createResultSubpartitionView

public ResultSubpartitionView createResultSubpartitionView(TieredStoragePartitionId partitionId,
                                                           TieredStorageSubpartitionId subpartitionId,
                                                           BufferAvailabilityListener availabilityListener)

Create a ResultSubpartitionView for the netty server.

Parameters:

partitionId - partition id indicates the unique id of TieredResultPartition.

subpartitionId - subpartition id indicates the unique id of subpartition.

availabilityListener - listener is used to listen the available status of data.

Returns:

the TieredStorageResultSubpartitionView.

setupInputChannels

public void setupInputChannels(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
                               List<Supplier<InputChannel>> inputChannelProviders)

Set up input channels in SingleInputGate. The method will be invoked by the pekko rpc thread at first, and then the method TieredStorageNettyService.registerConsumer(TieredStoragePartitionId, TieredStorageSubpartitionId) will be invoked by the same thread sequentially, which ensures thread safety.

Parameters:

tieredStorageConsumerSpecs - specs indicates TieredResultPartition and TieredStorageSubpartitionId.

inputChannelProviders - it provides input channels for subpartitions.