org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote

Class RemoteTierFactory

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote.RemoteTierFactory

All Implemented Interfaces:

TierFactory

public class RemoteTierFactory
extends Object
implements TierFactory

The implementation of TierFactory for remote tier.

Constructor Summary

Constructors

Constructor and Description
RemoteTierFactory(int numBytesPerSegment, int bufferSizeBytes, String remoteStorageBasePath)

Method Summary

Modifier and Type	Method and Description
TierConsumerAgent	createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs, TieredStorageNettyService nettyService) Creates the consumer-side agent of a Tier.
TierMasterAgent	createMasterAgent(TieredStorageResourceRegistry resourceRegistry) Creates the master-side agent of a Tier.
TierProducerAgent	createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout) Creates the producer-side agent of a Tier.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RemoteTierFactory

public RemoteTierFactory(int numBytesPerSegment,
                         int bufferSizeBytes,
                         String remoteStorageBasePath)

Method Detail

createMasterAgent

public TierMasterAgent createMasterAgent(TieredStorageResourceRegistry resourceRegistry)

Description copied from interface: TierFactory

Creates the master-side agent of a Tier.

Specified by:

createMasterAgent in interface TierFactory

createProducerAgent

public TierProducerAgent createProducerAgent(int numSubpartitions,
                                             TieredStoragePartitionId partitionID,
                                             String dataFileBasePath,
                                             boolean isBroadcastOnly,
                                             TieredStorageMemoryManager storageMemoryManager,
                                             TieredStorageNettyService nettyService,
                                             TieredStorageResourceRegistry resourceRegistry,
                                             BatchShuffleReadBufferPool bufferPool,
                                             ScheduledExecutorService ioExecutor,
                                             int maxRequestedBuffers,
                                             java.time.Duration bufferRequestTimeout)

Description copied from interface: TierFactory

Creates the producer-side agent of a Tier.

Specified by:

createProducerAgent in interface TierFactory

createConsumerAgent

public TierConsumerAgent createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
                                             TieredStorageNettyService nettyService)

Description copied from interface: TierFactory

Creates the consumer-side agent of a Tier.

Specified by:

createConsumerAgent in interface TierFactory