Package org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote

Class RemoteTierFactory

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote.RemoteTierFactory

All Implemented Interfaces:

TierFactory

public class RemoteTierFactory
extends Object
implements TierFactory

The implementation of TierFactory for remote tier.

Constructor Summary

Constructors

Constructor	Description
RemoteTierFactory()

Method Summary

Modifier and Type	Method	Description
TierConsumerAgent	createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs, List<TierShuffleDescriptor> shuffleDescriptors, TieredStorageNettyService nettyService)	Creates the consumer-side agent of a Tier.
TierMasterAgent	createMasterAgent(TieredStorageResourceRegistry resourceRegistry)	Creates the master-side agent of a Tier.
TierProducerAgent	createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffers, BufferCompressor bufferCompressor)	Creates the producer-side agent of a Tier.
TieredStorageMemorySpec	getConsumerAgentMemorySpec()	Get the TieredStorageMemorySpec of the consumer-side agent.
TieredStorageMemorySpec	getMasterAgentMemorySpec()	Get the TieredStorageMemorySpec of the master-side agent.
TieredStorageMemorySpec	getProducerAgentMemorySpec()	Get the TieredStorageMemorySpec of the producer-side agent.
void	setup(org.apache.flink.configuration.Configuration configuration)	Sets up the tier factory based on the Configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RemoteTierFactory

public RemoteTierFactory()

Method Detail

setup

public void setup(org.apache.flink.configuration.Configuration configuration)

Description copied from interface: TierFactory

Sets up the tier factory based on the Configuration.

Specified by:

setup in interface TierFactory

getMasterAgentMemorySpec

public TieredStorageMemorySpec getMasterAgentMemorySpec()

Description copied from interface: TierFactory

Get the TieredStorageMemorySpec of the master-side agent.

Specified by:

getMasterAgentMemorySpec in interface TierFactory

getProducerAgentMemorySpec

public TieredStorageMemorySpec getProducerAgentMemorySpec()

Description copied from interface: TierFactory

Get the TieredStorageMemorySpec of the producer-side agent.

Specified by:

getProducerAgentMemorySpec in interface TierFactory

getConsumerAgentMemorySpec

public TieredStorageMemorySpec getConsumerAgentMemorySpec()

Description copied from interface: TierFactory

Get the TieredStorageMemorySpec of the consumer-side agent.

Specified by:

getConsumerAgentMemorySpec in interface TierFactory

createMasterAgent

public TierMasterAgent createMasterAgent(TieredStorageResourceRegistry resourceRegistry)

Description copied from interface: TierFactory

Creates the master-side agent of a Tier.

Specified by:

createMasterAgent in interface TierFactory

createProducerAgent

public TierProducerAgent createProducerAgent(int numPartitions,
                                             int numSubpartitions,
                                             TieredStoragePartitionId partitionID,
                                             String dataFileBasePath,
                                             boolean isBroadcastOnly,
                                             TieredStorageMemoryManager storageMemoryManager,
                                             TieredStorageNettyService nettyService,
                                             TieredStorageResourceRegistry resourceRegistry,
                                             BatchShuffleReadBufferPool bufferPool,
                                             ScheduledExecutorService ioExecutor,
                                             List<TierShuffleDescriptor> shuffleDescriptors,
                                             int maxRequestedBuffers,
                                             @Nullable
                                             BufferCompressor bufferCompressor)

Description copied from interface: TierFactory

Creates the producer-side agent of a Tier.

Specified by:

createProducerAgent in interface TierFactory

createConsumerAgent

public TierConsumerAgent createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
                                             List<TierShuffleDescriptor> shuffleDescriptors,
                                             TieredStorageNettyService nettyService)

Description copied from interface: TierFactory

Creates the consumer-side agent of a Tier.

Specified by:

createConsumerAgent in interface TierFactory