org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk

Class DiskTierFactory

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk.DiskTierFactory

All Implemented Interfaces:

TierFactory

public class DiskTierFactory
extends Object
implements TierFactory

The implementation of TierFactory for disk tier.

Constructor Summary

Constructors

Constructor and Description
DiskTierFactory(int numBytesPerSegment, int bufferSizeBytes, float minReservedDiskSpaceFraction, int regionGroupSizeInBytes, int maxCachedBytesBeforeFlush, long numRetainedInMemoryRegionsMax)

Method Summary

Modifier and Type	Method and Description
TierConsumerAgent	createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs, TieredStorageNettyService nettyService) Creates the consumer-side agent of a Tier.
TierMasterAgent	createMasterAgent(TieredStorageResourceRegistry resourceRegistry) Creates the master-side agent of a Tier.
TierProducerAgent	createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionId, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout) Creates the producer-side agent of a Tier.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DiskTierFactory

public DiskTierFactory(int numBytesPerSegment,
                       int bufferSizeBytes,
                       float minReservedDiskSpaceFraction,
                       int regionGroupSizeInBytes,
                       int maxCachedBytesBeforeFlush,
                       long numRetainedInMemoryRegionsMax)

Method Detail

createMasterAgent

public TierMasterAgent createMasterAgent(TieredStorageResourceRegistry resourceRegistry)

Description copied from interface: TierFactory

Creates the master-side agent of a Tier.

Specified by:

createMasterAgent in interface TierFactory

createProducerAgent

public TierProducerAgent createProducerAgent(int numSubpartitions,
                                             TieredStoragePartitionId partitionId,
                                             String dataFileBasePath,
                                             boolean isBroadcastOnly,
                                             TieredStorageMemoryManager storageMemoryManager,
                                             TieredStorageNettyService nettyService,
                                             TieredStorageResourceRegistry resourceRegistry,
                                             BatchShuffleReadBufferPool bufferPool,
                                             ScheduledExecutorService ioExecutor,
                                             int maxRequestedBuffers,
                                             java.time.Duration bufferRequestTimeout)

Description copied from interface: TierFactory

Creates the producer-side agent of a Tier.

Specified by:

createProducerAgent in interface TierFactory

createConsumerAgent

public TierConsumerAgent createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
                                             TieredStorageNettyService nettyService)

Description copied from interface: TierFactory

Creates the consumer-side agent of a Tier.

Specified by:

createConsumerAgent in interface TierFactory