| Modifier and Type | Method and Description |
|---|---|
List<TierShuffleDescriptor> |
TieredInternalShuffleMaster.addPartitionAndGetShuffleDescriptor(org.apache.flink.api.common.JobID jobID,
ResultPartitionID resultPartitionID) |
| Modifier and Type | Method and Description |
|---|---|
TieredResultPartition |
TieredResultPartitionFactory.createTieredResultPartition(String owningTaskName,
int partitionIndex,
ResultPartitionID partitionId,
ResultPartitionType partitionType,
int numPartitions,
int numSubpartitions,
int maxParallelism,
int bufferSizeBytes,
Boolean isBroadCastOnly,
ResultPartitionManager partitionManager,
BufferCompressor bufferCompressor,
List<TierShuffleDescriptor> tierShuffleDescriptors,
org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory,
FileChannelManager fileChannelManager,
BatchShuffleReadBufferPool batchShuffleReadBufferPool,
ScheduledExecutorService batchShuffleReadIOExecutor,
boolean isNumberOfPartitionConsumerUndefined) |
| Modifier and Type | Method and Description |
|---|---|
List<TierShuffleDescriptor> |
TieredStorageMasterClient.addPartitionAndGetShuffleDescriptor(org.apache.flink.api.common.JobID jobID,
ResultPartitionID resultPartitionID) |
| Modifier and Type | Method and Description |
|---|---|
void |
TieredStorageConsumerClient.updateTierShuffleDescriptors(TieredStoragePartitionId partitionId,
TieredStorageInputChannelId inputChannelId,
TieredStorageSubpartitionId subpartitionId,
List<TierShuffleDescriptor> tierShuffleDescriptors) |
| Constructor and Description |
|---|
TieredStorageConsumerClient(List<TierFactory> tierFactories,
List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
List<List<TierShuffleDescriptor>> tierShuffleDescriptors,
TieredStorageNettyService nettyService) |
| Modifier and Type | Class and Description |
|---|---|
class |
NoOpTierShuffleDescriptor
The empty implementation for
TierShuffleDescriptor. |
class |
UnknownTierShuffleDescriptor
This is a placeholder when the tier shuffle descriptor should be unknown because the netty
shuffle descriptor is unknown.
|
| Modifier and Type | Method and Description |
|---|---|
TierShuffleDescriptor |
NoOpMasterAgent.addPartitionAndGetShuffleDescriptor(org.apache.flink.api.common.JobID jobID,
ResultPartitionID resultPartitionID) |
TierShuffleDescriptor |
TierMasterAgent.addPartitionAndGetShuffleDescriptor(org.apache.flink.api.common.JobID jobID,
ResultPartitionID resultPartitionID)
Add a new tiered storage partition and get the
TierShuffleDescriptor. |
| Modifier and Type | Method and Description |
|---|---|
void |
NoOpMasterAgent.releasePartition(TierShuffleDescriptor shuffleDescriptor) |
void |
TierMasterAgent.releasePartition(TierShuffleDescriptor shuffleDescriptor)
Release a tiered storage partition.
|
void |
TierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId,
TieredStorageInputChannelId inputChannelId,
TieredStorageSubpartitionId subpartitionId,
TierShuffleDescriptor tierShuffleDescriptor)
Update the
TierShuffleDescriptor for the consumer agent. |
| Modifier and Type | Method and Description |
|---|---|
TierConsumerAgent |
TierFactory.createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
List<TierShuffleDescriptor> shuffleDescriptors,
TieredStorageNettyService nettyService)
Creates the consumer-side agent of a Tier.
|
TierProducerAgent |
TierFactory.createProducerAgent(int numPartitions,
int numSubpartitions,
TieredStoragePartitionId partitionID,
String dataFileBasePath,
boolean isBroadcastOnly,
TieredStorageMemoryManager storageMemoryManager,
TieredStorageNettyService nettyService,
TieredStorageResourceRegistry resourceRegistry,
BatchShuffleReadBufferPool bufferPool,
ScheduledExecutorService ioExecutor,
List<TierShuffleDescriptor> shuffleDescriptors,
int maxRequestedBuffer)
Creates the producer-side agent of a Tier.
|
| Modifier and Type | Method and Description |
|---|---|
void |
DiskTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId,
TieredStorageInputChannelId inputChannelId,
TieredStorageSubpartitionId subpartitionId,
TierShuffleDescriptor tierShuffleDescriptor) |
| Modifier and Type | Method and Description |
|---|---|
TierConsumerAgent |
DiskTierFactory.createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
List<TierShuffleDescriptor> shuffleDescriptors,
TieredStorageNettyService nettyService) |
TierProducerAgent |
DiskTierFactory.createProducerAgent(int numPartitions,
int numSubpartitions,
TieredStoragePartitionId partitionId,
String dataFileBasePath,
boolean isBroadcastOnly,
TieredStorageMemoryManager storageMemoryManager,
TieredStorageNettyService nettyService,
TieredStorageResourceRegistry resourceRegistry,
BatchShuffleReadBufferPool bufferPool,
ScheduledExecutorService ioExecutor,
List<TierShuffleDescriptor> shuffleDescriptors,
int maxRequestedBuffers) |
| Modifier and Type | Method and Description |
|---|---|
void |
MemoryTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId,
TieredStorageInputChannelId inputChannelId,
TieredStorageSubpartitionId subpartitionId,
TierShuffleDescriptor tierShuffleDescriptor) |
| Modifier and Type | Method and Description |
|---|---|
TierConsumerAgent |
MemoryTierFactory.createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
List<TierShuffleDescriptor> shuffleDescriptors,
TieredStorageNettyService nettyService) |
TierProducerAgent |
MemoryTierFactory.createProducerAgent(int numPartitions,
int numSubpartitions,
TieredStoragePartitionId partitionID,
String dataFileBasePath,
boolean isBroadcastOnly,
TieredStorageMemoryManager memoryManager,
TieredStorageNettyService nettyService,
TieredStorageResourceRegistry resourceRegistry,
BatchShuffleReadBufferPool bufferPool,
ScheduledExecutorService ioExecutor,
List<TierShuffleDescriptor> shuffleDescriptors,
int maxRequestedBuffers) |
| Modifier and Type | Class and Description |
|---|---|
class |
RemoteTierShuffleDescriptor
The shuffle descriptor implementation for remote tier.
|
| Modifier and Type | Method and Description |
|---|---|
TierShuffleDescriptor |
RemoteTierMasterAgent.addPartitionAndGetShuffleDescriptor(org.apache.flink.api.common.JobID jobID,
ResultPartitionID resultPartitionID) |
| Modifier and Type | Method and Description |
|---|---|
void |
RemoteTierMasterAgent.releasePartition(TierShuffleDescriptor shuffleDescriptor) |
void |
RemoteTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId,
TieredStorageInputChannelId inputChannelId,
TieredStorageSubpartitionId subpartitionId,
TierShuffleDescriptor tierShuffleDescriptor) |
| Modifier and Type | Method and Description |
|---|---|
TierConsumerAgent |
RemoteTierFactory.createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
List<TierShuffleDescriptor> shuffleDescriptors,
TieredStorageNettyService nettyService) |
TierProducerAgent |
RemoteTierFactory.createProducerAgent(int numPartitions,
int numSubpartitions,
TieredStoragePartitionId partitionID,
String dataFileBasePath,
boolean isBroadcastOnly,
TieredStorageMemoryManager storageMemoryManager,
TieredStorageNettyService nettyService,
TieredStorageResourceRegistry resourceRegistry,
BatchShuffleReadBufferPool bufferPool,
ScheduledExecutorService ioExecutor,
List<TierShuffleDescriptor> shuffleDescriptors,
int maxRequestedBuffers) |
| Modifier and Type | Method and Description |
|---|---|
List<TierShuffleDescriptor> |
NettyShuffleDescriptor.getTierShuffleDescriptors() |
| Constructor and Description |
|---|
NettyShuffleDescriptor(ResourceID producerLocation,
NettyShuffleDescriptor.PartitionConnectionInfo partitionConnectionInfo,
ResultPartitionID resultPartitionID,
List<TierShuffleDescriptor> tierShuffleDescriptors) |
Copyright © 2014–2025 The Apache Software Foundation. All rights reserved.