| Modifier and Type | Method and Description |
|---|---|
List<ResultPartition> |
NettyShuffleEnvironment.createResultPartitionWriters(ShuffleIOOwnerContext ownerContext,
List<ResultPartitionDeploymentDescriptor> resultPartitionDeploymentDescriptors) |
| Modifier and Type | Method and Description |
|---|---|
void |
NetworkSequenceViewReader.notifySubpartitionsCreated(ResultPartition partition,
ResultSubpartitionIndexSet subpartitionIndexSet)
When the
ResultPartitionManager registers ResultPartition, it will get the
PartitionRequestListener via given ResultPartitionID, and create subpartition
view reader for downstream task. |
| Modifier and Type | Method and Description |
|---|---|
static void |
NettyShuffleMetricFactory.registerOutputMetrics(boolean isDetailedMetrics,
org.apache.flink.metrics.MetricGroup outputGroup,
ResultPartition[] resultPartitions) |
static void |
ResultPartitionMetrics.registerQueueLengthMetrics(org.apache.flink.metrics.MetricGroup parent,
ResultPartition[] partitions) |
| Constructor and Description |
|---|
OutputBufferPoolUsageGauge(ResultPartition[] resultPartitions) |
OutputBuffersGauge(ResultPartition[] resultPartitions) |
OutputBuffersSizeGauge(ResultPartition[] resultPartitions) |
| Modifier and Type | Method and Description |
|---|---|
void |
NettyPartitionRequestListener.notifyPartitionCreated(ResultPartition partition) |
| Modifier and Type | Class and Description |
|---|---|
class |
BoundedBlockingResultPartition
A output data result of an individual task (one partition of an intermediate result), produced
and communicated in a batch manner: The result must be produced completely before it can be
consumed.
|
class |
BufferWritingResultPartition
A
ResultPartition which writes buffers directly to ResultSubpartitions. |
class |
PipelinedResultPartition
A result output of a task, pipelined (streamed) to the receivers.
|
class |
SortMergeResultPartition
SortMergeResultPartition appends records and events to DataBuffer and after the
DataBuffer is full, all data in the DataBuffer will be copied and spilled to a
PartitionedFile in subpartition index order sequentially. |
| Modifier and Type | Field and Description |
|---|---|
protected ResultPartition |
ResultSubpartition.parent
The parent partition this subpartition belongs to.
|
| Modifier and Type | Method and Description |
|---|---|
ResultPartition |
ResultPartitionFactory.create(String taskNameWithSubtaskAndId,
int partitionIndex,
ResultPartitionDeploymentDescriptor desc) |
ResultPartition |
ResultPartitionFactory.create(String taskNameWithSubtaskAndId,
int partitionIndex,
ResultPartitionID id,
ResultPartitionType type,
int numberOfPartitions,
int numberOfSubpartitions,
int maxParallelism,
boolean isBroadcast,
ShuffleDescriptor shuffleDescriptor,
org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory,
boolean isNumberOfPartitionConsumerUndefined) |
| Modifier and Type | Method and Description |
|---|---|
abstract org.apache.flink.runtime.io.network.partition.BoundedBlockingSubpartition |
BoundedBlockingSubpartitionType.create(int index,
ResultPartition parent,
File tempFile,
int readBufferSize,
boolean sslEnabled)
Creates BoundedBlockingSubpartition of this type.
|
void |
PartitionRequestListener.notifyPartitionCreated(ResultPartition partition)
Notify the partition request listener when the given partition is registered.
|
void |
ResultPartitionManager.registerResultPartition(ResultPartition partition) |
| Constructor and Description |
|---|
ResultSubpartition(int index,
ResultPartition parent) |
| Modifier and Type | Class and Description |
|---|---|
class |
HsResultPartition
HsResultPartition appends records and events to HsMemoryDataManager, the shuffle
data maybe spilled to disk according to the HsSpillingStrategy, and the downstream can
consume data from memory or disk. |
| Modifier and Type | Class and Description |
|---|---|
class |
TieredResultPartition
TieredResultPartition appends records and events to the tiered storage, which supports
the upstream dynamically switches storage tier for writing shuffle data, and the downstream will
read data from the relevant tier. |
Copyright © 2014–2025 The Apache Software Foundation. All rights reserved.