| 限定符和类型 | 方法和说明 |
|---|---|
List<ResultPartition> |
NettyShuffleEnvironment.createResultPartitionWriters(ShuffleIOOwnerContext ownerContext,
List<ResultPartitionDeploymentDescriptor> resultPartitionDeploymentDescriptors) |
| 限定符和类型 | 方法和说明 |
|---|---|
void |
NetworkSequenceViewReader.notifySubpartitionsCreated(ResultPartition partition,
ResultSubpartitionIndexSet subpartitionIndexSet)
When the
ResultPartitionManager registers ResultPartition, it will get the
PartitionRequestListener via given ResultPartitionID, and create subpartition
view reader for downstream task. |
| 限定符和类型 | 方法和说明 |
|---|---|
static void |
NettyShuffleMetricFactory.registerOutputMetrics(boolean isDetailedMetrics,
org.apache.flink.metrics.MetricGroup outputGroup,
ResultPartition[] resultPartitions) |
static void |
ResultPartitionMetrics.registerQueueLengthMetrics(org.apache.flink.metrics.MetricGroup parent,
ResultPartition[] partitions) |
| 构造器和说明 |
|---|
OutputBufferPoolUsageGauge(ResultPartition[] resultPartitions) |
OutputBuffersGauge(ResultPartition[] resultPartitions) |
OutputBuffersSizeGauge(ResultPartition[] resultPartitions) |
| 限定符和类型 | 方法和说明 |
|---|---|
void |
NettyPartitionRequestListener.notifyPartitionCreated(ResultPartition partition) |
| 限定符和类型 | 类和说明 |
|---|---|
class |
BoundedBlockingResultPartition
A output data result of an individual task (one partition of an intermediate result), produced
and communicated in a batch manner: The result must be produced completely before it can be
consumed.
|
class |
BufferWritingResultPartition
A
ResultPartition which writes buffers directly to ResultSubpartitions. |
class |
PipelinedResultPartition
A result output of a task, pipelined (streamed) to the receivers.
|
class |
SortMergeResultPartition
SortMergeResultPartition appends records and events to DataBuffer and after the
DataBuffer is full, all data in the DataBuffer will be copied and spilled to a
PartitionedFile in subpartition index order sequentially. |
| 限定符和类型 | 字段和说明 |
|---|---|
protected ResultPartition |
ResultSubpartition.parent
The parent partition this subpartition belongs to.
|
| 限定符和类型 | 方法和说明 |
|---|---|
ResultPartition |
ResultPartitionFactory.create(String taskNameWithSubtaskAndId,
int partitionIndex,
ResultPartitionDeploymentDescriptor desc) |
ResultPartition |
ResultPartitionFactory.create(String taskNameWithSubtaskAndId,
int partitionIndex,
ResultPartitionID id,
ResultPartitionType type,
int numberOfPartitions,
int numberOfSubpartitions,
int maxParallelism,
boolean isBroadcast,
ShuffleDescriptor shuffleDescriptor,
org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory,
boolean isNumberOfPartitionConsumerUndefined) |
| 限定符和类型 | 方法和说明 |
|---|---|
abstract org.apache.flink.runtime.io.network.partition.BoundedBlockingSubpartition |
BoundedBlockingSubpartitionType.create(int index,
ResultPartition parent,
File tempFile,
int readBufferSize,
boolean sslEnabled)
Creates BoundedBlockingSubpartition of this type.
|
void |
PartitionRequestListener.notifyPartitionCreated(ResultPartition partition)
Notify the partition request listener when the given partition is registered.
|
void |
ResultPartitionManager.registerResultPartition(ResultPartition partition) |
| 构造器和说明 |
|---|
ResultSubpartition(int index,
ResultPartition parent) |
| 限定符和类型 | 类和说明 |
|---|---|
class |
HsResultPartition
HsResultPartition appends records and events to HsMemoryDataManager, the shuffle
data maybe spilled to disk according to the HsSpillingStrategy, and the downstream can
consume data from memory or disk. |
| 限定符和类型 | 类和说明 |
|---|---|
class |
TieredResultPartition
TieredResultPartition appends records and events to the tiered storage, which supports
the upstream dynamically switches storage tier for writing shuffle data, and the downstream will
read data from the relevant tier. |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.