org.apache.flink.runtime.io.network.partition.hybrid.tiered.common

类 TieredStorageUtils

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.common.TieredStorageUtils

public class TieredStorageUtils
extends Object

Utils for reading from or writing to tiered storage.

构造器概要

构造器

构造器和说明
TieredStorageUtils()

方法概要

限定符和类型	方法和说明
static ByteBuffer[]	generateBufferWithHeaders(List<org.apache.flink.api.java.tuple.Tuple2<Buffer,Integer>> bufferWithIndexes)
static int	getAccumulatorExclusiveBuffers() Get exclusive buffer number of accumulator.
static String	getDiskTierName()
static String	getMemoryTierName()
static int	getMinBuffersPerGate() Get the number of minimum buffers per input gate.
static int	getMinBuffersPerResultPartition() * Get the number of minimum buffers per result partition.
static float	getNumBuffersTriggerFlushRatio() When the number of buffers that have been requested exceeds this threshold, trigger the flushing operation in each TierProducerAgent.
static long	getPoolSizeCheckInterval() Get the pool size check interval.
static String	getRemoteTierName()

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

TieredStorageUtils

public TieredStorageUtils()

方法详细资料

getNumBuffersTriggerFlushRatio

public static float getNumBuffersTriggerFlushRatio()

When the number of buffers that have been requested exceeds this threshold, trigger the flushing operation in each TierProducerAgent.

返回:

flush ratio.

getAccumulatorExclusiveBuffers

public static int getAccumulatorExclusiveBuffers()

Get exclusive buffer number of accumulator.

The buffer number is used to compare with the subpartition number to determine the type of BufferAccumulator.

If the exclusive buffer number is larger than (subpartitionNum + 1), the accumulator will use HashBufferAccumulator. If the exclusive buffer number is equal to or smaller than (subpartitionNum + 1), the accumulator will use SortBufferAccumulator

返回:

the buffer number.

getPoolSizeCheckInterval

public static long getPoolSizeCheckInterval()

Get the pool size check interval.

getMinBuffersPerGate

public static int getMinBuffersPerGate()

Get the number of minimum buffers per input gate. It is only used when taskmanager.network.hybrid-shuffle.memory-decoupling.enabled is set to true.

返回:

the buffer number.

getMinBuffersPerResultPartition

public static int getMinBuffersPerResultPartition()

*

Get the number of minimum buffers per result partition.

返回:

the buffer number.

getMemoryTierName

public static String getMemoryTierName()

getDiskTierName

public static String getDiskTierName()

getRemoteTierName

public static String getRemoteTierName()

generateBufferWithHeaders

public static ByteBuffer[] generateBufferWithHeaders(List<org.apache.flink.api.java.tuple.Tuple2<Buffer,Integer>> bufferWithIndexes)