Uses of Interface
org.apache.hudi.common.util.SizeEstimator

Packages that use SizeEstimator

Package	Description
org.apache.hudi.common.util
org.apache.hudi.common.util.collection
org.apache.hudi.common.util.queue

Uses of SizeEstimator in org.apache.hudi.common.util

Classes in org.apache.hudi.common.util that implement SizeEstimator

Modifier and Type	Class and Description
class	DefaultSizeEstimator<T> Default implementation of size-estimator that uses Twitter's ObjectSizeCalculator.
class	HoodieRecordSizeEstimator<T> Size Estimator for Hoodie record payload.

Methods in org.apache.hudi.common.util with parameters of type SizeEstimator

Modifier and Type	Method and Description
static <R> long	SpillableMapUtils.computePayloadSize(R value, SizeEstimator<R> valueSizeEstimator) Compute a bytes representation of the payload by serializing the contents This is used to estimate the size of the payload (either in memory or when written to disk).

Uses of SizeEstimator in org.apache.hudi.common.util.collection

Constructors in org.apache.hudi.common.util.collection with parameters of type SizeEstimator

Constructor and Description
ExternalSpillableMap(Long maxInMemorySizeInBytes, String baseFilePath, SizeEstimator<T> keySizeEstimator, SizeEstimator<R> valueSizeEstimator)
ExternalSpillableMap(Long maxInMemorySizeInBytes, String baseFilePath, SizeEstimator<T> keySizeEstimator, SizeEstimator<R> valueSizeEstimator)
ExternalSpillableMap(Long maxInMemorySizeInBytes, String baseFilePath, SizeEstimator<T> keySizeEstimator, SizeEstimator<R> valueSizeEstimator, ExternalSpillableMap.DiskMapType diskMapType)
ExternalSpillableMap(Long maxInMemorySizeInBytes, String baseFilePath, SizeEstimator<T> keySizeEstimator, SizeEstimator<R> valueSizeEstimator, ExternalSpillableMap.DiskMapType diskMapType)
ExternalSpillableMap(Long maxInMemorySizeInBytes, String baseFilePath, SizeEstimator<T> keySizeEstimator, SizeEstimator<R> valueSizeEstimator, ExternalSpillableMap.DiskMapType diskMapType, boolean isCompressionEnabled)
ExternalSpillableMap(Long maxInMemorySizeInBytes, String baseFilePath, SizeEstimator<T> keySizeEstimator, SizeEstimator<R> valueSizeEstimator, ExternalSpillableMap.DiskMapType diskMapType, boolean isCompressionEnabled)

Uses of SizeEstimator in org.apache.hudi.common.util.queue

Constructors in org.apache.hudi.common.util.queue with parameters of type SizeEstimator

Constructor and Description
BoundedInMemoryExecutor(long bufferLimitInBytes, int recordSamplingRate, int recordCacheLimit, List<HoodieProducer<I>> producers, Option<HoodieConsumer<O,E>> consumer, Function<I,O> transformFunction, SizeEstimator<O> sizeEstimator, Runnable preExecuteRunnable)
BoundedInMemoryExecutor(long bufferLimitInBytes, List<HoodieProducer<I>> producers, Option<HoodieConsumer<O,E>> consumer, Function<I,O> transformFunction, SizeEstimator<O> sizeEstimator, Runnable preExecuteRunnable)
BoundedInMemoryQueue(long memoryLimit, Function<I,O> transformFunction, SizeEstimator<O> payloadSizeEstimator)
BoundedInMemoryQueue(long memoryLimit, Function<I,O> transformFunction, SizeEstimator<O> payloadSizeEstimator, int recordSamplingRate, int recordCacheLimit) Construct BoundedInMemoryQueue with passed in size estimator.