org.apache.hudi.common.util.collection

Class BitCaskDiskMap<T extends Serializable,R extends Serializable>

java.lang.Object

org.apache.hudi.common.util.collection.DiskMap<T,R>

org.apache.hudi.common.util.collection.BitCaskDiskMap<T,R>

All Implemented Interfaces:

Iterable<R>, Map<T,R>

public final class BitCaskDiskMap<T extends Serializable,R extends Serializable>
extends DiskMap<T,R>

This class provides a disk spillable only map implementation. All of the data is currently written to one file, without any rollover support. It uses the following : 1) An in-memory map that tracks the key-> latest ValueMetadata. 2) Current position in the file NOTE : Only String.class type supported for Key

Inspired by https://github.com/basho/bitcask

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BitCaskDiskMap.FileEntry The file metadata that should be spilled to disk.
static class	BitCaskDiskMap.ValueMetadata The value relevant metadata.

Nested classes/interfaces inherited from interface java.util.Map

Map.Entry<K,V>

Field Summary

Fields

Modifier and Type	Field and Description
static int	BUFFER_SIZE

Fields inherited from class org.apache.hudi.common.util.collection.DiskMap

diskMapPath

Constructor Summary

Constructors

Constructor and Description
BitCaskDiskMap(String baseFilePath)
BitCaskDiskMap(String baseFilePath, boolean isCompressionEnabled)

Method Summary

Modifier and Type	Method and Description
void	clear()
void	close() Close and cleanup the Map.
boolean	containsKey(Object key)
boolean	containsValue(Object value)
Set<Map.Entry<T,R>>	entrySet()
static <R> R	get(BitCaskDiskMap.ValueMetadata entry, RandomAccessFile file, boolean isCompressionEnabled)
R	get(Object key)
boolean	isEmpty()
Iterator<R>	iterator() Custom iterator to iterate over values written to disk.
Set<T>	keySet()
R	put(T key, R value)
void	putAll(Map<? extends T,? extends R> m)
R	remove(Object key)
int	size()
long	sizeOfFileOnDiskInBytes() Number of bytes spilled to disk.
Collection<R>	values()
Stream<R>	valueStream()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Map

compute, computeIfAbsent, computeIfPresent, equals, forEach, getOrDefault, hashCode, merge, putIfAbsent, remove, replace, replace, replaceAll

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Field Detail

BUFFER_SIZE

public static final int BUFFER_SIZE

See Also:

Constant Field Values

Constructor Detail

BitCaskDiskMap

public BitCaskDiskMap(String baseFilePath,
                      boolean isCompressionEnabled)
               throws IOException

Throws:

IOException

BitCaskDiskMap

public BitCaskDiskMap(String baseFilePath)
               throws IOException

Throws:

IOException

Method Detail

iterator

public Iterator<R> iterator()

Custom iterator to iterate over values written to disk.

sizeOfFileOnDiskInBytes

public long sizeOfFileOnDiskInBytes()

Number of bytes spilled to disk.

size

public int size()

isEmpty

public boolean isEmpty()

containsKey

public boolean containsKey(Object key)

containsValue

public boolean containsValue(Object value)

get

public R get(Object key)

get

public static <R> R get(BitCaskDiskMap.ValueMetadata entry,
                        RandomAccessFile file,
                        boolean isCompressionEnabled)

put

public R put(T key,
             R value)

remove

public R remove(Object key)

putAll

public void putAll(Map<? extends T,? extends R> m)

clear

public void clear()

close

public void close()

Description copied from class: DiskMap

Close and cleanup the Map.

Overrides:

close in class DiskMap<T extends Serializable,R extends Serializable>

keySet

public Set<T> keySet()

values

public Collection<R> values()

valueStream

public Stream<R> valueStream()

entrySet

public Set<Map.Entry<T,R>> entrySet()