com.addthis.muxy

Class ReadMuxFileDirectory

java.lang.Object

com.addthis.muxy.ReadMuxFileDirectory

Direct Known Subclasses:

MuxFileDirectory

public class ReadMuxFileDirectory
extends Object

Wraps MuxStreamDirectory to add file name to id mapping as well as multi-part transparency. Files are mapped to one or more underlying streams (indexed by id). This allows for efficient clustering of file data that would otherwise be sparsely distributed through the clustered block storage.

Field Summary

Fields

Modifier and Type	Field and Description
protected static int	DEFAULT_MAP_SIZE
protected MuxyEventListener	eventListener
protected Map<String,MuxFile>	fileMap
protected Path	fileMetaConfig
protected Path	fileMetaLog
protected int	lastMapSize
protected static int	MAX_RECORDS_READ
protected static boolean	SORTED_DIR
protected Path	streamDirectory
protected ReadMuxStreamDirectory	streamMux

Constructor Summary

Constructors

Constructor and Description
ReadMuxFileDirectory(Path dir)
ReadMuxFileDirectory(Path dir, MuxyEventListener listener)

Method Summary

Modifier and Type	Method and Description
boolean	exists(String fileName)
Path	getDirectory()
int	getFileCount()
protected ReadMuxStreamDirectory	getStreamManager()
protected ReadMuxStreamDirectory	initMuxStreamDirectory(Path dir, MuxyEventListener listener)
static boolean	isMuxDir(Path dir)
Collection<MuxFile>	listFiles()
MuxFile	openFile(String fileName, boolean create)
protected MuxFile	parseNextMuxFile(InputStream in)
void	publishEvent(MuxyFileEvent ID, Object target)
protected void	readConfig()
protected void	readMetaLog()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MAX_RECORDS_READ

protected static final int MAX_RECORDS_READ

SORTED_DIR

protected static final boolean SORTED_DIR

DEFAULT_MAP_SIZE

protected static final int DEFAULT_MAP_SIZE

streamMux

protected final ReadMuxStreamDirectory streamMux

eventListener

protected final MuxyEventListener eventListener

streamDirectory

protected final Path streamDirectory

fileMetaLog

protected final Path fileMetaLog

fileMetaConfig

protected final Path fileMetaConfig

fileMap

protected final Map<String,MuxFile> fileMap

lastMapSize

protected int lastMapSize

Constructor Detail

ReadMuxFileDirectory

public ReadMuxFileDirectory(Path dir)
                     throws Exception

Throws:

Exception

ReadMuxFileDirectory

public ReadMuxFileDirectory(Path dir,
                            MuxyEventListener listener)
                     throws Exception

Throws:

Exception

Method Detail

isMuxDir

public static boolean isMuxDir(Path dir)

initMuxStreamDirectory

protected ReadMuxStreamDirectory initMuxStreamDirectory(Path dir,
                                                        MuxyEventListener listener)
                                                 throws Exception

Throws:

Exception

getFileCount

public int getFileCount()

getDirectory

public Path getDirectory()

readConfig

protected void readConfig()
                   throws IOException

Throws:

IOException

publishEvent

public void publishEvent(MuxyFileEvent ID,
                         Object target)

getStreamManager

protected ReadMuxStreamDirectory getStreamManager()

parseNextMuxFile

protected MuxFile parseNextMuxFile(InputStream in)
                            throws IOException

Throws:

IOException

readMetaLog

protected void readMetaLog()
                    throws IOException

Throws:

IOException

exists

public boolean exists(String fileName)

openFile

public MuxFile openFile(String fileName,
                        boolean create)
                 throws IOException

Throws:

IOException

listFiles

public Collection<MuxFile> listFiles()
                              throws IOException

Throws:

IOException