com.addthis.muxy

Class MuxFileDirectory

java.lang.Object

com.addthis.muxy.ReadMuxFileDirectory

com.addthis.muxy.MuxFileDirectory

Direct Known Subclasses:

TrackedMultiplexFileManager

public class MuxFileDirectory
extends ReadMuxFileDirectory

Wraps MuxStreamDirectory to add file name to id mapping as well as multi-part transparency. Files are mapped to one or more underlying streams (indexed by id). This allows for efficient clustering of file data that would otherwise be sparsely distributed through the clustered block storage.

Field Summary

Fields

Modifier and Type	Field and Description
protected com.addthis.muxy.MuxFileDirectoryCacheInstance	cacheInstance

Fields inherited from class com.addthis.muxy.ReadMuxFileDirectory

DEFAULT_MAP_SIZE, eventListener, fileMap, fileMetaConfig, fileMetaLog, lastMapSize, MAX_RECORDS_READ, SORTED_DIR, streamDirectory, streamMux

Constructor Summary

Constructors

Constructor and Description
MuxFileDirectory(Path dir, MuxyEventListener listener)
MuxFileDirectory(Path dir, MuxyEventListener listener, com.addthis.muxy.MuxFileDirectoryCacheInstance cacheInstance)

Method Summary

Modifier and Type	Method and Description
protected void	defrag() iterate of all files and re-write them sequentially into new file space
boolean	exists(String fileName)
int	getFileCount()
protected MuxStreamDirectory	getStreamManager()
protected MuxStreamDirectory	initMuxStreamDirectory(Path dir, MuxyEventListener listener)
boolean	isWritingComplete()
Collection<MuxFile>	listFiles()
OutputStream	newStreamsOutput(WritableMuxFile muxFile)
OutputStream	newStreamsOutput(WritableMuxFile muxFile, boolean compress)
WritableMuxFile	openFile(String fileName, boolean create)
protected WritableMuxFile	parseNextMuxFile(InputStream in)
void	setDeleteFreed(boolean deleteFreed)
void	setLazyLogClose(int timeoutMS)
void	setMaxBlockSize(int size)
void	setMaxFileSize(int size)
void	setWriteThrashold(int threshold)
void	waitForWriteClosure()
boolean	waitForWriteClosure(int waitTime)

Methods inherited from class com.addthis.muxy.ReadMuxFileDirectory

getDirectory, isMuxDir, publishEvent, readConfig, readMetaLog

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

cacheInstance

protected final com.addthis.muxy.MuxFileDirectoryCacheInstance cacheInstance

Constructor Detail

MuxFileDirectory

public MuxFileDirectory(Path dir,
                        MuxyEventListener listener)
                 throws Exception

Throws:

Exception

MuxFileDirectory

public MuxFileDirectory(Path dir,
                        MuxyEventListener listener,
                        com.addthis.muxy.MuxFileDirectoryCacheInstance cacheInstance)
                 throws Exception

Throws:

Exception

Method Detail

initMuxStreamDirectory

protected MuxStreamDirectory initMuxStreamDirectory(Path dir,
                                                    MuxyEventListener listener)
                                             throws Exception

Overrides:

initMuxStreamDirectory in class ReadMuxFileDirectory

Throws:

Exception

getFileCount

public int getFileCount()

Overrides:

getFileCount in class ReadMuxFileDirectory

parseNextMuxFile

protected WritableMuxFile parseNextMuxFile(InputStream in)
                                    throws IOException

Overrides:

parseNextMuxFile in class ReadMuxFileDirectory

Throws:

IOException

listFiles

public Collection<MuxFile> listFiles()
                              throws IOException

Overrides:

listFiles in class ReadMuxFileDirectory

Throws:

IOException

setDeleteFreed

public void setDeleteFreed(boolean deleteFreed)

setWriteThrashold

public void setWriteThrashold(int threshold)
                       throws IOException

Throws:

IOException

setLazyLogClose

public void setLazyLogClose(int timeoutMS)
                     throws IOException

Throws:

IOException

setMaxBlockSize

public void setMaxBlockSize(int size)
                     throws IOException

Throws:

IOException

setMaxFileSize

public void setMaxFileSize(int size)
                    throws IOException

Throws:

IOException

isWritingComplete

public boolean isWritingComplete()

waitForWriteClosure

public void waitForWriteClosure()

waitForWriteClosure

public boolean waitForWriteClosure(int waitTime)

getStreamManager

protected MuxStreamDirectory getStreamManager()

Overrides:

getStreamManager in class ReadMuxFileDirectory

exists

public boolean exists(String fileName)

Overrides:

exists in class ReadMuxFileDirectory

openFile

public WritableMuxFile openFile(String fileName,
                                boolean create)
                         throws IOException

Overrides:

openFile in class ReadMuxFileDirectory

Throws:

IOException

defrag

protected void defrag()
               throws IOException

iterate of all files and re-write them sequentially into new file space

Throws:

IOException

newStreamsOutput

public OutputStream newStreamsOutput(WritableMuxFile muxFile)
                              throws IOException

Throws:

IOException

newStreamsOutput

public OutputStream newStreamsOutput(WritableMuxFile muxFile,
                                     boolean compress)
                              throws IOException

Throws:

IOException