water.fvec

Class UploadFileVec

java.lang.Object

water.Iced<T>

water.Keyed

water.fvec.Vec

water.fvec.ByteVec

water.fvec.UploadFileVec

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable

public class UploadFileVec
extends ByteVec

Build a Vec by reading from an InputStream

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	UploadFileVec.ReadPutStats

Nested classes/interfaces inherited from class water.fvec.Vec

Vec.CollectDomain, Vec.VectorGroup, Vec.Writer

Field Summary

Fields

Modifier and Type	Field and Description
static int	CHUNK_SZ

Fields inherited from class water.fvec.Vec

_espc, KEY_PREFIX_LEN, PERCENTILES, T_BAD, T_ENUM, T_NUM, T_STR, T_TIME, T_TIMELAST, T_UUID

Fields inherited from class water.Keyed

_key

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	UploadFileVec(Key key)

Method Summary

Methods

Modifier and Type	Method and Description
void	addAndCloseChunk(Chunk c, Futures fs)
long	byteSize() Size of vector data.
Value	chunkIdx(int cidx) Get a Chunk's Value by index.
static long	chunkOffset(Key ckey) Convert a chunk-key to a file offset.
void	close(water.fvec.C1NChunk c, int cidx, Futures fs)
long	length() Number of elements in the vector; returned as a long instead of an int because Vecs support more than 2^32 elements.
int	nChunks() Number of chunks, returned as an int - Chunk count is limited by the max size of a Java long[].
static Key	readPut(Key k, java.io.InputStream is, UploadFileVec.ReadPutStats stats)
static Key	readPut(java.lang.String keyname, java.io.InputStream is, UploadFileVec.ReadPutStats stats)
boolean	writable() Default read/write behavior for Vecs.

Methods inherited from class water.fvec.ByteVec

chunkForChunkIdx, getFirstBytes, isInt, naCnt, openStream

Methods inherited from class water.fvec.Vec

adaptTo, align, at, at16h, at16l, at8, atStr, base, bins, cardinality, checksum_impl, chunkForRow, chunkKey, chunkKey, domain, equals, factor, get_espc, get_type, getVecKey, group, hashCode, isBad, isConst, isEnum, isNA, isNumeric, isString, isTime, isUUID, lazy_bins, makeCon, makeCon, makeCons, makeCopy, makeRepSeq, makeSeq, makeSeq, makeVec, makeZero, makeZero, makeZero, max, maxs, mean, min, mins, newKey, ninfs, nzCnt, open, pctiles, pinfs, postWrite, preWriting, remove_impl, set, set, set, set, setDomain, sigma, startRollupStats, startRollupStats, stride, toEnum, toString, toStringVec

Methods inherited from class water.Keyed

checksum, remove, remove, remove, remove

Methods inherited from class water.Iced

clone, frozenType, read_impl, read, readExternal, readJSON_impl, readJSON, toJsonString, write_impl, write, writeExternal, writeHTML_impl, writeHTML, writeJSON_impl, writeJSON

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

CHUNK_SZ

public static final int CHUNK_SZ

See Also:

Constant Field Values

Constructor Detail

UploadFileVec

protected UploadFileVec(Key key)

Method Detail

writable

public boolean writable()

Description copied from class: Vec

Default read/write behavior for Vecs. AppendableVecs are write-only.

addAndCloseChunk

public void addAndCloseChunk(Chunk c,
                    Futures fs)

close

public void close(water.fvec.C1NChunk c,
         int cidx,
         Futures fs)

chunkIdx

public Value chunkIdx(int cidx)

Description copied from class: Vec

Get a Chunk's Value by index. Basically the index-to-key map, plus the DKV.get(). Warning: this pulls the data locally; using this call on every Chunk index on the same node will probably trigger an OOM!

readPut

public static Key readPut(java.lang.String keyname,
          java.io.InputStream is,
          UploadFileVec.ReadPutStats stats)
                   throws java.lang.Exception

Throws:

java.lang.Exception

readPut

public static Key readPut(Key k,
          java.io.InputStream is,
          UploadFileVec.ReadPutStats stats)
                   throws java.lang.Exception

Throws:

java.lang.Exception

length

public long length()

Description copied from class: Vec

Number of elements in the vector; returned as a long instead of an int because Vecs support more than 2^32 elements. Overridden by subclasses that compute length in an alternative way, such as file-backed Vecs.

Overrides:

length in class Vec

Returns:

Number of elements in the vector

nChunks

public int nChunks()

Description copied from class: Vec

Number of chunks, returned as an int - Chunk count is limited by the max size of a Java long[]. Overridden by subclasses that compute chunks in an alternative way, such as file-backed Vecs.

Overrides:

nChunks in class Vec

Returns:

Number of chunks

byteSize

public long byteSize()

Size of vector data.

chunkOffset

public static long chunkOffset(Key ckey)

Convert a chunk-key to a file offset. Size 1-byte "rows", so this is a direct conversion.

Returns:

The file offset corresponding to this Chunk index