Index
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form
A
- AbstractColumnVector - Class in io.delta.kernel.defaults.internal.data.vector
-
Abstract implementation of
ColumnVectorthat provides the default functionality common to most of the specific data typeColumnVectorimplementations. - addBinary(Binary) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BinaryDictionaryAwareDecimalColumnReader
- addBinary(Binary) - Method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters.TimestampBinaryConverter
- addInt(int) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.IntDictionaryAwareDecimalColumnReader
- addInt(int) - Method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters.DateToTimestampNTZConverter
- addLong(long) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.LongDictionaryAwareDecimalColumnReader
- addLong(long) - Method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters.TimestampBinaryConverter
- addLong(long) - Method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters.TimestampMillisConverter
- addValueFromDictionary(int) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BaseDecimalColumnReader
- available() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
B
- BatchReadSupport(int, StructType) - Constructor for class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
C
- canNotInstantiateLogStore(String, String, Exception) - Static method in class io.delta.kernel.defaults.internal.DefaultEngineErrors
- close() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
- close() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
- close() - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- close() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- close() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- close() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- close() - Method in class io.delta.kernel.defaults.internal.expressions.DefaultExpressionEvaluator
- copyFileAtomically(String, String, boolean) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
- copyFileAtomically(String, String, boolean) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
-
Atomically copy a file from source path to destination path.
- copyFileAtomically(String, String, boolean) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
- create(boolean) - Method in interface io.delta.kernel.defaults.engine.fileio.OutputFile
-
Get the output stream to write to the file.
- create(boolean) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopOutputFile
- create(FileIO) - Static method in class io.delta.kernel.defaults.engine.DefaultEngine
-
Create an instance of
DefaultEngine. - create(Configuration) - Static method in class io.delta.kernel.defaults.engine.DefaultEngine
-
Create an instance of
DefaultEngine. - createDecimalConverter(int, DecimalType, Type) - Static method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader
- createSelectionVector(boolean[], int, int) - Method in class io.delta.kernel.defaults.engine.DefaultExpressionHandler
- createTimestampConverter(int, Type, DataType) - Static method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters
-
Create a
timestampcolumn type reader
D
- daysToMicros(int, ZoneOffset) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
-
Converts a number of days since epoch (1970-01-01 00:00:00 UTC) to microseconds between epoch and start of the day in the given timezone.
- DecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
-
Decimal column readers for materializing the column values from Parquet files into Kernels
ColumnVector. - DecimalColumnReader() - Constructor for class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader
- DecimalColumnReader.BaseDecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
- DecimalColumnReader.BinaryDictionaryAwareDecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
- DecimalColumnReader.IntDictionaryAwareDecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
- DecimalColumnReader.LongDictionaryAwareDecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
- DEFAULT_TARGET_FILE_SIZE - Static variable in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
- DefaultArrayVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for array type data. - DefaultArrayVector(int, DataType, Optional<boolean[]>, int[], ColumnVector) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultArrayVector
-
Create an instance of
ColumnVectorfor array type. - DefaultBinaryVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for binary type data. - DefaultBinaryVector(DataType, int, byte[][]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultBinaryVector
-
Create an instance of
ColumnVectorfor binary type. - DefaultBooleanVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for boolean type data. - DefaultBooleanVector(int, Optional<boolean[]>, boolean[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultBooleanVector
-
Create an instance of
ColumnVectorfor boolean type. - DefaultByteVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for byte type data. - DefaultByteVector(int, Optional<boolean[]>, byte[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultByteVector
-
Create an instance of
ColumnVectorfor byte type. - DefaultColumnarBatch - Class in io.delta.kernel.defaults.internal.data
- DefaultColumnarBatch(int, StructType, ColumnVector[]) - Constructor for class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
- DefaultConstantVector - Class in io.delta.kernel.defaults.internal.data.vector
- DefaultConstantVector(DataType, int, Object) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultConstantVector
- DefaultDecimalVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for decimal type data. - DefaultDecimalVector(DataType, int, BigDecimal[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultDecimalVector
-
Create an instance of
ColumnVectorfor decimal type. - DefaultDoubleVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for double type data. - DefaultDoubleVector(int, Optional<boolean[]>, double[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultDoubleVector
-
Create an instance of
ColumnVectorfor float type. - DefaultEngine - Class in io.delta.kernel.defaults.engine
-
Default implementation of
Enginebased on Hadoop APIs. - DefaultEngineErrors - Class in io.delta.kernel.defaults.internal
- DefaultEngineErrors() - Constructor for class io.delta.kernel.defaults.internal.DefaultEngineErrors
- DefaultExpressionEvaluator - Class in io.delta.kernel.defaults.internal.expressions
-
Implementation of
ExpressionEvaluatorfor defaultExpressionHandler. - DefaultExpressionEvaluator(StructType, Expression, DataType) - Constructor for class io.delta.kernel.defaults.internal.expressions.DefaultExpressionEvaluator
-
Create a
DefaultExpressionEvaluatorinstance bound to the given expression and inputSchem. - DefaultExpressionHandler - Class in io.delta.kernel.defaults.engine
-
Default implementation of
ExpressionHandler - DefaultExpressionHandler() - Constructor for class io.delta.kernel.defaults.engine.DefaultExpressionHandler
- DefaultFileSystemClient - Class in io.delta.kernel.defaults.engine
-
Default implementation of
FileSystemClientbased on Hadoop APIs. - DefaultFileSystemClient(FileIO) - Constructor for class io.delta.kernel.defaults.engine.DefaultFileSystemClient
-
Create an instance of the default
FileSystemClientimplementation. - DefaultFloatVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for float type data. - DefaultFloatVector(int, Optional<boolean[]>, float[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultFloatVector
-
Create an instance of
ColumnVectorfor float type. - DefaultGenericVector - Class in io.delta.kernel.defaults.internal.data.vector
-
Generic column vector implementation to expose an array of objects as a column vector.
- DefaultIntVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for integer type data. - DefaultIntVector(DataType, int, Optional<boolean[]>, int[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultIntVector
-
Create an instance of
ColumnVectorfor integer type. - DefaultJsonHandler - Class in io.delta.kernel.defaults.engine
-
Default implementation of
JsonHandlerbased on Hadoop APIs. - DefaultJsonHandler(FileIO) - Constructor for class io.delta.kernel.defaults.engine.DefaultJsonHandler
- DefaultJsonRow - Class in io.delta.kernel.defaults.internal.data
- DefaultJsonRow(ObjectNode, StructType) - Constructor for class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- DefaultKernelUtils - Class in io.delta.kernel.defaults.internal
- DefaultLongVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for long, timestamp or timestamp_ntz type data. - DefaultLongVector(DataType, int, Optional<boolean[]>, long[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultLongVector
-
Create an instance of
ColumnVectorfor long type. - DefaultMapVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for map type data. - DefaultMapVector(int, DataType, Optional<boolean[]>, int[], ColumnVector, ColumnVector) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultMapVector
-
Create an instance of
ColumnVectorfor map type. - DefaultParquetHandler - Class in io.delta.kernel.defaults.engine
-
Default implementation of
ParquetHandlerbased on Hadoop APIs. - DefaultParquetHandler(FileIO) - Constructor for class io.delta.kernel.defaults.engine.DefaultParquetHandler
-
Create an instance of default
ParquetHandlerimplementation. - DefaultPredicateEvaluator - Class in io.delta.kernel.defaults.internal.expressions
-
Default implementation of
PredicateEvaluator. - DefaultPredicateEvaluator(StructType, Predicate) - Constructor for class io.delta.kernel.defaults.internal.expressions.DefaultPredicateEvaluator
- DefaultRowBasedColumnarBatch - Class in io.delta.kernel.defaults.internal.data
-
ColumnarBatchwrapper around list ofRowobjects. - DefaultRowBasedColumnarBatch(StructType, List<Row>) - Constructor for class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
- DefaultShortVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for short type data. - DefaultShortVector(int, Optional<boolean[]>, short[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultShortVector
-
Create an instance of
ColumnVectorfor short type. - DefaultStructVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorimplementation for struct type data. - DefaultStructVector(int, DataType, Optional<boolean[]>, ColumnVector[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultStructVector
-
Create an instance of
ColumnVectorforstructtype. - DefaultSubFieldVector - Class in io.delta.kernel.defaults.internal.data.vector
-
ColumnVectorwrapper on top ofRowobjects. - DefaultSubFieldVector(int, DataType, int, Function<Integer, Row>) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
-
Create an instance of
DefaultSubFieldVector - DefaultViewVector - Class in io.delta.kernel.defaults.internal.data.vector
-
Provides a restricted view on an underlying column vector.
- DefaultViewVector(ColumnVector, int, int) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- delete(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
- delete(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
-
Delete the file at given path.
- delete(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
E
- eval(ColumnarBatch) - Method in class io.delta.kernel.defaults.internal.expressions.DefaultExpressionEvaluator
- eval(ColumnarBatch, Optional<ColumnVector>) - Method in class io.delta.kernel.defaults.internal.expressions.DefaultPredicateEvaluator
F
- FileIO - Interface in io.delta.kernel.defaults.engine.fileio
-
Interface for file IO operations.
- finalizeCurrentRow(long) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
- finalizeCurrentRow(long) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
-
Finalize the current row.
- flush() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
- fromArray(DataType, Object[]) - Static method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- fromJulianDay(int, long) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
-
Returns the number of microseconds since epoch from Julian day and nanoseconds in a day.
- fromList(DataType, List<Object>) - Static method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
G
- getArray(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultArrayVector
-
Get the value at given
rowId. - getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultBinaryVector
-
Get the value at given
rowId. - getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultBooleanVector
-
Get the value at given
rowId. - getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getByte(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultByteVector
-
Get the value at given
rowId. - getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getChild(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getChild(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultStructVector
- getChild(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getChild(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getColumnVector(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
- getColumnVector(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
- getConf(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
-
Get the configuration value for the given key.
- getConf(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
- getCurrentRecord() - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
-
Return a fake object.
- getDataAsColumnarBatch(int) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
- getDataAsColumnarBatch(int) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
-
Return the data collected so far as a
ColumnarBatch. - getDataColumnVector(int) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BaseDecimalColumnReader
- getDataType() - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getDataType() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getDataType() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getDataType() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getDataType(StructType, Column) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
-
Search for the data type of the given column in the schema.
- getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultDecimalVector
- getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultDoubleVector
-
Get the value at given
rowId. - getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getEvaluator(StructType, Expression, DataType) - Method in class io.delta.kernel.defaults.engine.DefaultExpressionHandler
- getExpressionHandler() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
- getFileStatus(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
- getFileStatus(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
-
Get the metadata of the file at the given path.
- getFileStatus(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
- getFileSystemClient() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
- getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultFloatVector
-
Get the value at given
rowId. - getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getInt(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultIntVector
-
Get the value at given
rowId. - getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getJsonHandler() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
- getLogStore(Configuration, String) - Static method in class io.delta.kernel.defaults.internal.logstore.LogStoreProvider
-
Get the
LogStoreinstance for the given scheme and configuration. - getLong(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultLongVector
-
Get the value at given
rowId. - getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getMap(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultMapVector
-
Get the value at given
rowId. - getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getMetricsReporters() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
- getParquetHandler() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
- getPos() - Method in class io.delta.kernel.defaults.engine.fileio.PositionOutputStream
-
Get the current position in the stream.
- getPos() - Method in class io.delta.kernel.defaults.engine.fileio.SeekableInputStream
-
Get the current position in the stream.
- getPos() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
- getPos() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
- getPredicateEvaluator(StructType, Predicate) - Method in class io.delta.kernel.defaults.engine.DefaultExpressionHandler
- getRootConverter() - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
- getSchema() - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
- getSchema() - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getSchema() - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
- getShort(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultShortVector
-
Get the value at given
rowId. - getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getSize() - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
- getSize() - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
- getSize() - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getSize() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getSize() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getSize() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getString(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
- getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultBinaryVector
-
Get the value at given
rowId. - getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
- getStruct(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
H
- HadoopFileIO - Class in io.delta.kernel.defaults.engine.hadoopio
-
Implementation of
FileIObased on Hadoop APIs. - HadoopFileIO(Configuration) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
- HadoopInputFile - Class in io.delta.kernel.defaults.engine.hadoopio
- HadoopInputFile(FileSystem, Path, long) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopInputFile
- HadoopOutputFile - Class in io.delta.kernel.defaults.engine.hadoopio
- HadoopOutputFile(Configuration, String) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopOutputFile
- HadoopPositionOutputStream - Class in io.delta.kernel.defaults.engine.hadoopio
- HadoopPositionOutputStream(FSDataOutputStream) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
- HadoopSeekableInputStream - Class in io.delta.kernel.defaults.engine.hadoopio
- HadoopSeekableInputStream(FSDataInputStream) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
- hasDictionarySupport() - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BaseDecimalColumnReader
-
Dictionary support is an optional optimization to reduce BigDecimal instantiation and binary decoding (for Binary backed decimals).
I
- InExpressionEvaluator - Class in io.delta.kernel.defaults.internal.expressions
-
Utility methods to evaluate
INexpression. - init(InitContext) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
- InputFile - Interface in io.delta.kernel.defaults.engine.fileio
-
Interface for reading a file and getting metadata about it.
- invalidEscapeSequence(String, int) - Static method in class io.delta.kernel.defaults.internal.DefaultEngineErrors
-
Exception class for invalid escape sequence used in input for LIKE expressions
- io.delta.kernel.defaults.engine - package io.delta.kernel.defaults.engine
-
Default implementation of
Engineinterface and the sub-interfaces exposed by theEngine. - io.delta.kernel.defaults.engine.fileio - package io.delta.kernel.defaults.engine.fileio
- io.delta.kernel.defaults.engine.hadoopio - package io.delta.kernel.defaults.engine.hadoopio
- io.delta.kernel.defaults.internal - package io.delta.kernel.defaults.internal
- io.delta.kernel.defaults.internal.data - package io.delta.kernel.defaults.internal.data
- io.delta.kernel.defaults.internal.data.vector - package io.delta.kernel.defaults.internal.data.vector
- io.delta.kernel.defaults.internal.expressions - package io.delta.kernel.defaults.internal.expressions
- io.delta.kernel.defaults.internal.json - package io.delta.kernel.defaults.internal.json
- io.delta.kernel.defaults.internal.logstore - package io.delta.kernel.defaults.internal.logstore
- io.delta.kernel.defaults.internal.parquet - package io.delta.kernel.defaults.internal.parquet
- isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
- isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
-
Is the value at given
rowIdindex is null? - isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultBinaryVector
- isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultDecimalVector
- isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
- isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
- isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
J
- JsonUtils - Class in io.delta.kernel.defaults.internal.json
-
Utilities method to serialize and deserialize
Rowobjects with a limited set of data type values. - JsonUtils.RowSerializer - Class in io.delta.kernel.defaults.internal.json
L
- length() - Method in interface io.delta.kernel.defaults.engine.fileio.InputFile
-
Get the size of the file.
- length() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopInputFile
- LikeExpressionEvaluator - Class in io.delta.kernel.defaults.internal.expressions
-
Utility methods to evaluate
likeexpression. - listFrom(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
- listFrom(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
-
List the paths in the same directory that are lexicographically greater or equal to (UTF-8 sorting) the given `path`.
- listFrom(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
- LoggingMetricsReporter - Class in io.delta.kernel.defaults.engine
-
An implementation of
MetricsReporterthat logs the reports (as JSON) to Log4J at the info level. - LoggingMetricsReporter() - Constructor for class io.delta.kernel.defaults.engine.LoggingMetricsReporter
- LogStoreProvider - Class in io.delta.kernel.defaults.internal.logstore
-
Utility class to provide the correct
LogStorebased on the scheme of the path. - LogStoreProvider() - Constructor for class io.delta.kernel.defaults.internal.logstore.LogStoreProvider
M
- millisToMicros(long) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
- mkdirs(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
- mkdirs(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
-
Create a directory at the given path including parent directories.
- mkdirs(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
- multiFileWriter(FileIO, String, List<Column>) - Static method in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
-
Create writer to write data into one or more files depending upon the
delta.kernel.default.parquet.writer.targetMaxFileSizevalue and the given data.
N
- newInputFile(String, long) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
-
Get an
InputFilefor file at given path which can be used to read the file from any arbitrary position in the file. - newInputFile(String, long) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
- newOutputFile(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
-
Create a
OutputFileto write new file at the given path. - newOutputFile(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
- newStream() - Method in interface io.delta.kernel.defaults.engine.fileio.InputFile
-
Get the input stream to read the file.
- newStream() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopInputFile
O
- OutputFile - Interface in io.delta.kernel.defaults.engine.fileio
-
Interface for writing to a file and getting metadata about it.
P
- ParquetFileReader - Class in io.delta.kernel.defaults.internal.parquet
- ParquetFileReader(FileIO) - Constructor for class io.delta.kernel.defaults.internal.parquet.ParquetFileReader
- ParquetFileReader.BatchReadSupport - Class in io.delta.kernel.defaults.internal.parquet
-
Implement a
ReadSupportthat will collect the data for each row and return as aColumnarBatch. - ParquetFileReader.RowRecordCollector - Class in io.delta.kernel.defaults.internal.parquet
-
Collects the records given by the Parquet reader as columnar data.
- ParquetFileWriter - Class in io.delta.kernel.defaults.internal.parquet
-
Implements writing data given as
FilteredColumnarBatchto Parquet files. - ParquetFilterUtils - Class in io.delta.kernel.defaults.internal.parquet
-
Utilities to convert the Kernel
Predicateinto `parquet-mr`FilterPredicate. - ParquetIOUtils - Class in io.delta.kernel.defaults.internal.parquet
-
Utilities related to Parquet I/O.
- ParquetStatsReader - Class in io.delta.kernel.defaults.internal.parquet
-
Helper class to read statistics from Parquet files.
- ParquetStatsReader() - Constructor for class io.delta.kernel.defaults.internal.parquet.ParquetStatsReader
- parseJson(ColumnVector, StructType, Optional<ColumnVector>) - Method in class io.delta.kernel.defaults.engine.DefaultJsonHandler
- parseTimestampNTZ(String) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
-
Parses a TimestampNTZ string in UTC format, supporting milliseconds and microseconds, to microseconds since the Unix epoch.
- path() - Method in interface io.delta.kernel.defaults.engine.fileio.InputFile
-
Get the path of the file.
- path() - Method in interface io.delta.kernel.defaults.engine.fileio.OutputFile
-
Get the path of the file.
- path() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopInputFile
- path() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopOutputFile
- PositionOutputStream - Class in io.delta.kernel.defaults.engine.fileio
-
Extends
OutputStreamto provide the current position in the stream. - PositionOutputStream() - Constructor for class io.delta.kernel.defaults.engine.fileio.PositionOutputStream
- prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
R
- read() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
- read(byte[]) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
- read(byte[], int, int) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
- read(FileStatus, StructType, Optional<Predicate>) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader
- readDataFileStatistics(InputFile, StructType, List<Column>) - Static method in class io.delta.kernel.defaults.internal.parquet.ParquetStatsReader
-
Read the statistics for the given Parquet file.
- readFiles(CloseableIterator<FileReadRequest>) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
- readFully(byte[], int, int) - Method in class io.delta.kernel.defaults.engine.fileio.SeekableInputStream
-
Read fully len bytes into the buffer b.
- readFully(byte[], int, int) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
- readJsonFiles(CloseableIterator<FileStatus>, StructType, Optional<Predicate>) - Method in class io.delta.kernel.defaults.engine.DefaultJsonHandler
- readParquetFiles(CloseableIterator<FileStatus>, StructType, Optional<Predicate>) - Method in class io.delta.kernel.defaults.engine.DefaultParquetHandler
- report(MetricsReport) - Method in class io.delta.kernel.defaults.engine.LoggingMetricsReporter
- resizeIfNeeded() - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BaseDecimalColumnReader
- resolvePath(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
- resolvePath(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
-
Resolve the given path to a fully qualified path.
- resolvePath(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
- rowFromJson(String, StructType) - Static method in class io.delta.kernel.defaults.internal.json.JsonUtils
-
Converts a JSON string to a
Row. - RowRecordCollector(int, StructType, MessageType) - Constructor for class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
- RowSerializer() - Constructor for class io.delta.kernel.defaults.internal.json.JsonUtils.RowSerializer
- rowToJson(Row) - Static method in class io.delta.kernel.defaults.internal.json.JsonUtils
-
Converts a
Rowto a single line JSON string.
S
- seek(long) - Method in class io.delta.kernel.defaults.engine.fileio.SeekableInputStream
-
Seek to a new position in the stream.
- seek(long) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
- SeekableInputStream - Class in io.delta.kernel.defaults.engine.fileio
-
Extends
InputStreamto provide the current position in the stream and seek to a new position. - SeekableInputStream() - Constructor for class io.delta.kernel.defaults.engine.fileio.SeekableInputStream
- serialize(Row, JsonGenerator, SerializerProvider) - Method in class io.delta.kernel.defaults.internal.json.JsonUtils.RowSerializer
- setDictionary(Dictionary) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BinaryDictionaryAwareDecimalColumnReader
- setDictionary(Dictionary) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.IntDictionaryAwareDecimalColumnReader
- setDictionary(Dictionary) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.LongDictionaryAwareDecimalColumnReader
- singleFileWriter(FileIO, String, boolean, List<Column>) - Static method in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
-
Create writer to write the data exactly into one file.
- skip(long) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
- skipCurrentRecord() - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
- StartsWithExpressionEvaluator - Class in io.delta.kernel.defaults.internal.expressions
- StartsWithExpressionEvaluator() - Constructor for class io.delta.kernel.defaults.internal.expressions.StartsWithExpressionEvaluator
- SubstringEvaluator - Class in io.delta.kernel.defaults.internal.expressions
-
Utility methods to evaluate
substringexpression.
T
- TARGET_FILE_SIZE_CONF - Static variable in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
- TimestampConverters - Class in io.delta.kernel.defaults.internal.parquet
-
Column readers for columns of types
timestmap, timestamp_ntz. - TimestampConverters() - Constructor for class io.delta.kernel.defaults.internal.parquet.TimestampConverters
- TimestampConverters.DateToTimestampNTZConverter - Class in io.delta.kernel.defaults.internal.parquet
- TimestampConverters.TimestampBinaryConverter - Class in io.delta.kernel.defaults.internal.parquet
- TimestampConverters.TimestampMillisConverter - Class in io.delta.kernel.defaults.internal.parquet
- toJulianDay(long) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
-
Returns Julian day and remaining nanoseconds from the number of microseconds
- toParquetFilter(MessageType, Predicate) - Static method in class io.delta.kernel.defaults.internal.parquet.ParquetFilterUtils
-
Convert the given Kernel predicate
kernelPredicateinto `parquet-mr` predicate.
U
- unsupportedExpressionException(Expression, String) - Static method in class io.delta.kernel.defaults.internal.DefaultEngineErrors
-
Exception for when the default expression evaluator cannot evaluate an expression.
W
- withDeletedColumnAt(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
- withDeletedColumnAt(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
-
TODO this implementation sucks
- withNewColumn(int, StructField, ColumnVector) - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
- withNewColumn(int, StructField, ColumnVector) - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
- withNewSchema(StructType) - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
- write(byte[]) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
- write(byte[], int, int) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
- write(int) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
- write(CloseableIterator<FilteredColumnarBatch>) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
-
Write the given data to Parquet files.
- writeAtomically(CloseableIterator<String>, boolean) - Method in interface io.delta.kernel.defaults.engine.fileio.OutputFile
-
Atomically write (either write is completely or don't write all - i.e.
- writeAtomically(CloseableIterator<String>, boolean) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopOutputFile
- writeJsonFileAtomically(String, CloseableIterator<Row>, boolean) - Method in class io.delta.kernel.defaults.engine.DefaultJsonHandler
-
Makes use of
LogStoreimplementations in `delta-storage` to atomically write the data to a file depending upon the destination filesystem. - writeParquetFileAtomically(String, CloseableIterator<FilteredColumnarBatch>) - Method in class io.delta.kernel.defaults.engine.DefaultParquetHandler
-
Makes use of
LogStoreimplementations in `delta-storage` to atomically write the data to a file depending upon the destination filesystem. - writeParquetFiles(String, CloseableIterator<FilteredColumnarBatch>, List<Column>) - Method in class io.delta.kernel.defaults.engine.DefaultParquetHandler
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form