Index

A B C D E F G H I J L M N O P R S T U W 
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

AbstractColumnVector - Class in io.delta.kernel.defaults.internal.data.vector
Abstract implementation of ColumnVector that provides the default functionality common to most of the specific data type ColumnVector implementations.
addBinary(Binary) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BinaryDictionaryAwareDecimalColumnReader
 
addBinary(Binary) - Method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters.TimestampBinaryConverter
 
addInt(int) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.IntDictionaryAwareDecimalColumnReader
 
addInt(int) - Method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters.DateToTimestampNTZConverter
 
addLong(long) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.LongDictionaryAwareDecimalColumnReader
 
addLong(long) - Method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters.TimestampBinaryConverter
 
addLong(long) - Method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters.TimestampMillisConverter
 
addValueFromDictionary(int) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BaseDecimalColumnReader
 
available() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 

B

BatchReadSupport(int, StructType) - Constructor for class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
 

C

canNotInstantiateLogStore(String, String, Exception) - Static method in class io.delta.kernel.defaults.internal.DefaultEngineErrors
 
close() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
 
close() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 
close() - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
close() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
close() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
close() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
close() - Method in class io.delta.kernel.defaults.internal.expressions.DefaultExpressionEvaluator
 
copyFileAtomically(String, String, boolean) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
 
copyFileAtomically(String, String, boolean) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
Atomically copy a file from source path to destination path.
copyFileAtomically(String, String, boolean) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 
create(boolean) - Method in interface io.delta.kernel.defaults.engine.fileio.OutputFile
Get the output stream to write to the file.
create(boolean) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopOutputFile
 
create(FileIO) - Static method in class io.delta.kernel.defaults.engine.DefaultEngine
Create an instance of DefaultEngine.
create(Configuration) - Static method in class io.delta.kernel.defaults.engine.DefaultEngine
Create an instance of DefaultEngine.
createDecimalConverter(int, DecimalType, Type) - Static method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader
 
createSelectionVector(boolean[], int, int) - Method in class io.delta.kernel.defaults.engine.DefaultExpressionHandler
 
createTimestampConverter(int, Type, DataType) - Static method in class io.delta.kernel.defaults.internal.parquet.TimestampConverters
Create a timestamp column type reader

D

daysToMicros(int, ZoneOffset) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
Converts a number of days since epoch (1970-01-01 00:00:00 UTC) to microseconds between epoch and start of the day in the given timezone.
DecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
Decimal column readers for materializing the column values from Parquet files into Kernels ColumnVector.
DecimalColumnReader() - Constructor for class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader
 
DecimalColumnReader.BaseDecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
 
DecimalColumnReader.BinaryDictionaryAwareDecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
 
DecimalColumnReader.IntDictionaryAwareDecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
 
DecimalColumnReader.LongDictionaryAwareDecimalColumnReader - Class in io.delta.kernel.defaults.internal.parquet
 
DEFAULT_TARGET_FILE_SIZE - Static variable in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
 
DefaultArrayVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for array type data.
DefaultArrayVector(int, DataType, Optional<boolean[]>, int[], ColumnVector) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultArrayVector
Create an instance of ColumnVector for array type.
DefaultBinaryVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for binary type data.
DefaultBinaryVector(DataType, int, byte[][]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultBinaryVector
Create an instance of ColumnVector for binary type.
DefaultBooleanVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for boolean type data.
DefaultBooleanVector(int, Optional<boolean[]>, boolean[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultBooleanVector
Create an instance of ColumnVector for boolean type.
DefaultByteVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for byte type data.
DefaultByteVector(int, Optional<boolean[]>, byte[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultByteVector
Create an instance of ColumnVector for byte type.
DefaultColumnarBatch - Class in io.delta.kernel.defaults.internal.data
 
DefaultColumnarBatch(int, StructType, ColumnVector[]) - Constructor for class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
 
DefaultConstantVector - Class in io.delta.kernel.defaults.internal.data.vector
 
DefaultConstantVector(DataType, int, Object) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultConstantVector
 
DefaultDecimalVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for decimal type data.
DefaultDecimalVector(DataType, int, BigDecimal[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultDecimalVector
Create an instance of ColumnVector for decimal type.
DefaultDoubleVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for double type data.
DefaultDoubleVector(int, Optional<boolean[]>, double[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultDoubleVector
Create an instance of ColumnVector for float type.
DefaultEngine - Class in io.delta.kernel.defaults.engine
Default implementation of Engine based on Hadoop APIs.
DefaultEngineErrors - Class in io.delta.kernel.defaults.internal
 
DefaultEngineErrors() - Constructor for class io.delta.kernel.defaults.internal.DefaultEngineErrors
 
DefaultExpressionEvaluator - Class in io.delta.kernel.defaults.internal.expressions
Implementation of ExpressionEvaluator for default ExpressionHandler.
DefaultExpressionEvaluator(StructType, Expression, DataType) - Constructor for class io.delta.kernel.defaults.internal.expressions.DefaultExpressionEvaluator
Create a DefaultExpressionEvaluator instance bound to the given expression and inputSchem.
DefaultExpressionHandler - Class in io.delta.kernel.defaults.engine
Default implementation of ExpressionHandler
DefaultExpressionHandler() - Constructor for class io.delta.kernel.defaults.engine.DefaultExpressionHandler
 
DefaultFileSystemClient - Class in io.delta.kernel.defaults.engine
Default implementation of FileSystemClient based on Hadoop APIs.
DefaultFileSystemClient(FileIO) - Constructor for class io.delta.kernel.defaults.engine.DefaultFileSystemClient
Create an instance of the default FileSystemClient implementation.
DefaultFloatVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for float type data.
DefaultFloatVector(int, Optional<boolean[]>, float[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultFloatVector
Create an instance of ColumnVector for float type.
DefaultGenericVector - Class in io.delta.kernel.defaults.internal.data.vector
Generic column vector implementation to expose an array of objects as a column vector.
DefaultIntVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for integer type data.
DefaultIntVector(DataType, int, Optional<boolean[]>, int[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultIntVector
Create an instance of ColumnVector for integer type.
DefaultJsonHandler - Class in io.delta.kernel.defaults.engine
Default implementation of JsonHandler based on Hadoop APIs.
DefaultJsonHandler(FileIO) - Constructor for class io.delta.kernel.defaults.engine.DefaultJsonHandler
 
DefaultJsonRow - Class in io.delta.kernel.defaults.internal.data
 
DefaultJsonRow(ObjectNode, StructType) - Constructor for class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
DefaultKernelUtils - Class in io.delta.kernel.defaults.internal
 
DefaultLongVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for long, timestamp or timestamp_ntz type data.
DefaultLongVector(DataType, int, Optional<boolean[]>, long[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultLongVector
Create an instance of ColumnVector for long type.
DefaultMapVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for map type data.
DefaultMapVector(int, DataType, Optional<boolean[]>, int[], ColumnVector, ColumnVector) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultMapVector
Create an instance of ColumnVector for map type.
DefaultParquetHandler - Class in io.delta.kernel.defaults.engine
Default implementation of ParquetHandler based on Hadoop APIs.
DefaultParquetHandler(FileIO) - Constructor for class io.delta.kernel.defaults.engine.DefaultParquetHandler
Create an instance of default ParquetHandler implementation.
DefaultPredicateEvaluator - Class in io.delta.kernel.defaults.internal.expressions
Default implementation of PredicateEvaluator.
DefaultPredicateEvaluator(StructType, Predicate) - Constructor for class io.delta.kernel.defaults.internal.expressions.DefaultPredicateEvaluator
 
DefaultRowBasedColumnarBatch - Class in io.delta.kernel.defaults.internal.data
ColumnarBatch wrapper around list of Row objects.
DefaultRowBasedColumnarBatch(StructType, List<Row>) - Constructor for class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
 
DefaultShortVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for short type data.
DefaultShortVector(int, Optional<boolean[]>, short[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultShortVector
Create an instance of ColumnVector for short type.
DefaultStructVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector implementation for struct type data.
DefaultStructVector(int, DataType, Optional<boolean[]>, ColumnVector[]) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultStructVector
Create an instance of ColumnVector for struct type.
DefaultSubFieldVector - Class in io.delta.kernel.defaults.internal.data.vector
ColumnVector wrapper on top of Row objects.
DefaultSubFieldVector(int, DataType, int, Function<Integer, Row>) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
Create an instance of DefaultSubFieldVector
DefaultViewVector - Class in io.delta.kernel.defaults.internal.data.vector
Provides a restricted view on an underlying column vector.
DefaultViewVector(ColumnVector, int, int) - Constructor for class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
delete(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
 
delete(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
Delete the file at given path.
delete(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 

E

eval(ColumnarBatch) - Method in class io.delta.kernel.defaults.internal.expressions.DefaultExpressionEvaluator
 
eval(ColumnarBatch, Optional<ColumnVector>) - Method in class io.delta.kernel.defaults.internal.expressions.DefaultPredicateEvaluator
 

F

FileIO - Interface in io.delta.kernel.defaults.engine.fileio
Interface for file IO operations.
finalizeCurrentRow(long) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
 
finalizeCurrentRow(long) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
Finalize the current row.
flush() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
 
fromArray(DataType, Object[]) - Static method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
fromJulianDay(int, long) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
Returns the number of microseconds since epoch from Julian day and nanoseconds in a day.
fromList(DataType, List<Object>) - Static method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 

G

getArray(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultArrayVector
Get the value at given rowId.
getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getArray(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultBinaryVector
Get the value at given rowId.
getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getBinary(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultBooleanVector
Get the value at given rowId.
getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getBoolean(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getByte(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultByteVector
Get the value at given rowId.
getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getByte(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getChild(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getChild(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultStructVector
 
getChild(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getChild(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getColumnVector(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
 
getColumnVector(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
 
getConf(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
Get the configuration value for the given key.
getConf(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 
getCurrentRecord() - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
Return a fake object.
getDataAsColumnarBatch(int) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
 
getDataAsColumnarBatch(int) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
Return the data collected so far as a ColumnarBatch.
getDataColumnVector(int) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BaseDecimalColumnReader
 
getDataType() - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getDataType() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getDataType() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getDataType() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getDataType(StructType, Column) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
Search for the data type of the given column in the schema.
getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultDecimalVector
 
getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getDecimal(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultDoubleVector
Get the value at given rowId.
getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getDouble(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getEvaluator(StructType, Expression, DataType) - Method in class io.delta.kernel.defaults.engine.DefaultExpressionHandler
 
getExpressionHandler() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
 
getFileStatus(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
 
getFileStatus(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
Get the metadata of the file at the given path.
getFileStatus(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 
getFileSystemClient() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
 
getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultFloatVector
Get the value at given rowId.
getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getFloat(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getInt(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultIntVector
Get the value at given rowId.
getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getInt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getJsonHandler() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
 
getLogStore(Configuration, String) - Static method in class io.delta.kernel.defaults.internal.logstore.LogStoreProvider
Get the LogStore instance for the given scheme and configuration.
getLong(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultLongVector
Get the value at given rowId.
getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getLong(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getMap(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultMapVector
Get the value at given rowId.
getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getMap(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getMetricsReporters() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
 
getParquetHandler() - Method in class io.delta.kernel.defaults.engine.DefaultEngine
 
getPos() - Method in class io.delta.kernel.defaults.engine.fileio.PositionOutputStream
Get the current position in the stream.
getPos() - Method in class io.delta.kernel.defaults.engine.fileio.SeekableInputStream
Get the current position in the stream.
getPos() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
 
getPos() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 
getPredicateEvaluator(StructType, Predicate) - Method in class io.delta.kernel.defaults.engine.DefaultExpressionHandler
 
getRootConverter() - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
 
getSchema() - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
 
getSchema() - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getSchema() - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
 
getShort(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultShortVector
Get the value at given rowId.
getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getShort(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getSize() - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
 
getSize() - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
 
getSize() - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getSize() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getSize() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getSize() - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getString(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
 
getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultBinaryVector
Get the value at given rowId.
getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
getString(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 
getStruct(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 

H

HadoopFileIO - Class in io.delta.kernel.defaults.engine.hadoopio
Implementation of FileIO based on Hadoop APIs.
HadoopFileIO(Configuration) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 
HadoopInputFile - Class in io.delta.kernel.defaults.engine.hadoopio
 
HadoopInputFile(FileSystem, Path, long) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopInputFile
 
HadoopOutputFile - Class in io.delta.kernel.defaults.engine.hadoopio
 
HadoopOutputFile(Configuration, String) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopOutputFile
 
HadoopPositionOutputStream - Class in io.delta.kernel.defaults.engine.hadoopio
 
HadoopPositionOutputStream(FSDataOutputStream) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
 
HadoopSeekableInputStream - Class in io.delta.kernel.defaults.engine.hadoopio
 
HadoopSeekableInputStream(FSDataInputStream) - Constructor for class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 
hasDictionarySupport() - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BaseDecimalColumnReader
Dictionary support is an optional optimization to reduce BigDecimal instantiation and binary decoding (for Binary backed decimals).

I

InExpressionEvaluator - Class in io.delta.kernel.defaults.internal.expressions
Utility methods to evaluate IN expression.
init(InitContext) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
 
InputFile - Interface in io.delta.kernel.defaults.engine.fileio
Interface for reading a file and getting metadata about it.
invalidEscapeSequence(String, int) - Static method in class io.delta.kernel.defaults.internal.DefaultEngineErrors
Exception class for invalid escape sequence used in input for LIKE expressions
io.delta.kernel.defaults.engine - package io.delta.kernel.defaults.engine
Default implementation of Engine interface and the sub-interfaces exposed by the Engine.
io.delta.kernel.defaults.engine.fileio - package io.delta.kernel.defaults.engine.fileio
 
io.delta.kernel.defaults.engine.hadoopio - package io.delta.kernel.defaults.engine.hadoopio
 
io.delta.kernel.defaults.internal - package io.delta.kernel.defaults.internal
 
io.delta.kernel.defaults.internal.data - package io.delta.kernel.defaults.internal.data
 
io.delta.kernel.defaults.internal.data.vector - package io.delta.kernel.defaults.internal.data.vector
 
io.delta.kernel.defaults.internal.expressions - package io.delta.kernel.defaults.internal.expressions
 
io.delta.kernel.defaults.internal.json - package io.delta.kernel.defaults.internal.json
 
io.delta.kernel.defaults.internal.logstore - package io.delta.kernel.defaults.internal.logstore
 
io.delta.kernel.defaults.internal.parquet - package io.delta.kernel.defaults.internal.parquet
 
isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultJsonRow
 
isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.AbstractColumnVector
Is the value at given rowId index is null?
isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultBinaryVector
 
isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultDecimalVector
 
isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultGenericVector
 
isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultSubFieldVector
 
isNullAt(int) - Method in class io.delta.kernel.defaults.internal.data.vector.DefaultViewVector
 

J

JsonUtils - Class in io.delta.kernel.defaults.internal.json
Utilities method to serialize and deserialize Row objects with a limited set of data type values.
JsonUtils.RowSerializer - Class in io.delta.kernel.defaults.internal.json
 

L

length() - Method in interface io.delta.kernel.defaults.engine.fileio.InputFile
Get the size of the file.
length() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopInputFile
 
LikeExpressionEvaluator - Class in io.delta.kernel.defaults.internal.expressions
Utility methods to evaluate like expression.
listFrom(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
 
listFrom(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
List the paths in the same directory that are lexicographically greater or equal to (UTF-8 sorting) the given `path`.
listFrom(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 
LoggingMetricsReporter - Class in io.delta.kernel.defaults.engine
An implementation of MetricsReporter that logs the reports (as JSON) to Log4J at the info level.
LoggingMetricsReporter() - Constructor for class io.delta.kernel.defaults.engine.LoggingMetricsReporter
 
LogStoreProvider - Class in io.delta.kernel.defaults.internal.logstore
Utility class to provide the correct LogStore based on the scheme of the path.
LogStoreProvider() - Constructor for class io.delta.kernel.defaults.internal.logstore.LogStoreProvider
 

M

millisToMicros(long) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
 
mkdirs(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
 
mkdirs(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
Create a directory at the given path including parent directories.
mkdirs(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 
multiFileWriter(FileIO, String, List<Column>) - Static method in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
Create writer to write data into one or more files depending upon the delta.kernel.default.parquet.writer.targetMaxFileSize value and the given data.

N

newInputFile(String, long) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
Get an InputFile for file at given path which can be used to read the file from any arbitrary position in the file.
newInputFile(String, long) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 
newOutputFile(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
Create a OutputFile to write new file at the given path.
newOutputFile(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 
newStream() - Method in interface io.delta.kernel.defaults.engine.fileio.InputFile
Get the input stream to read the file.
newStream() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopInputFile
 

O

OutputFile - Interface in io.delta.kernel.defaults.engine.fileio
Interface for writing to a file and getting metadata about it.

P

ParquetFileReader - Class in io.delta.kernel.defaults.internal.parquet
 
ParquetFileReader(FileIO) - Constructor for class io.delta.kernel.defaults.internal.parquet.ParquetFileReader
 
ParquetFileReader.BatchReadSupport - Class in io.delta.kernel.defaults.internal.parquet
Implement a ReadSupport that will collect the data for each row and return as a ColumnarBatch.
ParquetFileReader.RowRecordCollector - Class in io.delta.kernel.defaults.internal.parquet
Collects the records given by the Parquet reader as columnar data.
ParquetFileWriter - Class in io.delta.kernel.defaults.internal.parquet
Implements writing data given as FilteredColumnarBatch to Parquet files.
ParquetFilterUtils - Class in io.delta.kernel.defaults.internal.parquet
Utilities to convert the Kernel Predicate into `parquet-mr` FilterPredicate.
ParquetIOUtils - Class in io.delta.kernel.defaults.internal.parquet
Utilities related to Parquet I/O.
ParquetStatsReader - Class in io.delta.kernel.defaults.internal.parquet
Helper class to read statistics from Parquet files.
ParquetStatsReader() - Constructor for class io.delta.kernel.defaults.internal.parquet.ParquetStatsReader
 
parseJson(ColumnVector, StructType, Optional<ColumnVector>) - Method in class io.delta.kernel.defaults.engine.DefaultJsonHandler
 
parseTimestampNTZ(String) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
Parses a TimestampNTZ string in UTC format, supporting milliseconds and microseconds, to microseconds since the Unix epoch.
path() - Method in interface io.delta.kernel.defaults.engine.fileio.InputFile
Get the path of the file.
path() - Method in interface io.delta.kernel.defaults.engine.fileio.OutputFile
Get the path of the file.
path() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopInputFile
 
path() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopOutputFile
 
PositionOutputStream - Class in io.delta.kernel.defaults.engine.fileio
Extends OutputStream to provide the current position in the stream.
PositionOutputStream() - Constructor for class io.delta.kernel.defaults.engine.fileio.PositionOutputStream
 
prepareForRead(Configuration, Map<String, String>, MessageType, ReadSupport.ReadContext) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
 

R

read() - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 
read(byte[]) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 
read(byte[], int, int) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 
read(FileStatus, StructType, Optional<Predicate>) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader
 
readDataFileStatistics(InputFile, StructType, List<Column>) - Static method in class io.delta.kernel.defaults.internal.parquet.ParquetStatsReader
Read the statistics for the given Parquet file.
readFiles(CloseableIterator<FileReadRequest>) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
 
readFully(byte[], int, int) - Method in class io.delta.kernel.defaults.engine.fileio.SeekableInputStream
Read fully len bytes into the buffer b.
readFully(byte[], int, int) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 
readJsonFiles(CloseableIterator<FileStatus>, StructType, Optional<Predicate>) - Method in class io.delta.kernel.defaults.engine.DefaultJsonHandler
 
readParquetFiles(CloseableIterator<FileStatus>, StructType, Optional<Predicate>) - Method in class io.delta.kernel.defaults.engine.DefaultParquetHandler
 
report(MetricsReport) - Method in class io.delta.kernel.defaults.engine.LoggingMetricsReporter
 
resizeIfNeeded() - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BaseDecimalColumnReader
 
resolvePath(String) - Method in class io.delta.kernel.defaults.engine.DefaultFileSystemClient
 
resolvePath(String) - Method in interface io.delta.kernel.defaults.engine.fileio.FileIO
Resolve the given path to a fully qualified path.
resolvePath(String) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopFileIO
 
rowFromJson(String, StructType) - Static method in class io.delta.kernel.defaults.internal.json.JsonUtils
Converts a JSON string to a Row.
RowRecordCollector(int, StructType, MessageType) - Constructor for class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
 
RowSerializer() - Constructor for class io.delta.kernel.defaults.internal.json.JsonUtils.RowSerializer
 
rowToJson(Row) - Static method in class io.delta.kernel.defaults.internal.json.JsonUtils
Converts a Row to a single line JSON string.

S

seek(long) - Method in class io.delta.kernel.defaults.engine.fileio.SeekableInputStream
Seek to a new position in the stream.
seek(long) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 
SeekableInputStream - Class in io.delta.kernel.defaults.engine.fileio
Extends InputStream to provide the current position in the stream and seek to a new position.
SeekableInputStream() - Constructor for class io.delta.kernel.defaults.engine.fileio.SeekableInputStream
 
serialize(Row, JsonGenerator, SerializerProvider) - Method in class io.delta.kernel.defaults.internal.json.JsonUtils.RowSerializer
 
setDictionary(Dictionary) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.BinaryDictionaryAwareDecimalColumnReader
 
setDictionary(Dictionary) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.IntDictionaryAwareDecimalColumnReader
 
setDictionary(Dictionary) - Method in class io.delta.kernel.defaults.internal.parquet.DecimalColumnReader.LongDictionaryAwareDecimalColumnReader
 
singleFileWriter(FileIO, String, boolean, List<Column>) - Static method in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
Create writer to write the data exactly into one file.
skip(long) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopSeekableInputStream
 
skipCurrentRecord() - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileReader.RowRecordCollector
 
StartsWithExpressionEvaluator - Class in io.delta.kernel.defaults.internal.expressions
 
StartsWithExpressionEvaluator() - Constructor for class io.delta.kernel.defaults.internal.expressions.StartsWithExpressionEvaluator
 
SubstringEvaluator - Class in io.delta.kernel.defaults.internal.expressions
Utility methods to evaluate substring expression.

T

TARGET_FILE_SIZE_CONF - Static variable in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
 
TimestampConverters - Class in io.delta.kernel.defaults.internal.parquet
Column readers for columns of types timestmap, timestamp_ntz.
TimestampConverters() - Constructor for class io.delta.kernel.defaults.internal.parquet.TimestampConverters
 
TimestampConverters.DateToTimestampNTZConverter - Class in io.delta.kernel.defaults.internal.parquet
 
TimestampConverters.TimestampBinaryConverter - Class in io.delta.kernel.defaults.internal.parquet
 
TimestampConverters.TimestampMillisConverter - Class in io.delta.kernel.defaults.internal.parquet
 
toJulianDay(long) - Static method in class io.delta.kernel.defaults.internal.DefaultKernelUtils
Returns Julian day and remaining nanoseconds from the number of microseconds
toParquetFilter(MessageType, Predicate) - Static method in class io.delta.kernel.defaults.internal.parquet.ParquetFilterUtils
Convert the given Kernel predicate kernelPredicate into `parquet-mr` predicate.

U

unsupportedExpressionException(Expression, String) - Static method in class io.delta.kernel.defaults.internal.DefaultEngineErrors
Exception for when the default expression evaluator cannot evaluate an expression.

W

withDeletedColumnAt(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
 
withDeletedColumnAt(int) - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
TODO this implementation sucks
withNewColumn(int, StructField, ColumnVector) - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
 
withNewColumn(int, StructField, ColumnVector) - Method in class io.delta.kernel.defaults.internal.data.DefaultRowBasedColumnarBatch
 
withNewSchema(StructType) - Method in class io.delta.kernel.defaults.internal.data.DefaultColumnarBatch
 
write(byte[]) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
 
write(byte[], int, int) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
 
write(int) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopPositionOutputStream
 
write(CloseableIterator<FilteredColumnarBatch>) - Method in class io.delta.kernel.defaults.internal.parquet.ParquetFileWriter
Write the given data to Parquet files.
writeAtomically(CloseableIterator<String>, boolean) - Method in interface io.delta.kernel.defaults.engine.fileio.OutputFile
Atomically write (either write is completely or don't write all - i.e.
writeAtomically(CloseableIterator<String>, boolean) - Method in class io.delta.kernel.defaults.engine.hadoopio.HadoopOutputFile
 
writeJsonFileAtomically(String, CloseableIterator<Row>, boolean) - Method in class io.delta.kernel.defaults.engine.DefaultJsonHandler
Makes use of LogStore implementations in `delta-storage` to atomically write the data to a file depending upon the destination filesystem.
writeParquetFileAtomically(String, CloseableIterator<FilteredColumnarBatch>) - Method in class io.delta.kernel.defaults.engine.DefaultParquetHandler
Makes use of LogStore implementations in `delta-storage` to atomically write the data to a file depending upon the destination filesystem.
writeParquetFiles(String, CloseableIterator<FilteredColumnarBatch>, List<Column>) - Method in class io.delta.kernel.defaults.engine.DefaultParquetHandler
 
A B C D E F G H I J L M N O P R S T U W 
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form