Index

A B C D E F G H I L M N O P R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

abort() - Method in class com.lancedb.lance.spark.write.LanceDataWriter

abort(WriterCommitMessage[]) - Method in class com.lancedb.lance.spark.write.LanceBatchWrite

allocator - Static variable in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

alterNamespace(String[], NamespaceChange...) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

alterTable(Identifier, TableChange...) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

alterTable(Identifier, TableChange...) - Method in class com.lancedb.lance.spark.LanceCatalog

Deprecated.

appendFragments(LanceConfig, List<FragmentMetadata>) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

ARROW_FIXED_SIZE_LIST_SIZE_KEY - Static variable in class com.lancedb.lance.spark.utils.VectorUtils

B

BaseLanceNamespaceSparkCatalog - Class in com.lancedb.lance.spark

BaseLanceNamespaceSparkCatalog() - Constructor for class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

BLOB_POSITION_SUFFIX - Static variable in class com.lancedb.lance.spark.LanceConstant

BLOB_SIZE_SUFFIX - Static variable in class com.lancedb.lance.spark.LanceConstant

BlobPositionColumnVector - Class in org.apache.spark.sql.vectorized

A column vector that provides the position values from a blob struct.

BlobPositionColumnVector(BlobStructAccessor) - Constructor for class org.apache.spark.sql.vectorized.BlobPositionColumnVector

BlobSizeColumnVector - Class in org.apache.spark.sql.vectorized

A column vector that provides the size values from a blob struct.

BlobSizeColumnVector(BlobStructAccessor) - Constructor for class org.apache.spark.sql.vectorized.BlobSizeColumnVector

BlobStructAccessor - Class in org.apache.spark.sql.vectorized

BlobStructAccessor(StructVector) - Constructor for class org.apache.spark.sql.vectorized.BlobStructAccessor

BlobUtils - Class in com.lancedb.lance.spark.utils

BlobUtils() - Constructor for class com.lancedb.lance.spark.utils.BlobUtils

build() - Method in class com.lancedb.lance.spark.read.LanceScanBuilder

build() - Method in class com.lancedb.lance.spark.write.SparkWrite.SparkWriteBuilder

bytesRead() - Method in class com.lancedb.lance.spark.write.LanceArrowWriter

C

capabilities() - Method in class com.lancedb.lance.spark.LanceDataset

close() - Method in class com.lancedb.lance.spark.internal.LanceFragmentColumnarBatchScanner

close() - Method in class com.lancedb.lance.spark.internal.LanceFragmentScanner

close() - Method in class com.lancedb.lance.spark.read.LanceColumnarPartitionReader

close() - Method in class com.lancedb.lance.spark.read.LanceCountStarPartitionReader

close() - Method in class com.lancedb.lance.spark.read.LanceRowPartitionReader

close() - Method in class com.lancedb.lance.spark.write.LanceDataWriter

close() - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

close() - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

close() - Method in class org.apache.spark.sql.vectorized.BlobStructAccessor

close() - Method in class org.apache.spark.sql.vectorized.FixedSizeListAccessor

close() - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

closeReadSource() - Method in class com.lancedb.lance.spark.write.LanceArrowWriter

com.lancedb.lance.spark - package com.lancedb.lance.spark

com.lancedb.lance.spark.internal - package com.lancedb.lance.spark.internal

com.lancedb.lance.spark.read - package com.lancedb.lance.spark.read

com.lancedb.lance.spark.utils - package com.lancedb.lance.spark.utils

com.lancedb.lance.spark.write - package com.lancedb.lance.spark.write

commit() - Method in class com.lancedb.lance.spark.write.LanceDataWriter

commit(WriterCommitMessage[]) - Method in class com.lancedb.lance.spark.write.LanceBatchWrite

compileFiltersToSqlWhereClause(Filter[]) - Static method in class com.lancedb.lance.spark.read.FilterPushDown

Create SQL 'where clause' from Spark filters.

config() - Method in class com.lancedb.lance.spark.LanceDataset

CONFIG_DATASET_URI - Static variable in class com.lancedb.lance.spark.LanceConfig

CONFIG_PUSH_DOWN_FILTERS - Static variable in class com.lancedb.lance.spark.LanceConfig

create(int, LanceInputPartition) - Static method in class com.lancedb.lance.spark.internal.LanceFragmentColumnarBatchScanner

create(int, LanceInputPartition) - Static method in class com.lancedb.lance.spark.internal.LanceFragmentScanner

create(LanceInputPartition) - Static method in class com.lancedb.lance.spark.read.LanceRowPartitionReader

createBatchWriterFactory(PhysicalWriteInfo) - Method in class com.lancedb.lance.spark.write.LanceBatchWrite

createDataset(LanceConfig, StructType) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

createDataset(LanceConfig, StructType) - Method in class com.lancedb.lance.spark.LanceDataSource

createDataset(String, StructType, WriteParams) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

createFragment(String, ArrowReader, WriteParams) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

createNamespace(String[], Map<String, String>) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

createReaderFactory() - Method in class com.lancedb.lance.spark.read.LanceScan

createTable(Identifier, StructType, Transform[], Map<String, String>) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

createTable(Identifier, StructType, Transform[], Map<String, String>) - Method in class com.lancedb.lance.spark.LanceCatalog

Deprecated.

createVectorSizePropertyKey(String) - Static method in class com.lancedb.lance.spark.utils.VectorUtils

Create a property key for specifying vector dimensions in table properties.

createWriter(int, long) - Method in class com.lancedb.lance.spark.write.LanceDataWriter.WriterFactory

D

deleteRows(LanceConfig, int, List<Integer>) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

dropDataset(LanceConfig) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

dropNamespace(String[], boolean) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

dropTable(Identifier) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

dropTable(Identifier) - Method in class com.lancedb.lance.spark.LanceCatalog

Deprecated.

E

empty() - Static method in class com.lancedb.lance.spark.utils.Optional

enableTopNPushDown(LanceConfig) - Static method in class com.lancedb.lance.spark.SparkOptions

equals(Object) - Method in class com.lancedb.lance.spark.LanceConfig

equals(Object) - Method in class com.lancedb.lance.spark.utils.Optional

estimateStatistics() - Method in class com.lancedb.lance.spark.read.LanceScan

extractCatalog(CaseInsensitiveStringMap) - Method in class com.lancedb.lance.spark.LanceDataSource

extractIdentifier(CaseInsensitiveStringMap) - Method in class com.lancedb.lance.spark.LanceDataSource

F

FilterPushDown - Class in com.lancedb.lance.spark.read

FilterPushDown() - Constructor for class com.lancedb.lance.spark.read.FilterPushDown

FixedSizeListAccessor - Class in org.apache.spark.sql.vectorized

Accessor for FixedSizeListVector that provides array access for Spark.

FixedSizeListAccessor(FixedSizeListVector) - Constructor for class org.apache.spark.sql.vectorized.FixedSizeListAccessor

FRAGMENT_ID - Static variable in class com.lancedb.lance.spark.LanceConstant

fragmentId() - Method in class com.lancedb.lance.spark.internal.LanceFragmentScanner

from(String) - Static method in class com.lancedb.lance.spark.LanceConfig

from(Map<String, String>) - Static method in class com.lancedb.lance.spark.LanceConfig

from(Map<String, String>, String) - Static method in class com.lancedb.lance.spark.LanceConfig

from(CaseInsensitiveStringMap) - Static method in class com.lancedb.lance.spark.LanceConfig

from(CaseInsensitiveStringMap, String) - Static method in class com.lancedb.lance.spark.LanceConfig

G

generateLanceSplits(LanceConfig) - Static method in class com.lancedb.lance.spark.read.LanceSplit

genReadOptionFromConfig(LanceConfig) - Static method in class com.lancedb.lance.spark.SparkOptions

genWriteParamsFromConfig(LanceConfig) - Static method in class com.lancedb.lance.spark.SparkOptions

get() - Method in class com.lancedb.lance.spark.read.LanceColumnarPartitionReader

get() - Method in class com.lancedb.lance.spark.read.LanceCountStarPartitionReader

get() - Method in class com.lancedb.lance.spark.read.LanceRowPartitionReader

get() - Method in class com.lancedb.lance.spark.utils.Optional

getArray(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getArray(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getArray(int) - Method in class org.apache.spark.sql.vectorized.FixedSizeListAccessor

getArray(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getArrowReader() - Method in class com.lancedb.lance.spark.internal.LanceFragmentScanner

getArrowWriter(StructType, int) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

getBatchSize(LanceConfig) - Static method in class com.lancedb.lance.spark.SparkOptions

getBinary(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getBinary(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getBinary(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getBlobStructAccessor() - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

Returns the blob struct accessor if this column is a blob column.

getBoolean(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getBoolean(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getBoolean(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getByte(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getByte(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getByte(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getChild(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getChild(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getChild(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getConfig() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

getCurrentBatch() - Method in class com.lancedb.lance.spark.internal.LanceFragmentColumnarBatchScanner

getDatasetDataSize(LanceConfig) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

getDatasetName() - Method in class com.lancedb.lance.spark.LanceConfig

getDatasetRowCount(LanceConfig) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

getDatasetUri() - Method in class com.lancedb.lance.spark.LanceConfig

getDbPath() - Method in class com.lancedb.lance.spark.LanceConfig

getDecimal(int, int, int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getDecimal(int, int, int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getDecimal(int, int, int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getDouble(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getDouble(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getDouble(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getFloat(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getFloat(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getFloat(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getFragmentIds(LanceConfig) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

getFragments() - Method in class com.lancedb.lance.spark.read.LanceSplit

getFragmentScanner(int, LanceInputPartition) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

getInputPartition() - Method in class com.lancedb.lance.spark.internal.LanceFragmentScanner

getInt(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getInt(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getInt(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getLanceSplit() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

getLimit() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

getLong(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getLong(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getLong(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getMap(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getMap(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getMap(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getMetaData() - Method in class com.lancedb.lance.spark.read.LanceScan

getNullCount() - Method in class org.apache.spark.sql.vectorized.BlobStructAccessor

getNullCount() - Method in class org.apache.spark.sql.vectorized.FixedSizeListAccessor

getOffset() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

getOptions() - Method in class com.lancedb.lance.spark.LanceConfig

getPartitionId() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

getPosition(int) - Method in class org.apache.spark.sql.vectorized.BlobStructAccessor

getPushedAggregation() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

getScanId() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

getSchema() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

getSchema(LanceConfig) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

getSchema(String) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

getShort(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getShort(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getShort(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getSize(int) - Method in class org.apache.spark.sql.vectorized.BlobStructAccessor

getStruct(int) - Method in class org.apache.spark.sql.vectorized.BlobStructAccessor

getTable(StructType, Transform[], Map<String, String>) - Method in class com.lancedb.lance.spark.LanceDataSource

getTopNSortOrders() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

getUTF8String(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

getUTF8String(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

getUTF8String(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

getVectorArrowDimension(Field) - Static method in class com.lancedb.lance.spark.utils.VectorUtils

Get the vector dimension from an Arrow FixedSizeList field.

getVectorDimension(StructField) - Static method in class com.lancedb.lance.spark.utils.VectorUtils

Get the vector dimension from a Spark field's metadata.

getWhereCondition() - Method in class com.lancedb.lance.spark.read.LanceInputPartition

H

hadoopConfCatalogOverrides(SparkSession, String) - Static method in class com.lancedb.lance.spark.utils.SparkUtil

Pulls any Catalog specific overrides for the Hadoop conf from the current SparkSession, which can be set via `spark.sql.catalog.$catalogName.hadoop.*`

hashCode() - Method in class com.lancedb.lance.spark.LanceConfig

hashCode() - Method in class com.lancedb.lance.spark.utils.Optional

hasNull() - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

hasNull() - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

hasNull() - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

I

ifPresent(Consumer<? super T>) - Method in class com.lancedb.lance.spark.utils.Optional

inferSchema(CaseInsensitiveStringMap) - Method in class com.lancedb.lance.spark.LanceDataSource

initialize(String, CaseInsensitiveStringMap) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

initialize(String, CaseInsensitiveStringMap) - Method in class com.lancedb.lance.spark.LanceCatalog

Deprecated.

isBlobArrowField(Field) - Static method in class com.lancedb.lance.spark.utils.BlobUtils

Check if an Arrow field is a blob field based on its metadata.

isBlobSparkField(StructField) - Static method in class com.lancedb.lance.spark.utils.BlobUtils

Check if a Spark field is a blob field based on its metadata.

isEmpty() - Method in class com.lancedb.lance.spark.utils.Optional

isFilterSupported(Filter) - Static method in class com.lancedb.lance.spark.read.FilterPushDown

isNullAt(int) - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

isNullAt(int) - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

isNullAt(int) - Method in class org.apache.spark.sql.vectorized.BlobStructAccessor

isNullAt(int) - Method in class org.apache.spark.sql.vectorized.FixedSizeListAccessor

isNullAt(int) - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

isPartiallyPushed() - Method in class com.lancedb.lance.spark.read.LanceScanBuilder

isPresent() - Method in class com.lancedb.lance.spark.utils.Optional

isPushDownFilters() - Method in class com.lancedb.lance.spark.LanceConfig

isVectorArrowField(Field) - Static method in class com.lancedb.lance.spark.utils.VectorUtils

Check if an Arrow field is a vector field (FixedSizeList).

isVectorField(StructField) - Static method in class com.lancedb.lance.spark.utils.VectorUtils

Check if a Spark field is a vector field (FixedSizeList) based on its metadata.

L

LANCE_ENCODING_BLOB_KEY - Static variable in class com.lancedb.lance.spark.utils.BlobUtils

LANCE_ENCODING_BLOB_VALUE - Static variable in class com.lancedb.lance.spark.utils.BlobUtils

LANCE_FILE_SUFFIX - Static variable in class com.lancedb.lance.spark.LanceConfig

LanceArrowColumnVector - Class in org.apache.spark.sql.vectorized

LanceArrowColumnVector(ValueVector) - Constructor for class org.apache.spark.sql.vectorized.LanceArrowColumnVector

LanceArrowWriter - Class in com.lancedb.lance.spark.write

A custom arrow reader that supports writes Spark internal rows while reading data in batches.

LanceArrowWriter(BufferAllocator, Schema, StructType, int) - Constructor for class com.lancedb.lance.spark.write.LanceArrowWriter

LanceBatchWrite - Class in com.lancedb.lance.spark.write

LanceBatchWrite(StructType, LanceConfig, boolean) - Constructor for class com.lancedb.lance.spark.write.LanceBatchWrite

LanceBatchWrite.TaskCommit - Class in com.lancedb.lance.spark.write

LanceCatalog - Class in com.lancedb.lance.spark

Deprecated.

LanceCatalog() - Constructor for class com.lancedb.lance.spark.LanceCatalog

Deprecated.

LanceColumnarPartitionReader - Class in com.lancedb.lance.spark.read

LanceColumnarPartitionReader(LanceInputPartition) - Constructor for class com.lancedb.lance.spark.read.LanceColumnarPartitionReader

LanceConfig - Class in com.lancedb.lance.spark

Lance Configuration.

LanceConstant - Class in com.lancedb.lance.spark

LanceConstant() - Constructor for class com.lancedb.lance.spark.LanceConstant

LanceCountStarPartitionReader - Class in com.lancedb.lance.spark.read

Partition reader for pushed down aggregates.

LanceCountStarPartitionReader(LanceInputPartition) - Constructor for class com.lancedb.lance.spark.read.LanceCountStarPartitionReader

LanceDataset - Class in com.lancedb.lance.spark

Lance Spark Dataset.

LanceDataset(LanceConfig, StructType) - Constructor for class com.lancedb.lance.spark.LanceDataset

Creates a Lance dataset.

LanceDatasetAdapter - Class in com.lancedb.lance.spark.internal

LanceDatasetAdapter() - Constructor for class com.lancedb.lance.spark.internal.LanceDatasetAdapter

LanceDataSource - Class in com.lancedb.lance.spark

LanceDataSource() - Constructor for class com.lancedb.lance.spark.LanceDataSource

LanceDataWriter - Class in com.lancedb.lance.spark.write

LanceDataWriter(LanceArrowWriter, FutureTask<List<FragmentMetadata>>, Thread) - Constructor for class com.lancedb.lance.spark.write.LanceDataWriter

LanceDataWriter.WriterFactory - Class in com.lancedb.lance.spark.write

LanceFragmentColumnarBatchScanner - Class in com.lancedb.lance.spark.internal

LanceFragmentColumnarBatchScanner(LanceFragmentScanner, ArrowReader) - Constructor for class com.lancedb.lance.spark.internal.LanceFragmentColumnarBatchScanner

LanceFragmentScanner - Class in com.lancedb.lance.spark.internal

LanceIdentifier - Class in com.lancedb.lance.spark

LanceIdentifier(String) - Constructor for class com.lancedb.lance.spark.LanceIdentifier

LanceInputPartition - Class in com.lancedb.lance.spark.read

LanceInputPartition(StructType, int, LanceSplit, LanceConfig, Optional<String>, Optional<Integer>, Optional<Integer>, Optional<List<ColumnOrdering>>, Optional<Aggregation>, String) - Constructor for class com.lancedb.lance.spark.read.LanceInputPartition

LanceInputPartition(StructType, int, LanceSplit, LanceConfig, Optional<String>, String) - Constructor for class com.lancedb.lance.spark.read.LanceInputPartition

LanceRowPartitionReader - Class in com.lancedb.lance.spark.read

LanceRowPartitionReader(LanceColumnarPartitionReader) - Constructor for class com.lancedb.lance.spark.read.LanceRowPartitionReader

LanceScan - Class in com.lancedb.lance.spark.read

LanceScan(StructType, LanceConfig, Optional<String>, Optional<Integer>, Optional<Integer>, Optional<List<ColumnOrdering>>, Optional<Aggregation>) - Constructor for class com.lancedb.lance.spark.read.LanceScan

LanceScanBuilder - Class in com.lancedb.lance.spark.read

LanceScanBuilder(StructType, LanceConfig) - Constructor for class com.lancedb.lance.spark.read.LanceScanBuilder

LanceSplit - Class in com.lancedb.lance.spark.read

LanceSplit(List<Integer>) - Constructor for class com.lancedb.lance.spark.read.LanceSplit

LanceStatistics - Class in com.lancedb.lance.spark.read

LanceStatistics(LanceConfig) - Constructor for class com.lancedb.lance.spark.read.LanceStatistics

listNamespaces() - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

listNamespaces(String[]) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

listTables(String[]) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

listTables(String[]) - Method in class com.lancedb.lance.spark.LanceCatalog

Deprecated.

loadNamespaceMetadata(String[]) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

loadNextBatch() - Method in class com.lancedb.lance.spark.internal.LanceFragmentColumnarBatchScanner

loadNextBatch() - Method in class com.lancedb.lance.spark.write.LanceArrowWriter

loadTable(Identifier) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

loadTable(Identifier) - Method in class com.lancedb.lance.spark.LanceCatalog

Deprecated.

M

METADATA_COLUMNS - Static variable in class com.lancedb.lance.spark.LanceDataset

metadataColumns() - Method in class com.lancedb.lance.spark.LanceDataset

N

name - Static variable in class com.lancedb.lance.spark.LanceDataSource

name() - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

name() - Method in class com.lancedb.lance.spark.LanceCatalog

Deprecated.

name() - Method in class com.lancedb.lance.spark.LanceDataset

name() - Method in class com.lancedb.lance.spark.LanceIdentifier

namespace() - Method in class com.lancedb.lance.spark.LanceIdentifier

namespaceExists(String[]) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

newScanBuilder(CaseInsensitiveStringMap) - Method in class com.lancedb.lance.spark.LanceDataset

newWriteBuilder(LogicalWriteInfo) - Method in class com.lancedb.lance.spark.LanceDataset

next() - Method in class com.lancedb.lance.spark.read.LanceColumnarPartitionReader

next() - Method in class com.lancedb.lance.spark.read.LanceCountStarPartitionReader

next() - Method in class com.lancedb.lance.spark.read.LanceRowPartitionReader

numNulls() - Method in class org.apache.spark.sql.vectorized.BlobPositionColumnVector

numNulls() - Method in class org.apache.spark.sql.vectorized.BlobSizeColumnVector

numNulls() - Method in class org.apache.spark.sql.vectorized.LanceArrowColumnVector

numRows() - Method in class com.lancedb.lance.spark.read.LanceStatistics

O

of(T) - Static method in class com.lancedb.lance.spark.utils.Optional

ofNullable(T) - Static method in class com.lancedb.lance.spark.utils.Optional

Optional<T> - Class in com.lancedb.lance.spark.utils

org.apache.spark.sql.vectorized - package org.apache.spark.sql.vectorized

overwrite(LanceConfig) - Static method in class com.lancedb.lance.spark.SparkOptions

overwriteFragments(LanceConfig, List<FragmentMetadata>, StructType) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

P

planInputPartitions() - Method in class com.lancedb.lance.spark.read.LanceScan

prepareLoadNextBatch() - Method in class com.lancedb.lance.spark.write.LanceArrowWriter

processFilters(Filter[]) - Static method in class com.lancedb.lance.spark.read.FilterPushDown

processSchemaWithProperties(StructType, Map<String, String>) - Static method in class com.lancedb.lance.spark.utils.SchemaConverter

Processes a Spark schema with table properties to add metadata for vector and blob columns.

pruneColumns(StructType) - Method in class com.lancedb.lance.spark.read.LanceScanBuilder

pushAggregation(Aggregation) - Method in class com.lancedb.lance.spark.read.LanceScanBuilder

pushedFilters() - Method in class com.lancedb.lance.spark.read.LanceScanBuilder

pushFilters(Filter[]) - Method in class com.lancedb.lance.spark.read.LanceScanBuilder

pushLimit(int) - Method in class com.lancedb.lance.spark.read.LanceScanBuilder

pushOffset(int) - Method in class com.lancedb.lance.spark.read.LanceScanBuilder

pushTopN(SortOrder[], int) - Method in class com.lancedb.lance.spark.read.LanceScanBuilder

R

readSchema() - Method in class com.lancedb.lance.spark.read.LanceScan

readSchema() - Method in class com.lancedb.lance.spark.write.LanceArrowWriter

renameTable(Identifier, Identifier) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

renameTable(Identifier, Identifier) - Method in class com.lancedb.lance.spark.LanceCatalog

Deprecated.

ROW_ADDRESS - Static variable in class com.lancedb.lance.spark.LanceConstant

ROW_ID - Static variable in class com.lancedb.lance.spark.LanceConstant

S

schema() - Method in class com.lancedb.lance.spark.LanceDataset

SchemaConverter - Class in com.lancedb.lance.spark.utils

Utility class for converting Spark schema types to JsonArrow schema types used by the Lance Namespace API.

shortName() - Method in class com.lancedb.lance.spark.LanceDataSource

shouldBeFixedSizeList(DataType, Metadata) - Static method in class com.lancedb.lance.spark.utils.VectorUtils

Check if a Spark DataType should be treated as a FixedSizeList based on metadata.

sizeInBytes() - Method in class com.lancedb.lance.spark.read.LanceStatistics

SparkOptions - Class in com.lancedb.lance.spark

SparkOptions() - Constructor for class com.lancedb.lance.spark.SparkOptions

sparkSchema - Variable in class com.lancedb.lance.spark.LanceDataset

SparkUtil - Class in com.lancedb.lance.spark.utils

SparkUtil() - Constructor for class com.lancedb.lance.spark.utils.SparkUtil

SparkWrite - Class in com.lancedb.lance.spark.write

Spark write builder.

SparkWrite.SparkWriteBuilder - Class in com.lancedb.lance.spark.write

Task commit.

SparkWriteBuilder(StructType, LanceConfig) - Constructor for class com.lancedb.lance.spark.write.SparkWrite.SparkWriteBuilder

T

tableExists(Identifier) - Method in class com.lancedb.lance.spark.BaseLanceNamespaceSparkCatalog

toBatch() - Method in class com.lancedb.lance.spark.read.LanceScan

toBatch() - Method in class com.lancedb.lance.spark.write.SparkWrite

toJsonArrowSchema(StructType) - Static method in class com.lancedb.lance.spark.utils.SchemaConverter

Converts a Spark StructType to JsonArrowSchema.

toStandardOptional() - Method in class com.lancedb.lance.spark.utils.Optional

toStreaming() - Method in class com.lancedb.lance.spark.write.SparkWrite

toString() - Method in class com.lancedb.lance.spark.utils.Optional

toString() - Method in class com.lancedb.lance.spark.write.LanceBatchWrite

truncate() - Method in class com.lancedb.lance.spark.write.SparkWrite.SparkWriteBuilder

U

UInt8Accessor - Class in org.apache.spark.sql.vectorized

updateFragments(LanceConfig, List<Long>, List<FragmentMetadata>, List<FragmentMetadata>) - Static method in class com.lancedb.lance.spark.internal.LanceDatasetAdapter

useCommitCoordinator() - Method in class com.lancedb.lance.spark.write.LanceBatchWrite

V

VectorUtils - Class in com.lancedb.lance.spark.utils

VectorUtils() - Constructor for class com.lancedb.lance.spark.utils.VectorUtils

W

withFragemtId() - Method in class com.lancedb.lance.spark.internal.LanceFragmentScanner

write(InternalRow) - Method in class com.lancedb.lance.spark.write.LanceDataWriter

WriterFactory(StructType, LanceConfig) - Constructor for class com.lancedb.lance.spark.write.LanceDataWriter.WriterFactory

A B C D E F G H I L M N O P R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form