com.lancedb.lance.spark.read

Class LanceScan

java.lang.Object

com.lancedb.lance.spark.read.LanceScan

All Implemented Interfaces:

Serializable, org.apache.spark.sql.connector.read.Batch, org.apache.spark.sql.connector.read.Scan, org.apache.spark.sql.connector.read.SupportsReportStatistics, org.apache.spark.sql.internal.connector.SupportsMetadata

public class LanceScan
extends Object
implements org.apache.spark.sql.connector.read.Batch, org.apache.spark.sql.connector.read.Scan, org.apache.spark.sql.internal.connector.SupportsMetadata, org.apache.spark.sql.connector.read.SupportsReportStatistics, Serializable

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.spark.sql.connector.read.Scan

org.apache.spark.sql.connector.read.Scan.ColumnarSupportMode

Constructor Summary

Constructors

Constructor and Description
LanceScan(org.apache.spark.sql.types.StructType schema, LanceConfig config, Optional<String> whereConditions, Optional<Integer> limit, Optional<Integer> offset, Optional<List<ColumnOrdering>> topNSortOrders)

Method Summary

Modifier and Type	Method and Description
org.apache.spark.sql.connector.read.PartitionReaderFactory	createReaderFactory()
org.apache.spark.sql.connector.read.Statistics	estimateStatistics()
scala.collection.immutable.Map<String,String>	getMetaData()
org.apache.spark.sql.connector.read.InputPartition[]	planInputPartitions()
org.apache.spark.sql.types.StructType	readSchema()
org.apache.spark.sql.connector.read.Batch	toBatch()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.connector.read.Scan

columnarSupportMode, description, reportDriverMetrics, supportedCustomMetrics, toContinuousStream, toMicroBatchStream

Constructor Detail

LanceScan

public LanceScan(org.apache.spark.sql.types.StructType schema,
                 LanceConfig config,
                 Optional<String> whereConditions,
                 Optional<Integer> limit,
                 Optional<Integer> offset,
                 Optional<List<ColumnOrdering>> topNSortOrders)

Method Detail

toBatch

public org.apache.spark.sql.connector.read.Batch toBatch()

Specified by:

toBatch in interface org.apache.spark.sql.connector.read.Scan

planInputPartitions

public org.apache.spark.sql.connector.read.InputPartition[] planInputPartitions()

Specified by:

planInputPartitions in interface org.apache.spark.sql.connector.read.Batch

createReaderFactory

public org.apache.spark.sql.connector.read.PartitionReaderFactory createReaderFactory()

Specified by:

createReaderFactory in interface org.apache.spark.sql.connector.read.Batch

readSchema

public org.apache.spark.sql.types.StructType readSchema()

Specified by:

readSchema in interface org.apache.spark.sql.connector.read.Scan

getMetaData

public scala.collection.immutable.Map<String,String> getMetaData()

Specified by:

getMetaData in interface org.apache.spark.sql.internal.connector.SupportsMetadata

estimateStatistics

public org.apache.spark.sql.connector.read.Statistics estimateStatistics()

Specified by:

estimateStatistics in interface org.apache.spark.sql.connector.read.SupportsReportStatistics