Uses of Class
com.lancedb.lance.spark.LanceConfig
Packages that use LanceConfig
Package
Description
-
Uses of LanceConfig in com.lancedb.lance.spark
Methods in com.lancedb.lance.spark that return LanceConfigModifier and TypeMethodDescriptionLanceDataset.config()static LanceConfigstatic LanceConfigstatic LanceConfigstatic LanceConfigLanceConfig.from(org.apache.spark.sql.util.CaseInsensitiveStringMap options) static LanceConfigMethods in com.lancedb.lance.spark with parameters of type LanceConfigModifier and TypeMethodDescriptionabstract LanceDatasetBaseLanceNamespaceSparkCatalog.createDataset(LanceConfig config, org.apache.spark.sql.types.StructType sparkSchema) abstract LanceDatasetLanceDataSource.createDataset(LanceConfig config, org.apache.spark.sql.types.StructType sparkSchema) static booleanSparkOptions.enableTopNPushDown(LanceConfig config) static com.lancedb.lance.ReadOptionsSparkOptions.genReadOptionFromConfig(LanceConfig config) static com.lancedb.lance.WriteParamsSparkOptions.genWriteParamsFromConfig(LanceConfig config) static intSparkOptions.getBatchSize(LanceConfig config) static booleanSparkOptions.overwrite(LanceConfig config) Constructors in com.lancedb.lance.spark with parameters of type LanceConfigModifierConstructorDescriptionLanceDataset(LanceConfig config, org.apache.spark.sql.types.StructType sparkSchema) Creates a Lance dataset. -
Uses of LanceConfig in com.lancedb.lance.spark.internal
Methods in com.lancedb.lance.spark.internal with parameters of type LanceConfigModifier and TypeMethodDescriptionstatic voidLanceDatasetAdapter.appendFragments(LanceConfig config, List<com.lancedb.lance.FragmentMetadata> fragments) static com.lancedb.lance.FragmentMetadataLanceDatasetAdapter.deleteRows(LanceConfig config, int fragmentId, List<Integer> rowIndexes) static voidLanceDatasetAdapter.dropDataset(LanceConfig config) LanceDatasetAdapter.getDatasetDataSize(LanceConfig config) LanceDatasetAdapter.getDatasetRowCount(LanceConfig config) LanceDatasetAdapter.getFragmentIds(LanceConfig config) static Optional<org.apache.spark.sql.types.StructType>LanceDatasetAdapter.getSchema(LanceConfig config) static voidLanceDatasetAdapter.overwriteFragments(LanceConfig config, List<com.lancedb.lance.FragmentMetadata> fragments, org.apache.spark.sql.types.StructType sparkSchema) static voidLanceDatasetAdapter.updateFragments(LanceConfig config, List<Long> removedFragmentIds, List<com.lancedb.lance.FragmentMetadata> updatedFragments, List<com.lancedb.lance.FragmentMetadata> newFragments) -
Uses of LanceConfig in com.lancedb.lance.spark.read
Methods in com.lancedb.lance.spark.read that return LanceConfigMethods in com.lancedb.lance.spark.read with parameters of type LanceConfigModifier and TypeMethodDescriptionstatic List<LanceSplit>LanceSplit.generateLanceSplits(LanceConfig config) Constructors in com.lancedb.lance.spark.read with parameters of type LanceConfigModifierConstructorDescriptionLanceInputPartition(org.apache.spark.sql.types.StructType schema, int partitionId, LanceSplit lanceSplit, LanceConfig config, Optional<String> whereCondition, Optional<Integer> limit, Optional<Integer> offset, Optional<List<com.lancedb.lance.ipc.ColumnOrdering>> topNSortOrders, Optional<org.apache.spark.sql.connector.expressions.aggregate.Aggregation> pushedAggregation, String scanId) LanceInputPartition(org.apache.spark.sql.types.StructType schema, int partitionId, LanceSplit lanceSplit, LanceConfig config, Optional<String> whereCondition, String scanId) LanceScan(org.apache.spark.sql.types.StructType schema, LanceConfig config, Optional<String> whereConditions, Optional<Integer> limit, Optional<Integer> offset, Optional<List<com.lancedb.lance.ipc.ColumnOrdering>> topNSortOrders, Optional<org.apache.spark.sql.connector.expressions.aggregate.Aggregation> pushedAggregation) LanceScanBuilder(org.apache.spark.sql.types.StructType schema, LanceConfig config) LanceStatistics(LanceConfig config) -
Uses of LanceConfig in com.lancedb.lance.spark.write
Constructors in com.lancedb.lance.spark.write with parameters of type LanceConfigModifierConstructorDescriptionLanceBatchWrite(org.apache.spark.sql.types.StructType schema, LanceConfig config, boolean overwrite) SparkWriteBuilder(org.apache.spark.sql.types.StructType schema, LanceConfig config) protectedWriterFactory(org.apache.spark.sql.types.StructType schema, LanceConfig config)