Package com.lancedb.lance.spark.write

Class LanceBatchWrite

java.lang.Object
com.lancedb.lance.spark.write.LanceBatchWrite
All Implemented Interfaces:
org.apache.spark.sql.connector.write.BatchWrite
public class LanceBatchWrite extends Object implements org.apache.spark.sql.connector.write.BatchWrite

  • Nested Class Summary

    Nested Classes
    Modifier and Type
    Class
    Description
    static class 
    LanceBatchWrite.TaskCommit
     

  • Constructor Summary

    Constructors
    Constructor
    Description
    LanceBatchWrite(org.apache.spark.sql.types.StructType schema, LanceConfig config, boolean overwrite)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    abort(org.apache.spark.sql.connector.write.WriterCommitMessage[] messages)
     
    void
    commit(org.apache.spark.sql.connector.write.WriterCommitMessage[] messages)
     
    org.apache.spark.sql.connector.write.DataWriterFactory
    createBatchWriterFactory(org.apache.spark.sql.connector.write.PhysicalWriteInfo info)
     
    String
    toString()
     
    boolean
    useCommitCoordinator()
     

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    Methods inherited from interface org.apache.spark.sql.connector.write.BatchWrite

    onDataWriterCommit

  • Constructor Details

    • LanceBatchWrite

      public LanceBatchWrite(org.apache.spark.sql.types.StructType schema, LanceConfig config, boolean overwrite)

  • Method Details

    • createBatchWriterFactory

      public org.apache.spark.sql.connector.write.DataWriterFactory createBatchWriterFactory(org.apache.spark.sql.connector.write.PhysicalWriteInfo info)
      Specified by:
      createBatchWriterFactory in interface org.apache.spark.sql.connector.write.BatchWrite

    • useCommitCoordinator

      public boolean useCommitCoordinator()
      Specified by:
      useCommitCoordinator in interface org.apache.spark.sql.connector.write.BatchWrite

    • commit

      public void commit(org.apache.spark.sql.connector.write.WriterCommitMessage[] messages)
      Specified by:
      commit in interface org.apache.spark.sql.connector.write.BatchWrite

    • abort

      public void abort(org.apache.spark.sql.connector.write.WriterCommitMessage[] messages)
      Specified by:
      abort in interface org.apache.spark.sql.connector.write.BatchWrite

    • toString

      public String toString()
      Overrides:
      toString in class Object