Package com.lancedb.lance.spark.write

Class LanceDataWriter

java.lang.Object

com.lancedb.lance.spark.write.LanceDataWriter

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.spark.sql.connector.write.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

public class LanceDataWriter
extends Object
implements org.apache.spark.sql.connector.write.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	LanceDataWriter.WriterFactory

Constructor Summary

Constructors

Constructor	Description
LanceDataWriter(LanceArrowWriter arrowWriter, FutureTask<List<com.lancedb.lance.FragmentMetadata>> fragmentCreationTask, Thread fragmentCreationThread)

Method Summary

Modifier and Type	Method	Description
void	abort()
void	close()
org.apache.spark.sql.connector.write.WriterCommitMessage	commit()
void	write(org.apache.spark.sql.catalyst.InternalRow record)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.connector.write.DataWriter

currentMetricsValues

Constructor Details

LanceDataWriter

public LanceDataWriter(LanceArrowWriter arrowWriter,
 FutureTask<List<com.lancedb.lance.FragmentMetadata>> fragmentCreationTask,
 Thread fragmentCreationThread)

Method Details

write

public void write(org.apache.spark.sql.catalyst.InternalRow record)
           throws IOException

Specified by:

write in interface org.apache.spark.sql.connector.write.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Throws:

IOException

commit

public org.apache.spark.sql.connector.write.WriterCommitMessage commit()
                                                                throws IOException

Specified by:

commit in interface org.apache.spark.sql.connector.write.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Throws:

IOException

abort

public void abort()
           throws IOException

Specified by:

abort in interface org.apache.spark.sql.connector.write.DataWriter<org.apache.spark.sql.catalyst.InternalRow>

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Throws:

IOException