Class ByteStreamSplitValuesWriter

java.lang.Object
org.apache.parquet.column.values.ValuesWriter
org.apache.parquet.column.values.bytestreamsplit.ByteStreamSplitValuesWriter
All Implemented Interfaces:
AutoCloseable
Direct Known Subclasses:
ByteStreamSplitValuesWriter.DoubleByteStreamSplitValuesWriter, ByteStreamSplitValuesWriter.FixedLenByteArrayByteStreamSplitValuesWriter, ByteStreamSplitValuesWriter.FloatByteStreamSplitValuesWriter, ByteStreamSplitValuesWriter.IntegerByteStreamSplitValuesWriter, ByteStreamSplitValuesWriter.LongByteStreamSplitValuesWriter

public abstract class ByteStreamSplitValuesWriter extends ValuesWriter
  • Field Details

    • numStreams

      protected final int numStreams
    • elementSizeInBytes

      protected final int elementSizeInBytes
  • Constructor Details

    • ByteStreamSplitValuesWriter

      public ByteStreamSplitValuesWriter(int elementSizeInBytes, int initialCapacity, int pageSize, org.apache.parquet.bytes.ByteBufferAllocator allocator)
  • Method Details

    • getBufferedSize

      public long getBufferedSize()
      Description copied from class: ValuesWriter
      used to decide if we want to work to the next page
      Specified by:
      getBufferedSize in class ValuesWriter
      Returns:
      the size of the currently buffered data (in bytes)
    • getBytes

      public org.apache.parquet.bytes.BytesInput getBytes()
      Specified by:
      getBytes in class ValuesWriter
      Returns:
      the bytes buffered so far to write to the current page
    • getEncoding

      public Encoding getEncoding()
      Description copied from class: ValuesWriter
      called after getBytes() and before reset()
      Specified by:
      getEncoding in class ValuesWriter
      Returns:
      the encoding that was used to encode the bytes
    • reset

      public void reset()
      Description copied from class: ValuesWriter
      called after getBytes() to reset the current buffer and start writing the next page
      Specified by:
      reset in class ValuesWriter
    • close

      public void close()
      Description copied from class: ValuesWriter
      Called to close the values writer. Any output stream is closed and can no longer be used. All resources are released.
      Specified by:
      close in interface AutoCloseable
      Overrides:
      close in class ValuesWriter
    • scatterBytes

      protected void scatterBytes(byte[] bytes)
    • getAllocatedSize

      public long getAllocatedSize()
      Description copied from class: ValuesWriter
      Specified by:
      getAllocatedSize in class ValuesWriter
      Returns:
      the allocated size of the buffer