Package io.delta.kernel.defaults.internal.parquet

Class ParquetFileReader.BatchReadSupport

Object
org.apache.parquet.hadoop.api.ReadSupport<Object>
io.delta.kernel.defaults.internal.parquet.ParquetFileReader.BatchReadSupport
Enclosing class:
ParquetFileReader
public static class ParquetFileReader.BatchReadSupport extends org.apache.parquet.hadoop.api.ReadSupport<Object>
Implement a ReadSupport that will collect the data for each row and return as a ColumnarBatch.

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.parquet.hadoop.api.ReadSupport

    org.apache.parquet.hadoop.api.ReadSupport.ReadContext

  • Field Summary

    Fields inherited from class org.apache.parquet.hadoop.api.ReadSupport

    PARQUET_READ_SCHEMA

  • Constructor Summary

    Constructors
    Constructor
    Description
    BatchReadSupport(int maxBatchSize, io.delta.kernel.types.StructType readSchema)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    finalizeCurrentRow(long fileRowIndex)
     
    io.delta.kernel.data.ColumnarBatch
    getDataAsColumnarBatch(int batchSize)
     
    org.apache.parquet.hadoop.api.ReadSupport.ReadContext
    init(org.apache.parquet.hadoop.api.InitContext context)
     
    org.apache.parquet.io.api.RecordMaterializer<Object>
    prepareForRead(org.apache.hadoop.conf.Configuration configuration, Map<String,String> keyValueMetaData, org.apache.parquet.schema.MessageType fileSchema, org.apache.parquet.hadoop.api.ReadSupport.ReadContext readContext)
     

    Methods inherited from class org.apache.parquet.hadoop.api.ReadSupport

    getSchemaForRead, getSchemaForRead, init, init, prepareForRead

    Methods inherited from class java.lang.Object

    equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • BatchReadSupport

      public BatchReadSupport(int maxBatchSize, io.delta.kernel.types.StructType readSchema)

  • Method Details

    • init

      public org.apache.parquet.hadoop.api.ReadSupport.ReadContext init(org.apache.parquet.hadoop.api.InitContext context)
      Overrides:
      init in class org.apache.parquet.hadoop.api.ReadSupport<Object>

    • prepareForRead

      public org.apache.parquet.io.api.RecordMaterializer<Object> prepareForRead(org.apache.hadoop.conf.Configuration configuration, Map<String,String> keyValueMetaData, org.apache.parquet.schema.MessageType fileSchema, org.apache.parquet.hadoop.api.ReadSupport.ReadContext readContext)
      Specified by:
      prepareForRead in class org.apache.parquet.hadoop.api.ReadSupport<Object>

    • getDataAsColumnarBatch

      public io.delta.kernel.data.ColumnarBatch getDataAsColumnarBatch(int batchSize)

    • finalizeCurrentRow

      public void finalizeCurrentRow(long fileRowIndex)
      Parameters:
      fileRowIndex - the file row index of the row just processed.