org.apache.flink.orc

类 OrcSplitReader<T,BATCH>

java.lang.Object

org.apache.flink.orc.OrcSplitReader<T,BATCH>

所有已实现的接口:

Closeable, AutoCloseable

直接已知子类:

OrcColumnarRowSplitReader

public abstract class OrcSplitReader<T,BATCH>
extends Object
implements Closeable

Orc split reader to read record from orc file. The reader is only responsible for reading the data of a single split.

字段概要

字段

限定符和类型	字段和说明
protected int	nextRow
protected OrcVectorizedBatchWrapper<BATCH>	rowBatchWrapper

构造器概要

构造器

构造器和说明
OrcSplitReader(OrcShim<BATCH> shim, org.apache.hadoop.conf.Configuration conf, org.apache.orc.TypeDescription schema, int[] selectedFields, List<OrcFilters.Predicate> conjunctPredicates, int batchSize, org.apache.flink.core.fs.Path path, long splitStart, long splitLength)

方法概要

限定符和类型	方法和说明
void	close()
protected abstract int	fillRows() Fills an ORC batch into an array of Row.
org.apache.orc.RecordReader	getRecordReader()
abstract T	nextRecord(T reuse) Reads the next record from the input.
boolean	reachedEnd() Method used to check if the end of the input is reached.
void	seekToRow(long rowCount) Seek to a particular row number.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

rowBatchWrapper

protected final OrcVectorizedBatchWrapper<BATCH> rowBatchWrapper

nextRow

protected int nextRow

构造器详细资料

OrcSplitReader

public OrcSplitReader(OrcShim<BATCH> shim,
                      org.apache.hadoop.conf.Configuration conf,
                      org.apache.orc.TypeDescription schema,
                      int[] selectedFields,
                      List<OrcFilters.Predicate> conjunctPredicates,
                      int batchSize,
                      org.apache.flink.core.fs.Path path,
                      long splitStart,
                      long splitLength)
               throws IOException

抛出:

IOException

方法详细资料

seekToRow

public void seekToRow(long rowCount)
               throws IOException

Seek to a particular row number.

抛出:

IOException

getRecordReader

@VisibleForTesting
public org.apache.orc.RecordReader getRecordReader()

reachedEnd

public boolean reachedEnd()
                   throws IOException

Method used to check if the end of the input is reached.

返回:

True if the end is reached, otherwise false.

抛出:

IOException - Thrown, if an I/O error occurred.

fillRows

protected abstract int fillRows()

Fills an ORC batch into an array of Row.

返回:

The number of rows that were filled.

nextRecord

public abstract T nextRecord(T reuse)
                      throws IOException

Reads the next record from the input.

参数:

reuse - Object that may be reused.

返回:

Read record.

抛出:

IOException - Thrown, if an I/O error occurred.

close

public void close()
           throws IOException

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

抛出:

IOException