org.apache.flink.orc

类 AbstractOrcFileInputFormat.OrcVectorizedReader<T,BatchT>

java.lang.Object

org.apache.flink.orc.AbstractOrcFileInputFormat.OrcVectorizedReader<T,BatchT>

类型参数:

T - The type of the records returned by the reader.

所有已实现的接口:

Closeable, AutoCloseable, org.apache.flink.connector.file.src.reader.BulkFormat.Reader<T>

封闭类:

AbstractOrcFileInputFormat<T,BatchT,SplitT extends org.apache.flink.connector.file.src.FileSourceSplit>

protected static final class AbstractOrcFileInputFormat.OrcVectorizedReader<T,BatchT>
extends Object
implements org.apache.flink.connector.file.src.reader.BulkFormat.Reader<T>

A vectorized ORC reader. This reader reads an ORC BatchT at a time and converts it to one or more records to be returned. An ORC Row-wise reader would convert the batch into a set of rows, while a reader for a vectorized query processor might return the whole batch as one record.

The conversion of the VectorizedRowBatch happens in the specific AbstractOrcFileInputFormat.OrcReaderBatch implementation.

The reader tracks its current position using ORC's row numbers. Each record in a batch is addressed by the starting row number of the batch, plus the number of records to be skipped before.

构造器概要

构造器

限定符	构造器和说明
protected	OrcVectorizedReader(OrcShim<BatchT> shim, org.apache.orc.RecordReader orcReader, org.apache.flink.connector.file.src.util.Pool<AbstractOrcFileInputFormat.OrcReaderBatch<T,BatchT>> pool)

方法概要

限定符和类型	方法和说明
void	close()
org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<T>	readBatch()
void	seek(org.apache.flink.connector.file.src.util.CheckpointedPosition position) The argument of RecordReader.seekToRow(long) must come from RecordReader.getRowNumber().

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

OrcVectorizedReader

protected OrcVectorizedReader(OrcShim<BatchT> shim,
                              org.apache.orc.RecordReader orcReader,
                              org.apache.flink.connector.file.src.util.Pool<AbstractOrcFileInputFormat.OrcReaderBatch<T,BatchT>> pool)

方法详细资料

readBatch

@Nullable
public org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<T> readBatch()
                                                                                            throws IOException

指定者:

readBatch 在接口中 org.apache.flink.connector.file.src.reader.BulkFormat.Reader<T>

抛出:

IOException

close

public void close()
           throws IOException

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

指定者:

close 在接口中 org.apache.flink.connector.file.src.reader.BulkFormat.Reader<T>

抛出:

IOException

seek

public void seek(org.apache.flink.connector.file.src.util.CheckpointedPosition position)
          throws IOException

The argument of RecordReader.seekToRow(long) must come from RecordReader.getRowNumber(). The internal implementation of ORC is very confusing. It has special behavior when dealing with Predicate.

抛出:

IOException