org.apache.flink.orc.vector

类 Vectorizer<T>

java.lang.Object

org.apache.flink.orc.vector.Vectorizer<T>

类型参数:

T - The type of the element

所有已实现的接口:

Serializable

直接已知子类:

RowDataVectorizer

@PublicEvolving
public abstract class Vectorizer<T>
extends Object
implements Serializable

This class provides an abstracted set of methods to handle the lifecycle of VectorizedRowBatch.

Users have to extend this class and override the vectorize() method with the logic to transform the element to a VectorizedRowBatch.

另请参阅:

序列化表格

构造器概要

构造器

构造器和说明
Vectorizer(String schema)

方法概要

限定符和类型	方法和说明
void	addUserMetadata(String key, ByteBuffer value) Adds arbitrary user metadata to the outgoing ORC file.
org.apache.orc.TypeDescription	getSchema() Provides the ORC schema.
void	setWriter(org.apache.orc.Writer writer) Users are not supposed to use this method since this is intended to be used only by the OrcBulkWriter.
abstract void	vectorize(T element, org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch batch) Transforms the provided element to ColumnVectors and sets them in the exposed VectorizedRowBatch.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

Vectorizer

public Vectorizer(String schema)

方法详细资料

getSchema

public org.apache.orc.TypeDescription getSchema()

Provides the ORC schema.

返回:

the ORC schema

setWriter

public void setWriter(org.apache.orc.Writer writer)

Users are not supposed to use this method since this is intended to be used only by the OrcBulkWriter.

参数:

writer - the underlying ORC Writer.

addUserMetadata

public void addUserMetadata(String key,
                            ByteBuffer value)

Adds arbitrary user metadata to the outgoing ORC file.

Users who want to dynamically add new metadata either based on either the input or from an external system can do so by calling addUserMetadata(...) inside the overridden vectorize() method.

参数:

key - a key to label the data with.

value - the contents of the metadata.

vectorize

public abstract void vectorize(T element,
                               org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch batch)
                        throws IOException

Transforms the provided element to ColumnVectors and sets them in the exposed VectorizedRowBatch.

参数:

element - The input element

batch - The batch to write the ColumnVectors

抛出:

IOException - if there is an error while transforming the input.