Package io.fury.format.encoder

Class BaseBinaryEncoderBuilder

java.lang.Object

io.fury.builder.CodecBuilder

io.fury.format.encoder.BaseBinaryEncoderBuilder

Direct Known Subclasses:

ArrayEncoderBuilder, MapEncoderBuilder, RowEncoderBuilder

public abstract class BaseBinaryEncoderBuilder
extends CodecBuilder

Base encoder builder for Row, ArrayData and MapData.

Author:

chaokunyang

Field Summary

Fields

Modifier and Type	Field	Description
protected final Map<com.google.common.reflect.TypeToken<?>,Expression.Reference>	arrayWriterMap
protected static com.google.common.reflect.TypeToken<BinaryArrayWriter>	arrayWriterTypeToken
protected static final com.google.common.reflect.TypeToken<org.apache.arrow.vector.types.pojo.Field>	ARROW_FIELD_TYPE
protected final Map<com.google.common.reflect.TypeToken<?>,Expression.Reference>	beanEncoderMap
protected static com.google.common.reflect.TypeToken<BinaryArray>	binaryArrayTypeToken
protected static com.google.common.reflect.TypeToken<BinaryRow>	binaryRowTypeToken
protected static final String	REFERENCES_NAME
protected static com.google.common.reflect.TypeToken<Row>	rowTypeToken
protected final Map<com.google.common.reflect.TypeToken<?>,Expression.Reference>	rowWriterMap
protected static com.google.common.reflect.TypeToken<BinaryRowWriter>	rowWriterTypeToken
protected static final com.google.common.reflect.TypeToken<org.apache.arrow.vector.types.pojo.Schema>	SCHEMA_TYPE
protected static com.google.common.reflect.TypeToken<org.apache.arrow.vector.types.pojo.Schema>	schemaTypeToken
protected static com.google.common.reflect.TypeToken<BinaryWriter>	writerTypeToken

Fields inherited from class io.fury.builder.CodecBuilder

beanClass, beanType, ctx, fieldMap, FURY_NAME, furyRef, isRecord, recordComponentDefaultValues, recordCtrAccessible, ROOT_OBJECT_NAME

Constructor Summary

Constructors

Constructor	Description
BaseBinaryEncoderBuilder(CodegenContext context, com.google.common.reflect.TypeToken<?> beanType)
BaseBinaryEncoderBuilder(CodegenContext context, Class<?> beanClass)

Method Summary

Modifier and Type	Method	Description
String	codecClassName(Class<?> beanClass)
String	codecClassName(Class<?> beanClass, String prefix)
String	codecQualifiedClassName(Class<?> beanClass)
String	codecQualifiedClassName(Class<?> beanClass, String prefix)
protected String	codecSuffix()
protected Expression	deserializeFor(Expression value, com.google.common.reflect.TypeToken<?> typeToken)	Returns an expression that deserialize value as a java object of type typeToken.
protected Expression	deserializeForArray(Expression arrayData, com.google.common.reflect.TypeToken<?> typeToken)	Return an expression that deserialize arrayData.
protected Expression	deserializeForBean(Expression row, com.google.common.reflect.TypeToken<?> typeToken)	Returns an expression that deserialize row as a java bean of type typeToken .
protected Expression	deserializeForCollection(Expression arrayData, com.google.common.reflect.TypeToken<?> typeToken)	Returns an expression that deserialize arrayData as a java collection.
protected Expression	deserializeForMap(Expression mapData, com.google.common.reflect.TypeToken<?> typeToken)	Returns an expression that deserialize mapData as a java map.
protected Expression	deserializeForMultiDimensionArray(Expression arrayData, Expression rootJavaArray, int numDimensions, com.google.common.reflect.TypeToken<?> typeToken, Expression[] indexes)	Returns an expression to deserialize multi-array from arrayData, and set value to rootJavaArray.
protected Expression	deserializeForObject(Expression value, com.google.common.reflect.TypeToken<?> typeToken)	Using fury to deserialize sliced MemoryBuffer.
protected Expression.Reference	getOrCreateArrayWriter(com.google.common.reflect.TypeToken<?> typeToken, Expression arrayDataType, Expression writer)	Get or create an ArrayWriter for given type and use writer as parent writer.
protected Expression.Reference	getOrCreateArrayWriter(com.google.common.reflect.TypeToken<?> typeToken, Expression arrayDataType, Expression writer, boolean reuse)
protected Expression	newCollection(com.google.common.reflect.TypeToken<?> typeToken)	Create a java collection.
protected Expression	newMap(com.google.common.reflect.TypeToken<?> typeToken)	Create a java map.
protected Expression	serializeFor(Expression ordinal, Expression inputObject, Expression writer, com.google.common.reflect.TypeToken<?> typeToken, Expression arrowField)	Return an expression for serializing an object of given type to row format representation.
protected Expression	serializeForArray(Expression inputObject, Expression writer, com.google.common.reflect.TypeToken<?> typeToken, Expression arrowField)	Returns an expression to write iterable inputObject of type typeToken as BinaryArray using given writer.
protected Expression	serializeForArray(Expression inputObject, Expression writer, com.google.common.reflect.TypeToken<?> typeToken, Expression arrowField, boolean reuse)
protected Expression	serializeForBean(Expression ordinal, Expression writer, Expression inputObject, com.google.common.reflect.TypeToken<?> typeToken, Expression structField)	Returns an expression to write bean inputObject to position ordinal of row/array using given writer.
protected Expression	serializeForMap(Expression ordinal, Expression writer, Expression inputObject, com.google.common.reflect.TypeToken<?> typeToken, Expression arrowField)	Returns an expression to write map inputObject to position ordinal of row/array using given writer.
protected Expression	serializeForObject(Expression ordinal, Expression writer, Expression inputObject)	Return an expression to serialize opaque inputObject as binary using fury .
protected Expression	setValueOrNull(Expression writer, Expression ordinal, Expression inputObject, Expression value)

Methods inherited from class io.fury.builder.CodecBuilder

beanClassExpr, beanClassExpr, buildDecodeExpression, buildDefaultComponentsArray, buildEncodeExpression, buildRecordComponentDefaultValues, genCode, getFieldValue, getRecordCtrHandle, newBean, setFieldValue, sourcePublicAccessible, staticBeanClassExpr, tryCastIfPublic, tryCastIfPublic, tryCastIfPublic, tryInlineCast, unsafeGet, unsafeGetBoolean, unsafeGetChar, unsafeGetDouble, unsafeGetFloat, unsafeGetInt, unsafeGetLong, unsafeGetShort, unsafePut, unsafePutBoolean, unsafePutChar, unsafePutDouble, unsafePutFloat, unsafePutInt, unsafePutLong, unsafePutShort

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

REFERENCES_NAME

protected static final String REFERENCES_NAME

See Also:

• Constant Field Values

SCHEMA_TYPE

protected static final com.google.common.reflect.TypeToken<org.apache.arrow.vector.types.pojo.Schema> SCHEMA_TYPE

ARROW_FIELD_TYPE

protected static final com.google.common.reflect.TypeToken<org.apache.arrow.vector.types.pojo.Field> ARROW_FIELD_TYPE

schemaTypeToken

protected static com.google.common.reflect.TypeToken<org.apache.arrow.vector.types.pojo.Schema> schemaTypeToken

writerTypeToken

protected static com.google.common.reflect.TypeToken<BinaryWriter> writerTypeToken

rowWriterTypeToken

protected static com.google.common.reflect.TypeToken<BinaryRowWriter> rowWriterTypeToken

arrayWriterTypeToken

protected static com.google.common.reflect.TypeToken<BinaryArrayWriter> arrayWriterTypeToken

rowTypeToken

protected static com.google.common.reflect.TypeToken<Row> rowTypeToken

binaryRowTypeToken

protected static com.google.common.reflect.TypeToken<BinaryRow> binaryRowTypeToken

binaryArrayTypeToken

protected static com.google.common.reflect.TypeToken<BinaryArray> binaryArrayTypeToken

arrayWriterMap

protected final Map<com.google.common.reflect.TypeToken<?>,Expression.Reference> arrayWriterMap

beanEncoderMap

protected final Map<com.google.common.reflect.TypeToken<?>,Expression.Reference> beanEncoderMap

rowWriterMap

protected final Map<com.google.common.reflect.TypeToken<?>,Expression.Reference> rowWriterMap

Constructor Details

BaseBinaryEncoderBuilder

public BaseBinaryEncoderBuilder(CodegenContext context,
 Class<?> beanClass)

BaseBinaryEncoderBuilder

public BaseBinaryEncoderBuilder(CodegenContext context,
 com.google.common.reflect.TypeToken<?> beanType)

Method Details

codecClassName

public String codecClassName(Class<?> beanClass)

codecClassName

public String codecClassName(Class<?> beanClass,
 String prefix)

codecSuffix

protected String codecSuffix()

codecQualifiedClassName

public String codecQualifiedClassName(Class<?> beanClass)

codecQualifiedClassName

public String codecQualifiedClassName(Class<?> beanClass,
 String prefix)

serializeFor

protected Expression serializeFor(Expression ordinal,
 Expression inputObject,
 Expression writer,
 com.google.common.reflect.TypeToken<?> typeToken,
 Expression arrowField)

Return an expression for serializing an object of given type to row format representation. The inputObject will be written to position ordinal of row/array using given writer

serializeForArray

protected Expression serializeForArray(Expression inputObject,
 Expression writer,
 com.google.common.reflect.TypeToken<?> typeToken,
 Expression arrowField)

Returns an expression to write iterable inputObject of type typeToken as BinaryArray using given writer.

serializeForArray

protected Expression serializeForArray(Expression inputObject,
 Expression writer,
 com.google.common.reflect.TypeToken<?> typeToken,
 Expression arrowField,
 boolean reuse)

getOrCreateArrayWriter

protected Expression.Reference getOrCreateArrayWriter(com.google.common.reflect.TypeToken<?> typeToken,
 Expression arrayDataType,
 Expression writer)

Get or create an ArrayWriter for given type and use writer as parent writer.

getOrCreateArrayWriter

protected Expression.Reference getOrCreateArrayWriter(com.google.common.reflect.TypeToken<?> typeToken,
 Expression arrayDataType,
 Expression writer,
 boolean reuse)

serializeForMap

protected Expression serializeForMap(Expression ordinal,
 Expression writer,
 Expression inputObject,
 com.google.common.reflect.TypeToken<?> typeToken,
 Expression arrowField)

Returns an expression to write map inputObject to position ordinal of row/array using given writer.

serializeForBean

protected Expression serializeForBean(Expression ordinal,
 Expression writer,
 Expression inputObject,
 com.google.common.reflect.TypeToken<?> typeToken,
 Expression structField)

Returns an expression to write bean inputObject to position ordinal of row/array using given writer.

serializeForObject

protected Expression serializeForObject(Expression ordinal,
 Expression writer,
 Expression inputObject)

Return an expression to serialize opaque inputObject as binary using fury . When deserialization, using fury to deserialize sliced MemoryBuffer. See BinaryUtils.getElemAccessMethodName(TypeToken), Getters.getBuffer(int)

setValueOrNull

protected Expression setValueOrNull(Expression writer,
 Expression ordinal,
 Expression inputObject,
 Expression value)

deserializeFor

protected Expression deserializeFor(Expression value,
 com.google.common.reflect.TypeToken<?> typeToken)

Returns an expression that deserialize value as a java object of type typeToken.

deserializeForBean

protected Expression deserializeForBean(Expression row,
 com.google.common.reflect.TypeToken<?> typeToken)

Returns an expression that deserialize row as a java bean of type typeToken .

deserializeForMap

protected Expression deserializeForMap(Expression mapData,
 com.google.common.reflect.TypeToken<?> typeToken)

Returns an expression that deserialize mapData as a java map.

deserializeForCollection

protected Expression deserializeForCollection(Expression arrayData,
 com.google.common.reflect.TypeToken<?> typeToken)

Returns an expression that deserialize arrayData as a java collection.

newCollection

protected Expression newCollection(com.google.common.reflect.TypeToken<?> typeToken)

Create a java collection. Create a ArrayList if typeToken is super class of ArrayList; Create a HashSet if typeToken is super class of HashSet; Create an instance of typeToken otherwise.

newMap

protected Expression newMap(com.google.common.reflect.TypeToken<?> typeToken)

Create a java map. Create a HashMap if typeToken is super class of HashMap; Create an instance of typeToken otherwise.

deserializeForMultiDimensionArray

protected Expression deserializeForMultiDimensionArray(Expression arrayData,
 Expression rootJavaArray,
 int numDimensions,
 com.google.common.reflect.TypeToken<?> typeToken,
 Expression[] indexes)

Returns an expression to deserialize multi-array from arrayData, and set value to rootJavaArray.

deserializeForArray

protected Expression deserializeForArray(Expression arrayData,
 com.google.common.reflect.TypeToken<?> typeToken)

Return an expression that deserialize arrayData. If array is multi-array, forward to deserializeForMultiDimensionArray(io.fury.codegen.Expression, io.fury.codegen.Expression, int, com.google.common.reflect.TypeToken<?>, io.fury.codegen.Expression[])

deserializeForObject

protected Expression deserializeForObject(Expression value,
 com.google.common.reflect.TypeToken<?> typeToken)

Using fury to deserialize sliced MemoryBuffer. see BinaryUtils.getElemAccessMethodName(TypeToken), Getters.getBuffer(int)