ai.rapids.cudf

Class ParquetColumnWriterOptions

java.lang.Object

ai.rapids.cudf.ParquetColumnWriterOptions

Direct Known Subclasses:

ParquetColumnWriterOptions.ParquetListColumnWriterOptions, ParquetColumnWriterOptions.ParquetStructColumnWriterOptions

public class ParquetColumnWriterOptions
extends Object

Per column settings for writing Parquet files.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	ParquetColumnWriterOptions.AbstractStructBuilder<T extends ParquetColumnWriterOptions.AbstractStructBuilder,V extends ParquetColumnWriterOptions>
protected static interface	ParquetColumnWriterOptions.ByteArrayProducer
protected static interface	ParquetColumnWriterOptions.IntArrayProducer
static class	ParquetColumnWriterOptions.ListBuilder
static class	ParquetColumnWriterOptions.NestedBuilder<T extends ParquetColumnWriterOptions.NestedBuilder,V extends ParquetColumnWriterOptions>
static class	ParquetColumnWriterOptions.ParquetListColumnWriterOptions
static class	ParquetColumnWriterOptions.ParquetStructColumnWriterOptions
static class	ParquetColumnWriterOptions.StructBuilder

Field Summary

Fields

Modifier and Type	Field and Description
protected ParquetColumnWriterOptions[]	childColumnOptions

Constructor Summary

Constructors

Constructor and Description
ParquetColumnWriterOptions(String columnName)
ParquetColumnWriterOptions(String columnName, boolean isNullable)
ParquetColumnWriterOptions(String columnName, boolean isTimestampTypeInt96, int precision, boolean isNullable)

Method Summary

Modifier and Type	Method and Description
ParquetColumnWriterOptions[]	getChildColumnOptions() Return the child columnOptions for this column
String	getColumName() Return if the column can have null values
protected boolean[]	getFlatBooleans(boolean[] ret, ParquetColumnWriterOptions.ByteArrayProducer producer)
protected String[]	getFlatColumnNames(String[] ret)
protected int[]	getFlatInts(int[] ret, ParquetColumnWriterOptions.IntArrayProducer producer)
int	getPrecision() Return the precision for this column
boolean	isNullable() Return if the column can have null values
boolean	isTimestampTypeInt96() Returns true if the writer is expected to write timestamps in INT96
static ParquetColumnWriterOptions.ListBuilder	listBuilder(String name) Creates a ListBuilder for column called 'name'
static ParquetColumnWriterOptions.ListBuilder	listBuilder(String name, boolean isNullable) Creates a ListBuilder for column called 'name'
static ParquetColumnWriterOptions	mapColumn(String name, ParquetColumnWriterOptions key, ParquetColumnWriterOptions value) Add a Map Column to the schema.
static ParquetColumnWriterOptions.StructBuilder	structBuilder(String name) Creates a StructBuilder for column called 'name'
static ParquetColumnWriterOptions.StructBuilder	structBuilder(String name, boolean isNullable) Creates a StructBuilder for column called 'name'

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

childColumnOptions

protected ParquetColumnWriterOptions[] childColumnOptions

Constructor Detail

ParquetColumnWriterOptions

public ParquetColumnWriterOptions(String columnName,
                                  boolean isTimestampTypeInt96,
                                  int precision,
                                  boolean isNullable)

ParquetColumnWriterOptions

public ParquetColumnWriterOptions(String columnName,
                                  boolean isNullable)

ParquetColumnWriterOptions

public ParquetColumnWriterOptions(String columnName)

Method Detail

getFlatBooleans

protected boolean[] getFlatBooleans(boolean[] ret,
                                    ParquetColumnWriterOptions.ByteArrayProducer producer)

getFlatInts

protected int[] getFlatInts(int[] ret,
                            ParquetColumnWriterOptions.IntArrayProducer producer)

getFlatColumnNames

protected String[] getFlatColumnNames(String[] ret)

mapColumn

public static ParquetColumnWriterOptions mapColumn(String name,
                                                   ParquetColumnWriterOptions key,
                                                   ParquetColumnWriterOptions value)

Add a Map Column to the schema.

Maps are List columns with a Struct named 'key_value' with a child named 'key' and a child named 'value'. The caller of this method doesn't need to worry about this as this method will take care of this without the knowledge of the caller.

listBuilder

public static ParquetColumnWriterOptions.ListBuilder listBuilder(String name)

Creates a ListBuilder for column called 'name'

listBuilder

public static ParquetColumnWriterOptions.ListBuilder listBuilder(String name,
                                                                 boolean isNullable)

Creates a ListBuilder for column called 'name'

structBuilder

public static ParquetColumnWriterOptions.StructBuilder structBuilder(String name,
                                                                     boolean isNullable)

Creates a StructBuilder for column called 'name'

structBuilder

public static ParquetColumnWriterOptions.StructBuilder structBuilder(String name)

Creates a StructBuilder for column called 'name'

getColumName

public String getColumName()

Return if the column can have null values

isNullable

public boolean isNullable()

Return if the column can have null values

getPrecision

public int getPrecision()

Return the precision for this column

isTimestampTypeInt96

public boolean isTimestampTypeInt96()

Returns true if the writer is expected to write timestamps in INT96

getChildColumnOptions

public ParquetColumnWriterOptions[] getChildColumnOptions()

Return the child columnOptions for this column