org.apache.paimon.format

类 FileFormat

java.lang.Object

org.apache.paimon.format.FileFormat

public abstract class FileFormat
extends Object

Factory class which creates reader and writer factories for specific file format.

NOTE: This class must be thread safe.

字段概要

字段

限定符和类型	字段和说明
protected String	formatIdentifier

构造器概要

构造器

限定符	构造器和说明
protected	FileFormat(String formatIdentifier)

方法概要

限定符和类型	方法和说明
FormatReaderFactory	createReaderFactory(RowType rowType)
FormatReaderFactory	createReaderFactory(RowType rowType, int[][] projection)
abstract FormatReaderFactory	createReaderFactory(RowType type, int[][] projection, List<Predicate> filters) Create a FormatReaderFactory from the type, with projection pushed down.
Optional<TableStatsExtractor>	createStatsExtractor(RowType type, FieldStatsCollector.Factory[] statsCollectors)
abstract FormatWriterFactory	createWriterFactory(RowType type) Create a FormatWriterFactory from the type.
static FileFormat	fromIdentifier(String identifier, FileFormatFactory.FormatContext context) Create a FileFormat from format identifier and format options.
static FileFormat	fromIdentifier(String identifier, Options options)
static FileFormat	getFileFormat(Options options, String formatIdentifier)
String	getFormatIdentifier()
abstract void	validateDataFields(RowType rowType) Validate data field type supported or not.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

formatIdentifier

protected String formatIdentifier

构造器详细资料

FileFormat

protected FileFormat(String formatIdentifier)

方法详细资料

getFormatIdentifier

public String getFormatIdentifier()

createReaderFactory

public abstract FormatReaderFactory createReaderFactory(RowType type,
                                                        int[][] projection,
                                                        @Nullable
                                                        List<Predicate> filters)

Create a FormatReaderFactory from the type, with projection pushed down.

参数:

type - Type without projection.

filters - A list of filters in conjunctive form for filtering on a best-effort basis.

createWriterFactory

public abstract FormatWriterFactory createWriterFactory(RowType type)

Create a FormatWriterFactory from the type.

validateDataFields

public abstract void validateDataFields(RowType rowType)

Validate data field type supported or not.

createReaderFactory

public FormatReaderFactory createReaderFactory(RowType rowType)

createReaderFactory

public FormatReaderFactory createReaderFactory(RowType rowType,
                                               int[][] projection)

createStatsExtractor

public Optional<TableStatsExtractor> createStatsExtractor(RowType type,
                                                          FieldStatsCollector.Factory[] statsCollectors)

fromIdentifier

@VisibleForTesting
public static FileFormat fromIdentifier(String identifier,
                                                           Options options)

fromIdentifier

public static FileFormat fromIdentifier(String identifier,
                                        FileFormatFactory.FormatContext context)

Create a FileFormat from format identifier and format options.

getFileFormat

public static FileFormat getFileFormat(Options options,
                                       String formatIdentifier)