org.apache.flink.formats.csv

Class CsvFileSystemFormatFactory.CsvInputFormat

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<OT,org.apache.flink.core.fs.FileInputSplit>

org.apache.flink.api.common.io.FileInputFormat<T>

org.apache.flink.formats.csv.AbstractCsvInputFormat<org.apache.flink.table.data.RowData>

org.apache.flink.formats.csv.CsvFileSystemFormatFactory.CsvInputFormat

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>, org.apache.flink.core.io.InputSplitSource<org.apache.flink.core.fs.FileInputSplit>

Enclosing class:

CsvFileSystemFormatFactory

public static class CsvFileSystemFormatFactory.CsvInputFormat
extends AbstractCsvInputFormat<org.apache.flink.table.data.RowData>

InputFormat that reads csv record into RowData.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.common.io.FileInputFormat

org.apache.flink.api.common.io.FileInputFormat.FileBaseStatistics, org.apache.flink.api.common.io.FileInputFormat.InputSplitOpenThread

Field Summary

Fields inherited from class org.apache.flink.formats.csv.AbstractCsvInputFormat

csvInputStream, csvSchema

Fields inherited from class org.apache.flink.api.common.io.FileInputFormat

currentSplit, ENUMERATE_NESTED_FILES_FLAG, enumerateNestedFiles, filePath, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable

Constructor Summary

Constructors

Constructor and Description

CsvInputFormat(org.apache.flink.core.fs.Path[] filePaths, org.apache.flink.table.types.DataType[] fieldTypes, String[] fieldNames, org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema csvSchema, org.apache.flink.table.types.logical.RowType formatRowType, int[] selectFields, List<String> partitionKeys, String defaultPartValue, long limit, int[] csvSelectFieldToProjectFieldMapping, int[] csvSelectFieldToCsvFieldMapping, boolean ignoreParseErrors)

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.flink.table.data.RowData	nextRecord(org.apache.flink.table.data.RowData reuse)
void	open(org.apache.flink.core.fs.FileInputSplit split)
boolean	reachedEnd()

Methods inherited from class org.apache.flink.formats.csv.AbstractCsvInputFormat

supportsMultiPaths

Methods inherited from class org.apache.flink.api.common.io.FileInputFormat

acceptFile, configure, createInputSplits, decorateInputStream, extractFileExtension, getFilePath, getFilePaths, getFileStats, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNestedFileEnumeration, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, getStatistics, registerInflaterInputStreamFactory, setFilePath, setFilePath, setFilePaths, setFilePaths, setFilesFilter, setMinSplitSize, setNestedFileEnumeration, setNumSplits, setOpenTimeout, testForUnsplittable, toString

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

CsvInputFormat

public CsvInputFormat(org.apache.flink.core.fs.Path[] filePaths,
                      org.apache.flink.table.types.DataType[] fieldTypes,
                      String[] fieldNames,
                      org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema csvSchema,
                      org.apache.flink.table.types.logical.RowType formatRowType,
                      int[] selectFields,
                      List<String> partitionKeys,
                      String defaultPartValue,
                      long limit,
                      int[] csvSelectFieldToProjectFieldMapping,
                      int[] csvSelectFieldToCsvFieldMapping,
                      boolean ignoreParseErrors)

Method Detail

open

public void open(org.apache.flink.core.fs.FileInputSplit split)
          throws IOException

Specified by:

open in interface org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>

Overrides:

open in class AbstractCsvInputFormat<org.apache.flink.table.data.RowData>

Throws:

IOException

reachedEnd

public boolean reachedEnd()
                   throws IOException

Throws:

IOException

nextRecord

public org.apache.flink.table.data.RowData nextRecord(org.apache.flink.table.data.RowData reuse)
                                               throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface org.apache.flink.api.common.io.InputFormat<org.apache.flink.table.data.RowData,org.apache.flink.core.fs.FileInputSplit>

Overrides:

close in class org.apache.flink.api.common.io.FileInputFormat<org.apache.flink.table.data.RowData>

Throws:

IOException