Package org.apache.druid.data.input.impl

Class DelimitedInputFormat

java.lang.Object

org.apache.druid.data.input.impl.FlatTextInputFormat

org.apache.druid.data.input.impl.DelimitedInputFormat

All Implemented Interfaces:

InputFormat

public class DelimitedInputFormat
extends FlatTextInputFormat

InputFormat for customized Delimiter Separate Value format of input data (default is TSV).

Field Summary

Fields

Modifier and Type	Field	Description
static final String	TYPE_KEY

Fields inherited from interface org.apache.druid.data.input.InputFormat

TYPE_PROPERTY

Constructor Summary

Constructors

Constructor	Description
DelimitedInputFormat(List<String> columns, String listDelimiter, String delimiter, Boolean hasHeaderRow, Boolean findColumnsFromHeader, int skipHeaderRows, Boolean tryParseNumbers)

Method Summary

Modifier and Type	Method	Description
InputEntityReader	createReader(InputRowSchema inputRowSchema, InputEntity source, File temporaryDirectory)
boolean	isSplittable()	Trait to indicate that a file can be split into multiple InputSplits.
static List<String>	splitToList(com.google.common.base.Splitter splitter, String input)	Copied from Guava's Splitter.splitToList(CharSequence).
String	toString()

Methods inherited from class org.apache.druid.data.input.impl.FlatTextInputFormat

createRowAdapter, equals, fieldsToString, getColumns, getDelimiter, getListDelimiter, getSkipHeaderRows, getWeightedSize, hashCode, isFindColumnsFromHeader, shouldTryParseNumbers, useListBasedInputRows

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Details

TYPE_KEY

public static final String TYPE_KEY

See Also:

• Constant Field Values

Constructor Details

DelimitedInputFormat

public DelimitedInputFormat(@Nullable
 List<String> columns,
 @Nullable
 String listDelimiter,
 @Nullable
 String delimiter,
 @Deprecated @Nullable
 Boolean hasHeaderRow,
 @Nullable
 Boolean findColumnsFromHeader,
 int skipHeaderRows,
 @Nullable
 Boolean tryParseNumbers)

Method Details

isSplittable

public boolean isSplittable()

Description copied from interface: InputFormat

Trait to indicate that a file can be split into multiple InputSplits.

This method is not being used anywhere for now, but should be considered in SplittableInputSource.createSplits(org.apache.druid.data.input.InputFormat, org.apache.druid.data.input.SplitHintSpec) in the future.

createReader

public InputEntityReader createReader(InputRowSchema inputRowSchema,
 InputEntity source,
 File temporaryDirectory)

splitToList

public static List<String> splitToList(com.google.common.base.Splitter splitter,
 String input)

Copied from Guava's Splitter.splitToList(CharSequence). This is to avoid the error of the missing method signature when using an old Guava library. For example, it may happen when running Druid Hadoop indexing jobs, since we may inherit the version provided by the Hadoop cluster. See https://github.com/apache/druid/issues/6801.

toString

public String toString()

Overrides:

toString in class Object