Package org.apache.druid.data.input.impl

Class LinesInputFormat

java.lang.Object

org.apache.druid.data.input.impl.LinesInputFormat

All Implemented Interfaces:

InputFormat

public class LinesInputFormat
extends Object
implements InputFormat

Input format that breaks the input on newlines, and returns a single column named LinesReader.LINE_COLUMN.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	TYPE_KEY

Fields inherited from interface org.apache.druid.data.input.InputFormat

TYPE_PROPERTY

Constructor Summary

Constructors

Constructor	Description
LinesInputFormat()

Method Summary

Modifier and Type	Method	Description
InputEntityReader	createReader(InputRowSchema inputRowSchema, InputEntity source, File temporaryDirectory)
long	getWeightedSize(String path, long size)	Computes the weighted size of a given input object of the underyling input format type, weighted for its cost during ingestion.
boolean	isSplittable()	Trait to indicate that a file can be split into multiple InputSplits.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.druid.data.input.InputFormat

createRowAdapter

Field Details

TYPE_KEY

public static final String TYPE_KEY

See Also:

• Constant Field Values

Constructor Details

LinesInputFormat

public LinesInputFormat()

Method Details

isSplittable

public boolean isSplittable()

Description copied from interface: InputFormat

Trait to indicate that a file can be split into multiple InputSplits.

This method is not being used anywhere for now, but should be considered in SplittableInputSource.createSplits(org.apache.druid.data.input.InputFormat, org.apache.druid.data.input.SplitHintSpec) in the future.

Specified by:

isSplittable in interface InputFormat

createReader

public InputEntityReader createReader(InputRowSchema inputRowSchema,
 InputEntity source,
 File temporaryDirectory)

Specified by:

createReader in interface InputFormat

getWeightedSize

public long getWeightedSize(String path,
 long size)

Description copied from interface: InputFormat

Computes the weighted size of a given input object of the underyling input format type, weighted for its cost during ingestion. The weight calculated is dependent on the format type and compression type (CompressionUtils.Format) used if any. Uncompressed newline delimited json is used as baseline with scale factor 1. This means that when computing the byte weight that an uncompressed newline delimited json input object has towards ingestion, we take the file size as is, 1:1.

Specified by:

getWeightedSize in interface InputFormat

Parameters:

path - The path of the input object. Used to tell whether any compression is used.

size - The size of the input object in bytes.

Returns:

The weighted size of the input object.