Package org.apache.druid.data.input.impl

Class LinesReader

java.lang.Object

org.apache.druid.data.input.IntermediateRowParsingReader<String>

org.apache.druid.data.input.TextReader<String>

org.apache.druid.data.input.TextReader.Strings

org.apache.druid.data.input.impl.LinesReader

All Implemented Interfaces:

InputEntityReader

public class LinesReader
extends TextReader.Strings

Reader for LinesInputFormat.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.druid.data.input.TextReader

TextReader.Bytes, TextReader.Strings

Method Summary

Modifier and Type	Method	Description
int	getNumHeaderLinesToSkip()	Returns the number of header lines to skip.
boolean	needsToProcessHeaderLine()	Returns true if the file format needs to process a header line.
List<InputRow>	parseInputRows(String intermediateRow)	Parses the given line into a list of InputRows.
void	processHeaderLine(String line)	Processes a header line.
protected List<Map<String,Object>>	toMap(String intermediateRow)	Converts the given intermediate row into a Map.

Methods inherited from class org.apache.druid.data.input.TextReader.Strings

makeSourceIterator

Methods inherited from class org.apache.druid.data.input.TextReader

findOrCreateInputRowSignature, getInputRowSchema, intermediateRowIteratorWithMetadata, source

Methods inherited from class org.apache.druid.data.input.IntermediateRowParsingReader

intermediateRowAsString, intermediateRowIterator, read, sample

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

parseInputRows

public List<InputRow> parseInputRows(String intermediateRow)
                              throws ParseException

Description copied from class: TextReader

Parses the given line into a list of InputRows. Note that some file formats can explode a single line of input into multiple inputRows. This method will be called after TextReader.getNumHeaderLinesToSkip() and TextReader.processHeaderLine(T).

Specified by:

parseInputRows in class TextReader<String>

Throws:

ParseException - if it cannot parse the given intermediateRow properly

toMap

protected List<Map<String,Object>> toMap(String intermediateRow)

Description copied from class: IntermediateRowParsingReader

Converts the given intermediate row into a Map. The returned JSON will be used by InputSourceSampler. Implementations can use any method to convert the given row into a Map. This should return a non-empty list with the same size of the list returned by IntermediateRowParsingReader.parseInputRows(T) or the returned objects will be discarded

Specified by:

toMap in class IntermediateRowParsingReader<String>

getNumHeaderLinesToSkip

public int getNumHeaderLinesToSkip()

Description copied from class: TextReader

Returns the number of header lines to skip. TextReader.processHeaderLine(T) will be called as many times as the returned number.

Specified by:

getNumHeaderLinesToSkip in class TextReader<String>

needsToProcessHeaderLine

public boolean needsToProcessHeaderLine()

Description copied from class: TextReader

Returns true if the file format needs to process a header line. This method will be called after skipping lines as many as TextReader.getNumHeaderLinesToSkip().

Specified by:

needsToProcessHeaderLine in class TextReader<String>

processHeaderLine

public void processHeaderLine(String line)

Description copied from class: TextReader

Processes a header line. This will be called if TextReader.needsToProcessHeaderLine() = true.

Specified by:

processHeaderLine in class TextReader<String>