edu.umd.cloud9.collection
Class XMLInputFormat

java.lang.Object
  org.apache.hadoop.mapreduce.InputFormat<K,V>
      org.apache.hadoop.mapreduce.lib.input.FileInputFormat<LongWritable,Text>
          org.apache.hadoop.mapreduce.lib.input.TextInputFormat
              edu.umd.cloud9.collection.XMLInputFormat

public class XMLInputFormat
extends TextInputFormat

A simple InputFormat for XML documents (org.apache.hadoop.mapreduce API). The class recognizes begin-of-document and end-of-document tags only: everything between those delimiting tags is returned in an uninterpreted Text object.

Author:

Jimmy Lin

Nested Class Summary

static class

XMLInputFormat.XMLRecordReader Simple RecordReader for XML documents (org.apache.hadoop.mapreduce API).

Field Summary

static String	END_TAG_KEY
static String	START_TAG_KEY

Constructor Summary

XMLInputFormat()

Method Summary

RecordReader<LongWritable,Text>

createRecordReader(InputSplit split, TaskAttemptContext context) Create a record reader for a given split.

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPaths, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

START_TAG_KEY

public static final String START_TAG_KEY

See Also:

Constant Field Values

END_TAG_KEY

public static final String END_TAG_KEY

See Also:

Constant Field Values

Constructor Detail

XMLInputFormat

public XMLInputFormat()

Method Detail

createRecordReader

public RecordReader<LongWritable,Text> createRecordReader(InputSplit split,
                                                          TaskAttemptContext context)

Create a record reader for a given split. The framework will call XMLInputFormat.XMLRecordReader.initialize(InputSplit, TaskAttemptContext) before the split is used.

Overrides:

createRecordReader in class TextInputFormat

Parameters:

split - the split to be read

context - the information about the task

Returns:

a new record reader

Throws:

IOException

InterruptedException