edu.umd.cloud9.collection.wikipedia
Class WikipediaDocnoMappingBuilder

java.lang.Object
  extended by org.apache.hadoop.conf.Configured
      extended by edu.umd.cloud9.collection.wikipedia.WikipediaDocnoMappingBuilder
All Implemented Interfaces:
DocnoMapping.Builder, Configurable, Tool

public class WikipediaDocnoMappingBuilder
extends Configured
implements Tool, DocnoMapping.Builder

Tool for building the mapping between Wikipedia internal ids (docids) and sequentially-numbered ints (docnos).

Author:
Jimmy Lin, Peter Exner

Field Summary
static String INPUT_OPTION
           
static String KEEP_ALL_OPTION
           
static String LANGUAGE_OPTION
           
static String OUTPUT_FILE_OPTION
           
 
Constructor Summary
WikipediaDocnoMappingBuilder()
           
 
Method Summary
 int build(Path src, Path dest, Configuration conf)
           
static void main(String[] args)
           
 int run(String[] args)
           
 
Methods inherited from class org.apache.hadoop.conf.Configured
getConf, setConf
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 
Methods inherited from interface org.apache.hadoop.conf.Configurable
getConf, setConf
 

Field Detail

INPUT_OPTION

public static final String INPUT_OPTION
See Also:
Constant Field Values

OUTPUT_FILE_OPTION

public static final String OUTPUT_FILE_OPTION
See Also:
Constant Field Values

KEEP_ALL_OPTION

public static final String KEEP_ALL_OPTION
See Also:
Constant Field Values

LANGUAGE_OPTION

public static final String LANGUAGE_OPTION
See Also:
Constant Field Values
Constructor Detail

WikipediaDocnoMappingBuilder

public WikipediaDocnoMappingBuilder()
Method Detail

build

public int build(Path src,
                 Path dest,
                 Configuration conf)
          throws IOException
Specified by:
build in interface DocnoMapping.Builder
Throws:
IOException

run

public int run(String[] args)
        throws Exception
Specified by:
run in interface Tool
Throws:
Exception

main

public static void main(String[] args)
                 throws Exception
Throws:
Exception