edu.umd.cloud9.collection.wikipedia
Class CountWikipediaPages

java.lang.Object
  extended by org.apache.hadoop.conf.Configured
      extended by edu.umd.cloud9.collection.wikipedia.CountWikipediaPages
All Implemented Interfaces:
Configurable, Tool

public class CountWikipediaPages
extends Configured
implements Tool

Tool for counting the number of pages in a particular Wikipedia XML dump file. This program keeps track of total number of pages, redirect pages, disambiguation pages, empty pages, actual articles (including stubs), stubs, and non-articles ("File:", "Category:", "Wikipedia:", etc.). This also provides a skeleton for MapReduce programs to process the collection. Specify input path to the Wikipedia XML dump file with the -input flag.

Author:
Jimmy Lin

Constructor Summary
CountWikipediaPages()
           
 
Method Summary
static void main(String[] args)
           
 int run(String[] args)
           
 
Methods inherited from class org.apache.hadoop.conf.Configured
getConf, setConf
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 
Methods inherited from interface org.apache.hadoop.conf.Configurable
getConf, setConf
 

Constructor Detail

CountWikipediaPages

public CountWikipediaPages()
Method Detail

run

public int run(String[] args)
        throws Exception
Specified by:
run in interface Tool
Throws:
Exception

main

public static void main(String[] args)
                 throws Exception
Throws:
Exception