Package edu.umd.cloud9.collection.wikipedia

Provides classes for working with Wikipedia XML dumps.

See:
          Description

Class Summary
CountWikipediaPages Tool for counting the number of pages in a particular Wikipedia XML dump file.
DumpWikipediaToPlainText Tool for taking a Wikipedia XML dump file and spits out articles in a flat text file (article title and content, separated by a tab).
LookupWikipediaArticle Tool for providing command-line access to page titles given either a docno or a docid.
RepackWikipedia Tool for repacking Wikipedia XML dumps into SequenceFiles.
WikipediaDocnoMapping Provides a mapping between Wikipedia internal ids (docids) and sequentially-numbered ints (docnos).
WikipediaDocnoMappingBuilder Tool for building the mapping between Wikipedia internal ids (docids) and sequentially-numbered ints (docnos).
WikipediaForwardIndex Forward index for Wikipedia collections.
WikipediaForwardIndexBuilder Tool for building a document forward index for Wikipedia.
WikipediaPage A page from Wikipedia.
WikipediaPage.Link  
WikipediaPageInputFormat Hadoop InputFormat for processing Wikipedia pages from the XML dumps.
WikipediaPageInputFormat.WikipediaPageRecordReader  
WikipediaPageInputFormatOld Hadoop InputFormat for processing Wikipedia pages from the XML dumps.
WikipediaPageInputFormatOld.WikipediaPageRecordReader Hadoop RecordReader for reading Wikipedia pages from the XML dumps.
WikipediaPagesBz2InputStream Class for working with bz2-compressed Wikipedia article dump files on local disk.
 

Package edu.umd.cloud9.collection.wikipedia Description

Provides classes for working with Wikipedia XML dumps.