edu.umd.cloud9.webgraph
Class TrecExtractLinks

java.lang.Object
  org.apache.hadoop.conf.Configured
      edu.umd.cloud9.util.PowerTool
          edu.umd.cloud9.webgraph.TrecExtractLinks

All Implemented Interfaces:

Configurable, Tool

public class TrecExtractLinks
extends PowerTool

Author:

Nima Asadi, Fangyue Wang, metzler

Nested Class Summary

static class	TrecExtractLinks.Map
static class	TrecExtractLinks.Reduce

Field Summary

static String[]

RequiredParameters

Constructor Summary

TrecExtractLinks(Configuration conf)

TrecExtractLinks(Configuration conf, CollectionConfigurationManager confer)

Method Summary

String[]	getRequiredParameters()
static void	recursivelyAddInputPaths(Job job, String path)
int	runTool()

Methods inherited from class edu.umd.cloud9.util.PowerTool

run, run

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

RequiredParameters

public static final String[] RequiredParameters

Constructor Detail

TrecExtractLinks

public TrecExtractLinks(Configuration conf)

TrecExtractLinks

public TrecExtractLinks(Configuration conf,
                        CollectionConfigurationManager confer)

Method Detail

getRequiredParameters

public String[] getRequiredParameters()

Specified by:

getRequiredParameters in class PowerTool

runTool

public int runTool()
            throws Exception

Specified by:

runTool in class PowerTool

Throws:

Exception

recursivelyAddInputPaths

public static void recursivelyAddInputPaths(Job job,
                                            String path)
                                     throws IOException

Throws:

IOException