|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.hadoop.conf.Configured
edu.umd.cloud9.util.CombineSequenceFiles
public class CombineSequenceFiles
Combine a number of sequence files into a smaller number of sequence files.
Input: Any number of sequence files containing key-value pairs, each of a certain type.
Output: N sequence or text files containing all key-value pairs given as input.
Given the number of desired sequence files, say N, map over a number of sequence files and partition all key-value pairs into N.
Usage: [input] [output-dir] [number-of-mappers] [number-of-reducers] [key-class-name] [value-class-name] [seqeuence|text]
| Constructor Summary | |
|---|---|
CombineSequenceFiles()
|
|
| Method Summary | |
|---|---|
static void |
main(String[] args)
|
int |
run(String[] args)
|
| Methods inherited from class org.apache.hadoop.conf.Configured |
|---|
getConf, setConf |
| Methods inherited from class java.lang.Object |
|---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Methods inherited from interface org.apache.hadoop.conf.Configurable |
|---|
getConf, setConf |
| Constructor Detail |
|---|
public CombineSequenceFiles()
| Method Detail |
|---|
public int run(String[] args)
throws Exception
run in interface ToolException
public static void main(String[] args)
throws Exception
Exception
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||