edu.umd.cloud9.util
Class CombineSequenceFiles

java.lang.Object
  extended by org.apache.hadoop.conf.Configured
      extended by edu.umd.cloud9.util.CombineSequenceFiles
All Implemented Interfaces:
Configurable, Tool

public class CombineSequenceFiles
extends Configured
implements Tool

Combine a number of sequence files into a smaller number of sequence files.

Input: Any number of sequence files containing key-value pairs, each of a certain type.

Output: N sequence or text files containing all key-value pairs given as input.

Given the number of desired sequence files, say N, map over a number of sequence files and partition all key-value pairs into N.

Usage: [input] [output-dir] [number-of-mappers] [number-of-reducers] [key-class-name] [value-class-name] [seqeuence|text]

Author:
ferhanture

Constructor Summary
CombineSequenceFiles()
           
 
Method Summary
static void main(String[] args)
           
 int run(String[] args)
           
 
Methods inherited from class org.apache.hadoop.conf.Configured
getConf, setConf
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 
Methods inherited from interface org.apache.hadoop.conf.Configurable
getConf, setConf
 

Constructor Detail

CombineSequenceFiles

public CombineSequenceFiles()
Method Detail

run

public int run(String[] args)
        throws Exception
Specified by:
run in interface Tool
Throws:
Exception

main

public static void main(String[] args)
                 throws Exception
Throws:
Exception