com.google.cloud.bigtable.mapreduce.hbasesnapshots

Class ShuffledTableSnapshotInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<ImmutableBytesWritable,Result>

org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat

com.google.cloud.bigtable.mapreduce.hbasesnapshots.ShuffledTableSnapshotInputFormat

public class ShuffledTableSnapshotInputFormat
extends TableSnapshotInputFormat

A SnapshotInputFormat that randomizes the order of snapshot splits. This is needed for the Bigtable import job to spread the load across all of the Bigtable tablet servers and allows Bigtable to create initial split quicker.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat

TableSnapshotInputFormat.TableSnapshotRegionSplit

Constructor Summary

Constructors

Constructor and Description
ShuffledTableSnapshotInputFormat()

Method Summary

Modifier and Type	Method and Description
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext job)

Methods inherited from class org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat

createRecordReader, setInput, setInput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ShuffledTableSnapshotInputFormat

public ShuffledTableSnapshotInputFormat()

Method Detail

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext job)
                                                       throws IOException,
                                                              InterruptedException

Overrides:

getSplits in class TableSnapshotInputFormat

Throws:

IOException

InterruptedException