org.apache.hadoop.hbase.favored

Class FavoredNodeLoadBalancer

java.lang.Object

org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer

org.apache.hadoop.hbase.favored.FavoredNodeLoadBalancer

All Implemented Interfaces:

ConfigurationObserver, FavoredNodesPromoter, LoadBalancer, Stoppable

@InterfaceAudience.LimitedPrivate(value="Configuration")
public class FavoredNodeLoadBalancer
extends BaseLoadBalancer
implements FavoredNodesPromoter

An implementation of the LoadBalancer that assigns favored nodes for each region. There is a Primary RegionServer that hosts the region, and then there is Secondary and Tertiary RegionServers. Currently, the favored nodes information is used in creating HDFS files - the Primary RegionServer passes the primary, secondary, tertiary node addresses as hints to the DistributedFileSystem API for creating files on the filesystem. These nodes are treated as hints by the HDFS to place the blocks of the file. This alleviates the problem to do with reading from remote nodes (since we can make the Secondary RegionServer as the new Primary RegionServer) after a region is recovered. This should help provide consistent read latencies for the regions even when their primary region servers die.

Field Summary

Fields inherited from class org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer

BALANCER_DECISION_BUFFER_ENABLED, BALANCER_REJECTION_BUFFER_ENABLED, clusterStatus, DEFAULT_BALANCER_DECISION_BUFFER_ENABLED, DEFAULT_BALANCER_REJECTION_BUFFER_ENABLED, DEFAULT_HBASE_MASTER_LOADBALANCE_BYTABLE, isByTable, masterServerName, metricsBalancer, MIN_SERVER_BALANCE, provider, rackManager, regionFinder, slop, useRegionFinder

Fields inherited from interface org.apache.hadoop.hbase.favored.FavoredNodesPromoter

FAVORED_ALWAYS_ASSIGN_REGIONS

Fields inherited from interface org.apache.hadoop.hbase.master.LoadBalancer

BOGUS_SERVER_NAME, HBASE_RSGROUP_LOADBALANCER_CLASS

Constructor Summary

Constructors

Constructor and Description
FavoredNodeLoadBalancer()

Method Summary

Modifier and Type	Method and Description
protected List<RegionPlan>	balanceTable(TableName tableName, Map<ServerName,List<RegionInfo>> loadOfOneTable) Perform the major balance operation for table, all sub classes should override this method.
void	generateFavoredNodesForDaughter(List<ServerName> servers, RegionInfo parent, RegionInfo regionA, RegionInfo regionB)
void	generateFavoredNodesForMergedRegion(RegionInfo merged, RegionInfo[] mergeParents)
List<ServerName>	getFavoredNodes(RegionInfo regionInfo)
ServerName	randomAssignment(RegionInfo regionInfo, List<ServerName> servers) Used to assign a single region to a random server.
Map<ServerName,List<RegionInfo>>	roundRobinAssignment(List<RegionInfo> regions, List<ServerName> servers) Generates a bulk assignment plan to be used on cluster startup using a simple round-robin assignment.
void	setFavoredNodesManager(FavoredNodesManager fnm)

Methods inherited from class org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer

balanceCluster, getConf, getDefaultSlop, idleRegionServerExist, initialize, isStopped, loadConf, onConfigurationChange, postMasterStartupInitialize, preBalanceCluster, regionOffline, regionOnline, retainAssignment, setClusterInfoProvider, sloppyRegionServerExist, stop, toEnsumbleTableLoad, updateBalancerStatus, updateClusterMetrics

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.master.LoadBalancer

updateBalancerLoadInfo

Constructor Detail

FavoredNodeLoadBalancer

public FavoredNodeLoadBalancer()

Method Detail

setFavoredNodesManager

public void setFavoredNodesManager(FavoredNodesManager fnm)

Specified by:

setFavoredNodesManager in interface FavoredNodesPromoter

balanceTable

protected List<RegionPlan> balanceTable(TableName tableName,
                                        Map<ServerName,List<RegionInfo>> loadOfOneTable)

Description copied from class: BaseLoadBalancer

Perform the major balance operation for table, all sub classes should override this method.

Will be invoked by BaseLoadBalancer.balanceCluster(Map). If HConstants.HBASE_MASTER_LOADBALANCE_BYTABLE is enabled, we will call this method multiple times, one table a time, where we will only pass in the regions for a single table each time. If not, we will pass in all the regions at once, and the tableName will be HConstants.ENSEMBLE_TABLE_NAME.

Specified by:

balanceTable in class BaseLoadBalancer

Parameters:

tableName - the table to be balanced

loadOfOneTable - region load of servers for the specific one table

Returns:

List of plans

roundRobinAssignment

@NonNull
public Map<ServerName,List<RegionInfo>> roundRobinAssignment(List<RegionInfo> regions,
                                                                      List<ServerName> servers)
                                                               throws HBaseIOException

Description copied from class: BaseLoadBalancer

Generates a bulk assignment plan to be used on cluster startup using a simple round-robin assignment.

Takes a list of all the regions and all the servers in the cluster and returns a map of each server to the regions that it should be assigned.

Currently implemented as a round-robin assignment. Same invariant as load balancing, all servers holding floor(avg) or ceiling(avg). TODO: Use block locations from HDFS to place regions with their blocks

Specified by:

roundRobinAssignment in interface LoadBalancer

Overrides:

roundRobinAssignment in class BaseLoadBalancer

Parameters:

regions - all regions

servers - all servers

Returns:

map of server to the regions it should take, or emptyMap if no assignment is possible (ie. no servers)

Throws:

HBaseIOException

randomAssignment

public ServerName randomAssignment(RegionInfo regionInfo,
                                   List<ServerName> servers)
                            throws HBaseIOException

Description copied from class: BaseLoadBalancer

Used to assign a single region to a random server.

Specified by:

randomAssignment in interface LoadBalancer

Overrides:

randomAssignment in class BaseLoadBalancer

Parameters:

regionInfo - Region for which this selection is being done.

Throws:

HBaseIOException

getFavoredNodes

public List<ServerName> getFavoredNodes(RegionInfo regionInfo)

Specified by:

getFavoredNodes in interface FavoredNodesPromoter

generateFavoredNodesForDaughter

public void generateFavoredNodesForDaughter(List<ServerName> servers,
                                            RegionInfo parent,
                                            RegionInfo regionA,
                                            RegionInfo regionB)
                                     throws IOException

Specified by:

generateFavoredNodesForDaughter in interface FavoredNodesPromoter

Throws:

IOException

generateFavoredNodesForMergedRegion

public void generateFavoredNodesForMergedRegion(RegionInfo merged,
                                                RegionInfo[] mergeParents)
                                         throws IOException

Specified by:

generateFavoredNodesForMergedRegion in interface FavoredNodesPromoter

Throws:

IOException