Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> How to set rolling region split size?


Copy link to this message
-
How to set rolling region split size?
Hi, all

    My cluster uses hbase 0.92.0.
    I'm now trying to split some big regions manually. (I configured
region file size to 20G)
    I ran it like this:
hbase org.apache.hadoop.hbase.util.RegionSplitter statistic_visit1 -r -o 2

    Before I split, the table statistic_visit1 has only one region:
[hadoop@hadoop01 ~]$ hadoop dfs -du /hbase/statistic_visit1
Found 3 items
5161         hdfs://hadoop01:51001/hbase/statistic_visit1/.tableinfo.0000000001
0            hdfs://hadoop01:51001/hbase/statistic_visit1/.tmp
58234791267  hdfs://hadoop01:51001/hbase/statistic_visit1/e15d089574adaeacaf75fd8e1277ce2d

    And after the split is done,
[hadoop@hadoop01 ~]$ hadoop dfs -du /hbase/statistic_visit1
Found 6 items
5161         hdfs://hadoop01:51001/hbase/statistic_visit1/.tableinfo.0000000001
0            hdfs://hadoop01:51001/hbase/statistic_visit1/.tmp
58234783527  hdfs://hadoop01:51001/hbase/statistic_visit1/0eae290663e59659fc728333d0b18b47
287          hdfs://hadoop01:51001/hbase/statistic_visit1/7865a928112751bcf27fce2cc8304441
80           hdfs://hadoop01:51001/hbase/statistic_visit1/_balancedSplit
58234787479  hdfs://hadoop01:51001/hbase/statistic_visit1/e15d089574adaeacaf75fd8e1277ce2d

    Does the split result look fine? And how can I get more regions?

    And is there any danger, if I resize the region file size setting
to a smaller value? (like 5G)

    Thanks.
--

Regards,
Cheng Su
+
Davey Yan 2012-11-14, 08:24
+
Cheng Su 2012-11-14, 09:30