Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - Hbase heap size


+
Varun Sharma 2013-01-17, 21:15
Copy link to this message
-
Re: Hbase heap size
lars hofhansl 2013-01-17, 22:31
A good rule of thumb that I found is to give each region server a Java help that is roughly 1/100th of the size of the disk space per region server.
(that is assuming all the default setting: 10G regions, 128M memstores, 40% of heap for memstores, 20% of heap for block cache, 3-way replication)
That is, if you give the region server a 10G heap, you can expect to be able to serve about 1T worth of disk space.

That can be tweaked of course (increase the region size to 20G, if your load is mostly readonly you shrink the memstores, etc).
That way you can reduce that ratio to 1/200 or even less.
I'm sure other folks will have more detailed input.
-- Lars

________________________________
 From: Varun Sharma <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Thursday, January 17, 2013 1:15 PM
Subject: Hbase heap size
 
Hi,

I was wondering how much folks typical give to hbase and how much they
leave for the file system cache for the region server. I am using hbase
0.94 and running only the region server and data node daemons. I have a
system with 15G ram.

Thanks
+
Varun Sharma 2013-01-17, 23:24
+
lars hofhansl 2013-01-18, 02:24
+
Chalcy Raja 2013-01-18, 12:45
+
Varun Sharma 2013-01-18, 17:50
+
Adrien Mogenet 2013-01-18, 20:28
+
lars hofhansl 2013-01-18, 21:40
+
Varun Sharma 2013-01-18, 20:43