Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> NameNode per-block memory usage?


Copy link to this message
-
Re: NameNode per-block memory usage?
> How much memory/JVM heap does NameNode use for each block?

I don't remember the exact number, it also depends on which version of
Hadoop you're using

> http://search-hadoop.com/m/O886P1VyVvK1 - 1 GB heap for every object?

It's 1 GB for every *million* objects (files, blocks, etc.). This is a
good rule of thumb, at least for the 0.20.x/1.0.0 series.

Is there a reason you need a more exact estimate?

-Joey

--
Joseph Echeverria
Cloudera, Inc.
443.305.9434
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB