Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> NameNode per-block memory usage?

Otis Gospodnetic 2012-01-17, 15:08
Copy link to this message
Re: NameNode per-block memory usage?
> How much memory/JVM heap does NameNode use for each block?

I don't remember the exact number, it also depends on which version of
Hadoop you're using

> http://search-hadoop.com/m/O886P1VyVvK1 - 1 GB heap for every object?

It's 1 GB for every *million* objects (files, blocks, etc.). This is a
good rule of thumb, at least for the 0.20.x/1.0.0 series.

Is there a reason you need a more exact estimate?


Joseph Echeverria
Cloudera, Inc.
Edward Capriolo 2012-01-17, 15:22
M. C. Srivas 2012-01-17, 22:28
prasenjit mukherjee 2012-01-18, 12:39
ke yuan 2012-01-31, 05:31