Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> memory leak


Copy link to this message
-
Re: memory leak
On Tue, Nov 20, 2012 at 7:45 PM, Yusup Ashrap <[EMAIL PROTECTED]> wrote:
> hi all, I am encountering with high memory usage problem in my production
> environment.I doubt this is caused by memory leak or something,
> and I hope someone could tell me what is going on , or what should I do to
> to keep a lower memory footprint, or any ways or tools to find out what is
> causing so much memory footprint.my cluster have 24 nodes, and here is some
> info from my random one node.
>
> hbase version:0.90.2

Can you upgrade your hbase?  This is an old version.  What version of
hadoop are you running?

> I used google-perftools  to do the heap profiling and i got this.
>
> Total: 213.9 MB
>    154.4  72.2%  72.2%    154.4  72.2% os::malloc
>     18.8   8.8%  81.0%     20.6   9.7% CMSCollector::CMSCollector
>     13.0   6.1%  87.1%     13.0   6.1% ParNewGeneration::ParNewGeneration
>      9.6   4.5%  91.6%      9.6   4.5% ObjectSynchronizer::omAlloc
>      3.0   1.4%  93.0%      3.0   1.4% init
>      2.8   1.3%  94.3%      2.8   1.3% AllocateHeap
>      2.3   1.1%  95.3%      2.3   1.1% zcalloc
>      1.7   0.8%  96.1%      1.7   0.8% nmethod::nmethod
>      1.3   0.6%  96.7%      1.3   0.6% SymbolTable::basic_add
>      1.2   0.6%  97.3%      1.4   0.6%

...

I've not used this tool before.  Its output includes that of the JVM
itself which would tend to occlude any picture of what hbase is doing
inside in the JVM.

Are you OOMEing?

St.Ack