Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - memory leak


Copy link to this message
-
Re: memory leak
Stack 2012-11-21, 17:31
On Wed, Nov 21, 2012 at 12:16 AM, Yusup Ashrap <[EMAIL PROTECTED]> wrote:
>>Does your hadoop support append/sync?
> current version of hadoop supports append/sync ,but  we have not trun on
> explicitely in hdfs-site.xml.
>

Then you will lose data.
>>So, what is the worry?  You are using CMS?  It carries lots of
>>garbage.   If you are really concerned, then maybe dump a heap -- this
>>can take a while to write if your heap is large and you will freeze
>>the daemon while the heap is being written (be sure you write the heap
>>to a place that has space) -- and use one of the aforementioned tools
>>to inspect it.
>
> it's kinda delicate to dump heap now, and i tried once and regionserver
> process crashed .
> dumping heap process  ended simultaneously.
Yes.  I suppose.  If it takes a long time to dump it could hose the
regionserver.  Did it make a dump file that you could use?

St.Ack