Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Zookeeper >> mail # user >> setting zookeeper heap size


Copy link to this message
-
Re: setting zookeeper heap size
If you are using RHEL 6 chances are you're running into the newer per
thread allocator in recent glibc. See
http://www.quora.com/Why-do-some-applications-use-significantly-more-virtual-memory-on-RHEL-6-compared-to-RHEL-5

If so, it's harmless. Virtual memory address space is not a scarce
resource. If it concerns you, you can set MALLOC_ARENA_MAX to something
like 4 in the JVM's environment.

Henry

On Thursday, 10 November 2011, Camille Fournier <[EMAIL PROTECTED]> wrote:
> It's very odd for the jvm to chose a 6g heap. On a 64bit machine it might
> choose 2g, I've never seen it go larger without xmx. Check to see if you
> have some sort of flags unintentionally added.
>
> C
> From my phone
> On Nov 10, 2011 4:59 PM, "Patrick Hunt" <[EMAIL PROTECTED]> wrote:
>
>> In general ZK does not bound the heap size. The default is to use
>> whatever the JVM prefers, which is typically based on available host
>> memory. You can override this using JVMFLAGS.
>>
>> Patrick
>>
>> On Thu, Nov 10, 2011 at 1:47 PM, Ed Sexton <[EMAIL PROTECTED]>
wrote:
>> > Hello Group-
>> >
>> > I am running CDH zookeeper version 3.3.3+12.12 and noticed that
zookeeper
>> > is running with a heapsize of 6477m.
>> >
>> > I start zookeeper standalone, via /etc/init.d/hadoop-zookeeper-server.
 I
>> > do not see reference to any ZOOKEEPER_HEAPIZE in the startup or
zoo.cfg,
>> > nor do I see any special JVMFLAGS in export/usr/bin/zookeeper-server,
>> which
>> > is what is called by the startup script, it just has this definition:
>> >
>> > JVMFLAGS=-Dzookeeper.log.threshold=INFO
>> >
>> > Can someone guide me to where the 6GB heapsize is being referenced?
 This
>> > seems a bit large of a heap.
>> >
>> > Thanks for your guidance.
>> >
>> > Sincerely,
>> > Ed
>> >
>>
>

--
Henry Robinson
Software Engineer
Cloudera
415-994-6679
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB