Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Unhandled internal error. Java heap space when using EXPLAIN in pig


Copy link to this message
-
Unhandled internal error. Java heap space when using EXPLAIN in pig
When I try to use the following statement
explain -brief A;
I got the following error
2013-02-06 19:18:34,250 [Low Memory Detector] INFO     org.apache.pig.impl.util.SpillableMemoryManager - first memory handler call - Collection threshold init = 526123008(513792K) used = 349984528(341781K) committed = 699072512(682688K) max = 699072512(682688K)
2013-02-06 19:18:34,942 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. Java heap space
I tried to increase the heap space size by adding option
-Dmapred.child.java.opts=-Xmx4096m
but it didn't work. Any idea?
Thanks. Dan