Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Pig 0.10.0 slow startup


Copy link to this message
-
Pig 0.10.0 slow startup
Hi All,

Just wanted to follow-up on Chun's question. Several of our Pig users have
been experiencing slow start-ups with Pig 0.10.0, when the same script runs
fine with 0.9.1. Anyone else facing similar issues?

Thanks,
Prashant

Hi all,

I'm trying to move from Pig 0.9.1 to Pig 0.10.0 . When I try to run the same
script using the two Pig versions, 0.9.1 starts off fast and almost
immediately submits the job to the cluster. On the other hand, Pig 0.10.0
takes forever to submit the job. When I use the java option
-XX:+PrintGCDetails, I see that for 0.10.0 the GC is being run many times
before and after the job is submitted to the cluster.

Does anyone know what is causing this and/or how I might be able to
troubleshoot it?

I've uploaded truncated output showing when GC happens to
Pastebin:http://pastebin.com/B8WTHW9r

Thanks,
Chun
+
Jonathan Coveney 2012-08-08, 05:07
+
Chun Yang 2012-08-08, 19:01
+
Jonathan Coveney 2012-08-08, 19:22
+
Chun Yang 2012-08-08, 22:04
+
Jonathan Coveney 2012-08-09, 00:38
+
Chun Yang 2012-08-09, 00:51
+
Jonathan Coveney 2012-08-09, 18:00
+
Chun Yang 2012-08-09, 22:32
+
Prashant Kommireddi 2012-08-10, 20:15
+
Dmitriy Ryaboy 2012-08-13, 23:44
+
Chun Yang 2012-07-26, 22:32
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB