Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Pig script compiling too slow with pig-0.10 and pig-0.11


Copy link to this message
-
Re: Pig script compiling too slow with pig-0.10 and pig-0.11
Can you try this on trunk and let me know if you have a similar error?

Also can you turn on DEBUG and say if it is taking forever during or after
parsing?
2013/3/6 Haitao Yao <[EMAIL PROTECTED]>

> Hi all
>         I have a big pig script running under pig-0.9.2. While upgrading
> to pig 0.11 or 0.10, the script needs to be compiled for 2 hours! This is
> unbelievable. What new compile rules are added in pig 0.10? With pig-0.9.2,
> the job compilation is done only within several minutes.
>
>         Thanks.
>
>
> Haitao Yao
> [EMAIL PROTECTED]
> weibo: @haitao_yao
> Skype:  haitao.yao.final
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB