Pig, mail # user - Pig script compiling too slow with pig-0.10 and pig-0.11

Pig script compiling too slow with pig-0.10 and pig-0.11

Haitao Yao 2013-03-06, 06:32

Hi all
I have a big pig script running under pig-0.9.2. While upgrading to pig 0.11 or 0.10, the script needs to be compiled for 2 hours! This is unbelievable. What new compile rules are added in pig 0.10? With pig-0.9.2, the job compilation is done only within several minutes.

Thanks.
Haitao Yao
[EMAIL PROTECTED]
weibo: @haitao_yao
Skype: haitao.yao.final

Re: Pig script compiling too slow with pig-0.10 and pig-0.11

Jonathan Coveney 2013-03-06, 13:21

Can you try this on trunk and let me know if you have a similar error?

Also can you turn on DEBUG and say if it is taking forever during or after
parsing?
2013/3/6 Haitao Yao <[EMAIL PROTECTED]>

> Hi all
> I have a big pig script running under pig-0.9.2. While upgrading
> to pig 0.11 or 0.10, the script needs to be compiled for 2 hours! This is
> unbelievable. What new compile rules are added in pig 0.10? With pig-0.9.2,
> the job compilation is done only within several minutes.
>
> Thanks.
>
>
> Haitao Yao
> [EMAIL PROTECTED]
> weibo: @haitao_yao
> Skype: haitao.yao.final
>
>