Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Nested Binary Condition operators takes too much time to compile, PIG 0.11


Copy link to this message
-
Re: Nested Binary Condition operators takes too much time to compile, PIG 0.11
Hi Hitesh,

Sounds like you're hitting this bug-
https://issues.apache.org/jira/browse/PIG-2769

This is fixed in 0.12.0 (released) and 0.11.2 (not released).

Thanks,
Cheolsoo
On Thu, Dec 26, 2013 at 8:33 AM, Hitesh Patel <[EMAIL PROTECTED]>wrote:

> Hello,
>
> Below is the script which is working fine on PIG 0.8. Currently I am moving
> from PIG 0.8 to 0.11. Trying to execute the same code on PIG 0.11. Its
> taking too much time to compile the script.
>
> A = LOAD 'data' USING PigStorage(',') AS
> (code1:chararray,code2:chararray,code3:chararray);
> B = FOREACH A GENERATE
>     (code1 MATCHES '(val1|val2|val3|val4|val5|val6|val7|val8|val9)'?
> code1:'oth') AS code1,
>     (code2 MATCHES '(c1|c2|c3|v4|c5)'? code2: 'oth') AS code2,
>     code3;
> C = FOREACH B GENERATE
>         (code2 == 'c1'? (code1 == 'val1' AND code3 =='xval' ? 1 : ( code1
> == 'val1'? 2: ( code1 == 'val2'? 3: ( code1 == 'val3'? 4: ( code1 => 'val4'? 5:( code1 == 'val5'? 6:( code1 == 'val6'? 7 : ( code1 == 'val7'? 8:
> ( code1 == 'val8'? 9 :10))))))))) :
>         (code2 == 'c2' ? (code1 == 'val1' AND code3 =='xval' ? 11 : ( code1
> == 'val1'? 12: ( code1 == 'val2'? 13: ( code1 == 'val3'? 14: ( code1 => 'val4'? 15:( code1 == 'val5'? 16:( code1 == 'val6'? 17 : 18))))))) :
>          (code2 == 'c3' ? (code1 =='val1' ? 19 : ( code1 == 'val2'? 20: (
> code1 == 'val3'? 21: ( code1 == 'val4'? 22: ( code1 == 'val5'? 23:24))))):
>           (code2 == 'c4' ? (code1 =='val1' ? 25: ( code1 == 'val2'? 26: (
> code1 == 'val3'? 27: ( code1 == 'val4'? 28: 29)))) :
>             (code1 =='val1' ? 30 : ( code1 == 'val2'? 31: ( code1 => 'val3'? 32: ( code1 == 'val4'? 33: ( code1 == 'val5'? 34:35))))))))) as
> code1,
>         (code2 == 'c1' ? 1: (code2== 'c2' ? 2 :( code2=='c3' ? 3 : (code2=> 'c4'? 4:5)))) AS code2;
>
> I am using Cloudera distribution. I tried same code on grunts for PIG 0.8
> and PIG.11. On PIG 0.8 it compiles within a moment. On PIG 0.11 I executed
> the line and waited almost for 12 mins, but control didn't come back grunt.
>
> Do I need to set anything which I missed and having this problem?
>
> --
> Regards,
> Hitesh Patel
> Bardoli
> Fix:- 91 2622 222299
> Mob:- 91 942 835 7400
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB