Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Pig Map-reduce process


Copy link to this message
-
Re: Pig Map-reduce process
Adam Kawa 2013-12-01, 20:32
Did you try to use EXPLAIN operator?
http://pig.apache.org/docs/r0.12.0/test.html#explain.

2013/10/9 Krishnan Narayanan <[EMAIL PROTECTED]>

> Hi All,
>
> Can someone explain map-reduce process flow for the below script?
>
> b =  FOREACH a{ P_EVAR =  REPLACE(PEVAR35,'-','');
>                P_LEN = LENGTH(P_EVAR);
>                P_EVAR_10 = (LENGTH(P_EVAR) == 11 ?
> CONCAT(SUBSTRING(P_EVAR,8,11),SUBSTRING(P_EVAR,4,8)) : (LENGTH(P_EVAR) => 12 ?CONCAT(SUBSTRING(P_EVAR,8,12),SUBSTRING(P_EVAR,4,8)) : (LENGTH(P_EVAR)
> == 13 ? CONCAT(SUBSTRING(P_EVAR,9,13),SUBSTRING(P_EVAR,4,9)) : P_EVAR )));
> GENERATE P_EVAR,P_LEN,P_EVAR_10;
> };
>
> Thanks
> Krishnan
>