Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> error


+
jamal sasha 2012-12-12, 19:23
What is the intention of the script?
foreach on the 'gruped' field here means you'll get only a single row
(because of GROUP .. ALL). the field features.f0 will be a bag.
mf0 is also a bag. Refer to
http://pig.apache.org/docs/r0.7.0/piglatin_ref2.html#Data+Types

Division of 2 bags doesnt make a lot of sense.
I'm guessing mf0 set contains only a single line, but what's the intent of
the script here?

On Thu, Dec 13, 2012 at 12:55 AM, jamal sasha <[EMAIL PROTECTED]> wrote:

> Eh sorry
>
> nf0 = foreach gruped generate features.id,features.f0/mf0;
>
> Should be
> nf0 = foreach gruped generate data.id,data.f0/mf0;
> ---------- Forwarded message ----------
> From: jamal sasha
> Date: Wednesday, December 12, 2012
> Subject: error
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>
>
>
>
> mf0 = LOAD 'max.txt’ AS (maxi:double);
>
> data =  LOAD
>
> '/axp/rimimsat/userdata/msing137/hadoop_streaming/final_anomaly_detection/step3/output'
> USING PigStorage(',')
>
>                                                 AS (id:long, f0:double)
>
> gruped =  group data all;
>
> nf0 = foreach gruped generate features.id,features.f0/mf0;
>
>
>
> But I am getting an error in last line?
>
> Invalid scalar projection: mf0 : A column needs to be projected from a
> relation for it to be used as a scalar
>
>
>
>
>
> What am I missing
>
> Thanks
>