Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> wrong sort order (lexical vs numeric) in a nested foreach


+
Lauren Blau 2012-08-30, 21:59
Copy link to this message
-
Re: wrong sort order (lexical vs numeric) in a nested foreach
sorry, premature email :-).

relation = key1 ,key2,orderkey1,val; //schema is
(chararray,int,int,chararray);

groupbykey = group relation by (key1,key2);
foreach groupbykey {
    sorted = order  relation by orderkey1;
    generate flatten($0), MyUDF(sorted);
}

I notice that when the 'sorted' values arrive in my UDF, they are sorted
lexically, not numerically. I checked the schema on the way in and
orderkey1 is definitely an int.

Is there any way to force the order by into a numeric sort?

Thanks,
Lauren

On Thu, Aug 30, 2012 at 5:59 PM, Lauren Blau <
[EMAIL PROTECTED]> wrote:

> I have the following foreach:
>
> foo := foreach bar {
>
>
+
Lauren Blau 2012-08-31, 09:42
+
=?KOI8-U?B?96bUwcymyiD0yc... 2012-08-31, 20:55
+
Dmitriy Ryaboy 2012-09-01, 04:42
+
Lauren Blau 2012-09-04, 18:05
+
Lauren Blau 2012-09-04, 20:27