Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Yet more NPEs with TOP

Copy link to this message
Yet more NPEs with TOP
Hello all,

I have a bit of a maddening issue with builtin TOP. Consider the
following script:
A = LOAD '$DATA' AS (a_bag:bag {t:tuple (value:double)});
        top_one = TOP(1,0,a_bag);
        GENERATE FLATTEN(top_one) AS (value);

Most of the time this script works just fine. However, for the following
piece of data it fails:

Now, I understand it has a null field, but I've confirmed that TOP
handles this fine by passing in various things like {(),()} and so on.
What makes it yet more strange is that deleting a single _arbitrary_
entry from the line above gets rid of the error.
I really have no idea what's going on.

Any ideas?