James Newhaven 2012-04-10, 20:33
-Re: LIMIT operator doesn't work with variables
Stan Rosenberg 2012-04-10, 21:11
I believe the syntax of LIMIT does not admit an arbitrary expression;
it only admits constants. At least this is what the documentation
On Tue, Apr 10, 2012 at 4:33 PM, James Newhaven
<[EMAIL PROTECTED]> wrote:
> I am trying to a limit the output size using LIMIT. I want to the limit
> size to be 5 percent of the total output size like this:
> -- Put all the inids in a bag so we can count them.
> G = GROUP F ALL;
> -- Count everything in the bag
> H = FOREACH G GENERATE COUNT_STAR(F) AS total;
> -- Limit out to 5 percent of the total.
> I = LIMIT F H.total * 0.05;
> However, when I define the last line with the LIMIT operator, I get the
> following error. Does anyone know a way around this?
> ERROR 1200: <line 362, column 12> mismatched input 'H' expecting set null
> Failed to parse: <line 362, column 12> mismatched input 'H' expecting set
> at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:222)
Dmitriy Ryaboy 2012-04-10, 21:20
James Newhaven 2012-04-10, 21:42
Dmitriy Ryaboy 2012-04-10, 22:14