Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Push limit into custom LoadFunc


Copy link to this message
-
Re: Push limit into custom LoadFunc
Mike, it's done automatically -- the operator will just stop asking
the loader for more elements.
If you observe something to the contrary, please let us know!

On Wed, Nov 28, 2012 at 7:11 PM, Mike Drob <[EMAIL PROTECTED]> wrote:
> Hello,
>
> According to https://issues.apache.org/jira/browse/PIG-1270 the execution
> engine can push limit operations into loads. If I am writing a custom
> LoadFunc in Java, what do I need to implement in order to take advantage of
> this optimization, or does the pipeline handle it for me automatically?
>
> Thanks,
> Mike