Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Push limit into custom LoadFunc


+
Mike Drob 2012-11-29, 03:11
Copy link to this message
-
Re: Push limit into custom LoadFunc
Mike, it's done automatically -- the operator will just stop asking
the loader for more elements.
If you observe something to the contrary, please let us know!

On Wed, Nov 28, 2012 at 7:11 PM, Mike Drob <[EMAIL PROTECTED]> wrote:
> Hello,
>
> According to https://issues.apache.org/jira/browse/PIG-1270 the execution
> engine can push limit operations into loads. If I am writing a custom
> LoadFunc in Java, what do I need to implement in order to take advantage of
> this optimization, or does the pipeline handle it for me automatically?
>
> Thanks,
> Mike
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB