Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Decide if function is algebraic at planning phase


Copy link to this message
-
Re: Decide if function is algebraic at planning phase
Hi!

Out of curiosity: what for? Algebraic works faster in most cases.

Possible solutions:
1) Maybe you can disable the use of combiner or something else that is
related. Maybe if you change the Configuration to
pig.exec.nocombiner=true
that will disable the use of Algebraic, but I am not sure, that's just a thought
2) You can embed pig into Java or Python from where you can construct
pig scripts pro grammatically, using the appropriate UDF
implementation

Best Regards, Ruslan

On Mon, Oct 8, 2012 at 11:01 PM, Ugljesa Stojanovic <[EMAIL PROTECTED]> wrote:
> I would like to be able to decide if I want to use the Algebraic or regular
> implementation of an EvalFunc on the front end (planning phase), preferably
> in the function constructor. Is there any way to do this? If I implement
> the interface the planner will automatically attempt to use it. Returning
> null when implementing it in those cases also doesn't work.
>
> Thanks,
> Ugljesa
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB