Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # dev - LogicalExpressionSimplifier rules


Copy link to this message
-
LogicalExpressionSimplifier rules
Thejas Nair 2011-10-10, 22:40
Sending this email for getting wider attention.
I propose disabling LogicalExpressionSimplifier optimizer rule, because
the complexity of that rule and number of bugs that seem to come from
there does not justify the expected performance gains -
https://issues.apache.org/jira/browse/PIG-2316?focusedCommentId=13124489&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13124489

In general, I think any new code that is significantly complex (ie hard
to maintain, and likely source of bugs) should be added to pig only if
there are enough gains to justify it.

-Thejas