Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # dev - Review Request 13186: PIG-3395 Large filter expression makes Pig hang


Copy link to this message
-
Review Request 13186: PIG-3395 Large filter expression makes Pig hang
Cheolsoo Park 2013-08-01, 04:14

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/13186/
-----------------------------------------------------------

Review request for pig.
Bugs: PIG-3395
    https://issues.apache.org/jira/browse/PIG-3395
Repository: pig-git
Description
-------

Refactors PColFilterExtractor so that a large filter expression can be processed w/ reasonable heap size. Currently, a large filter expression that consists of more than 50 or/and expressions chokes Pig.
Diffs
-----

  src/org/apache/pig/newplan/PColFilterExtractor.java 32ba788
  test/org/apache/pig/test/TestPartitionFilterPushDown.java b6b26f4

Diff: https://reviews.apache.org/r/13186/diff/
Testing
-------

Adds new test cases to TestPartitionFilterPushDown.

All unit tests pass.
Thanks,

Cheolsoo Park

+
Rohini Palaniswamy 2013-08-01, 21:41