Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # dev >> Review Request 13186: PIG-3395 Large filter expression makes Pig hang


+
Cheolsoo Park 2013-08-01, 04:14
Copy link to this message
-
Re: Review Request 13186: PIG-3395 Large filter expression makes Pig hang

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/13186/#review24473
-----------------------------------------------------------

Ship it!
Ship It!

- Rohini Palaniswamy
On Aug. 1, 2013, 4:14 a.m., Cheolsoo Park wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/13186/
> -----------------------------------------------------------
>
> (Updated Aug. 1, 2013, 4:14 a.m.)
>
>
> Review request for pig.
>
>
> Bugs: PIG-3395
>     https://issues.apache.org/jira/browse/PIG-3395
>
>
> Repository: pig-git
>
>
> Description
> -------
>
> Refactors PColFilterExtractor so that a large filter expression can be processed w/ reasonable heap size. Currently, a large filter expression that consists of more than 50 or/and expressions chokes Pig.
>
>
> Diffs
> -----
>
>   src/org/apache/pig/newplan/PColFilterExtractor.java 32ba788
>   test/org/apache/pig/test/TestPartitionFilterPushDown.java b6b26f4
>
> Diff: https://reviews.apache.org/r/13186/diff/
>
>
> Testing
> -------
>
> Adds new test cases to TestPartitionFilterPushDown.
>
> All unit tests pass.
>
>
> Thanks,
>
> Cheolsoo Park
>
>