Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # dev - Review Request 20051: HIVE-4904: A little more CP crossing RS boundaries


Copy link to this message
-
Re: Review Request 20051: HIVE-4904: A little more CP crossing RS boundaries
John Pullokkaran 2014-04-07, 18:03

This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20051/#review39706
I took a look at this change; my knowledge of hive code is rather limited.
1. Column Pruner doesn't cross Script operator boundary. Theoretically you could prune above and below the script op separately.
2. It seems column pruner assumes that parent of UDTF is always select; but we haven't formalized this assumption. Other processors should throw exception if it ever come across a child that is UDTF. Theoretically you can push down certain filters below builtin UDTF. We may not be doing that today.
3.  In Select Pruner it seems like there is no difference between 'prunedCols' and 'columns'.

- John Pullokkaran
On April 6, 2014, 1:33 a.m., Harish Butani wrote: