Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # dev - Review Request 14155: HIVE-5297 Hive does not honor type for partition columns


Copy link to this message
-
Re: Review Request 14155: HIVE-5297 Hive does not honor type for partition columns
Vikram Dixit Kumaraswamy 2013-09-17, 17:51

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14155/#review26164
-----------------------------------------------------------

common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
<https://reviews.apache.org/r/14155/#comment51125>

    Folks may be depending on this 'feature'. Debatable, open to others opinions.

ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
<https://reviews.apache.org/r/14155/#comment51126>

    Yes.
    
    Updated the check as well.

ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
<https://reviews.apache.org/r/14155/#comment51127>

    Cannot as I need to look up the key in different maps and the ordering cannot be guaranteed.
- Vikram Dixit Kumaraswamy
On Sept. 17, 2013, 9:08 a.m., Vikram Dixit Kumaraswamy wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/14155/
> -----------------------------------------------------------
>
> (Updated Sept. 17, 2013, 9:08 a.m.)
>
>
> Review request for hive and Ashutosh Chauhan.
>
>
> Bugs: HIVE-5297
>     https://issues.apache.org/jira/browse/HIVE-5297
>
>
> Repository: hive-git
>
>
> Description
> -------
>
> Hive does not consider the type of the partition column while writing partitions. Consider for example the query:
>
> create table tab1 (id1 int, id2 string) PARTITIONED BY(month string,day int) row format delimited fields terminated by ',';
> alter table tab1 add partition (month='June', day='second');
>
> Hive accepts this query. However if you try to select from this table and insert into another expecting schema match, it will insert nulls instead.
>
>
> Diffs
> -----
>
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 1af68a6
>   ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java 393ef57
>   ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 2ece97e
>   ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java a704462
>   ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java fb79823
>   ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g ca667d4
>   ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java 767f545
>   ql/src/test/queries/clientnegative/illegal_partition_type.q PRE-CREATION
>   ql/src/test/queries/clientnegative/illegal_partition_type2.q PRE-CREATION
>   ql/src/test/queries/clientpositive/partition_type_check.q PRE-CREATION
>   ql/src/test/results/clientnegative/alter_table_add_partition.q.out bd9c148
>   ql/src/test/results/clientnegative/alter_view_failure5.q.out 4edb82c
>   ql/src/test/results/clientnegative/illegal_partition_type.q.out PRE-CREATION
>   ql/src/test/results/clientnegative/illegal_partition_type2.q.out PRE-CREATION
>   ql/src/test/results/clientpositive/parititon_type_check.q.out PRE-CREATION
>   ql/src/test/results/clientpositive/partition_type_check.q.out PRE-CREATION
>
> Diff: https://reviews.apache.org/r/14155/diff/
>
>
> Testing
> -------
>
> Ran all tests.
>
>
> Thanks,
>
> Vikram Dixit Kumaraswamy
>
>