Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - dynamic Partition not splitting properly


+
Hamza Asad 2013-06-12, 13:47
Copy link to this message
-
Re: dynamic Partition not splitting properly
Nitin Pawar 2013-06-12, 13:50
you did not create partitioned table. You just created a bucketed table.

refer to partitioned table created
something like
partitioned by (event_date string)
On Wed, Jun 12, 2013 at 7:17 PM, Hamza Asad <[EMAIL PROTECTED]> wrote:

> i have created table after enabling dynamic partition. i partitioned it on
> date but it is not splitting data datewise. Below is the query of table
> created and data insert
> CREATE TABLE rc_partition_cluster_table(
>   id int,
>   event_id int,
>   user_id BIGINT,
>   event_date string,
>   intval_1 int )
> CLUSTERED BY(id) INTO 256 BUCKETS
> ROW FORMAT DELIMITED
>  FIELDS TERMINATED BY ','
> STORED AS RCFile;
>
> set hive.exec.dynamic.partition=true;
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.exec.max.dynamic.partitions=1000;
> set hive.exec.max.dynamic.partitions.pernode=1000;
>
> INSERT OVERWRITE TABLE rc_partition_cluster_table Partition (event_date)
> SELECT * FROM events_details;
>
> why it is not working fine?
>
> --
> *Muhammad Hamza Asad*
>

--
Nitin Pawar
+
Hamza Asad 2013-06-13, 11:10
+
Nitin Pawar 2013-06-13, 11:12
+
Hamza Asad 2013-06-13, 11:49
+
Nitin Pawar 2013-06-13, 11:52
+
Hamza Asad 2013-06-13, 11:54
+
Nitin Pawar 2013-06-13, 12:07
+
Hamza Asad 2013-06-14, 06:39
+
Nitin Pawar 2013-06-14, 06:54
+
Hamza Asad 2013-06-14, 07:01
+
Nitin Pawar 2013-06-14, 07:27
+
Hamza Asad 2013-06-14, 07:34
+
Nitin Pawar 2013-06-14, 07:41
+
Hamza Asad 2013-06-14, 07:51
+
Nitin Pawar 2013-06-14, 08:30
+
Hamza Asad 2013-06-14, 08:38
+
Hamza Asad 2013-06-16, 13:08