Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> dynamic Partition not splitting properly


Copy link to this message
-
Re: dynamic Partition not splitting properly
you did not create partitioned table. You just created a bucketed table.

refer to partitioned table created
something like
partitioned by (event_date string)
On Wed, Jun 12, 2013 at 7:17 PM, Hamza Asad <[EMAIL PROTECTED]> wrote:

> i have created table after enabling dynamic partition. i partitioned it on
> date but it is not splitting data datewise. Below is the query of table
> created and data insert
> CREATE TABLE rc_partition_cluster_table(
>   id int,
>   event_id int,
>   user_id BIGINT,
>   event_date string,
>   intval_1 int )
> CLUSTERED BY(id) INTO 256 BUCKETS
> ROW FORMAT DELIMITED
>  FIELDS TERMINATED BY ','
> STORED AS RCFile;
>
> set hive.exec.dynamic.partition=true;
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.exec.max.dynamic.partitions=1000;
> set hive.exec.max.dynamic.partitions.pernode=1000;
>
> INSERT OVERWRITE TABLE rc_partition_cluster_table Partition (event_date)
> SELECT * FROM events_details;
>
> why it is not working fine?
>
> --
> *Muhammad Hamza Asad*
>

--
Nitin Pawar