Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> dynamic Partition not splitting properly


Copy link to this message
-
Re: dynamic Partition not splitting properly
you did not create partitioned table. You just created a bucketed table.

refer to partitioned table created
something like
partitioned by (event_date string)
On Wed, Jun 12, 2013 at 7:17 PM, Hamza Asad <[EMAIL PROTECTED]> wrote:

> i have created table after enabling dynamic partition. i partitioned it on
> date but it is not splitting data datewise. Below is the query of table
> created and data insert
> CREATE TABLE rc_partition_cluster_table(
>   id int,
>   event_id int,
>   user_id BIGINT,
>   event_date string,
>   intval_1 int )
> CLUSTERED BY(id) INTO 256 BUCKETS
> ROW FORMAT DELIMITED
>  FIELDS TERMINATED BY ','
> STORED AS RCFile;
>
> set hive.exec.dynamic.partition=true;
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.exec.max.dynamic.partitions=1000;
> set hive.exec.max.dynamic.partitions.pernode=1000;
>
> INSERT OVERWRITE TABLE rc_partition_cluster_table Partition (event_date)
> SELECT * FROM events_details;
>
> why it is not working fine?
>
> --
> *Muhammad Hamza Asad*
>

--
Nitin Pawar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB