Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Re: Dynamic partition - support for distribute by


Copy link to this message
-
Re: Dynamic partition - support for distribute by
Not sure about that, but this is supported:

FROM (SELECT *, dt from table_a DISTRIBUTE BY dt) T
        INSERT OVERWRITE TABLE table_b PARTITION(dt)
                SELECT * ;

On Mar 1, 2011, at 5:28 AM, Wil - wrote:

> Hi,
>
> Reading the wiki on dynamic partition, there is best practice example to solve
> the issue of creating too many dynamic partitions on a specific node. However,
> the query does not work.
> (http://wiki.apache.org/hadoop/Hive/Tutorial#Dynamic-partition_Insert)
>
>
> Is this form of query support?
>
>
> FROM table_a
> INSERT OVERWRITE TABLE table_b PARTITION(dt)
> SELECT * FROM (
> SELECT *, dt
> DISTRIBUTE BY dt
> ) T;
>
> Thanks,
> --wil
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB