Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Create table like with partitions


+
Peter Marron 2013-06-10, 13:31
+
Nitin Pawar 2013-06-10, 13:38
+
Owen OMalley 2013-06-10, 14:06
+
Lefty Leverenz 2013-06-11, 07:03
+
Richa Sharma 2013-06-11, 08:23
+
Richa Sharma 2013-06-11, 12:34
+
Edward Capriolo 2013-06-11, 14:33
+
Dean Wampler 2013-06-11, 18:04
+
Sanjay Subramanian 2013-06-11, 22:46
+
Lefty Leverenz 2013-06-12, 00:39
Copy link to this message
-
Re: Create table like with partitions
+1 Its one of the very very usable hands on book published in this technical domain. Same here I bought both versions :-)

From: Lefty Leverenz <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Reply-To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Tuesday, June 11, 2013 5:39 PM
To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Subject: Re: Create table like with partitions

It's an excellent book, and not too expensive so I recommend buying your own copy from O'Reilly or Amazon.  (Not only will you have a legal copy, but you'll encourage authors to write more books for the benefit of all.)  I've got it in hardcover and digital format.

– Lefty

On Tue, Jun 11, 2013 at 6:46 PM, Sanjay Subramanian <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
>From Russia with Love...
Domain ID:D39022749-LRMS
Domain Name:IT-EBOOKS.INFO<http://IT-EBOOKS.INFO>
Created On:27-Jul-2011 12:24:45 UTC
Last Updated On:29-Apr-2013 11:00:03 UTC
Expiration Date:27-Jul-2015 12:24:45 UTC
Sponsoring Registrar:GoDaddy.com LLC (R171-LRMS)
Status:CLIENT DELETE PROHIBITED
Status:CLIENT RENEW PROHIBITED
Status:CLIENT TRANSFER PROHIBITED
Status:CLIENT UPDATE PROHIBITED
Registrant ID:CR89106899
Registrant Name:Artur Denisov
Registrant Organization:
Registrant Street1:Akademika Koroleva 21/5
Registrant Street2:
Registrant Street3:
Registrant City:Moscow
Registrant State/Province:Moscow
Registrant Postal Code:127427
Registrant Country:RU
Registrant Phone:+7.4957930823
Registrant Phone Ext.:
Registrant FAX:
Registrant FAX Ext.:
Registrant Email:[EMAIL PROTECTED]<mailto:Email%[EMAIL PROTECTED]>
Admin ID:CR89106901
Admin Name:Artur Denisov
Admin Organization:
Admin Street1:Akademika Koroleva 21/5
Admin Street2:
Admin Street3:
Admin City:Moscow
Admin State/Province:Moscow
Admin Postal Code:127427
Admin Country:RU
Admin Phone:+7.4957930823
Admin Phone Ext.:
Admin FAX:
Admin FAX Ext.:
Admin Email:[EMAIL PROTECTED]<mailto:Email%[EMAIL PROTECTED]>
Billing ID:CR89106902
Billing Name:Artur Denisov
Billing Organization:
Billing Street1:Akademika Koroleva 21/5
Billing Street2:
Billing Street3:
Billing City:Moscow
Billing State/Province:Moscow
Billing Postal Code:127427
Billing Country:RU
Billing Phone:+7.4957930823
Billing Phone Ext.:
Billing FAX:
Billing FAX Ext.:
Billing Email:[EMAIL PROTECTED]<mailto:Email%[EMAIL PROTECTED]>
Tech ID:CR89106900
Tech Name:Artur Denisov
Tech Organization:
Tech Street1:Akademika Koroleva 21/5
Tech Street2:
Tech Street3:
Tech City:Moscow
Tech State/Province:Moscow
Tech Postal Code:127427
Tech Country:RU
Tech Phone:+7.4957930823
Tech Phone Ext.:
Tech FAX:
Tech FAX Ext.:
Tech Email:[EMAIL PROTECTED]<mailto:Email%[EMAIL PROTECTED]>
Name Server:NS1.FASTVPS.RU<http://NS1.FASTVPS.RU>
Name Server:NS2.FASTVPS.RU<http://NS2.FASTVPS.RU>
Name Server:NS4.FASTVPS.RU<http://NS4.FASTVPS.RU>
Name Server:NS3.FASTVPS.RU<http://NS3.FASTVPS.RU>
Name Server:
Name Server:
Name Server:
Name Server:
Name Server:
Name Server:
Name Server:
Name Server:
Name Server:

From: Dean Wampler <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Reply-To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Tuesday, June 11, 2013 11:04 AM
To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Cc: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Subject: Re: Create table like with partitions

I confirmed it is a pirate site.

Sent from my rotary phone.

On Jun 11, 2013, at 10:33 AM, Edward Capriolo <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

For reference, any that puts the entire book online like this is likely pirated.
On Tue, Jun 11, 2013 at 8:34 AM, Richa Sharma <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi all,

Found a very useful guide online. Link -> http://it-ebooks.info/book/941/

Richa
On Tue, Jun 11, 2013 at 1:53 PM, Richa Sharma <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Thanks for sharing!

I looked at these links .. Is there any documentation with more examples with both static and dynamic partitions covered together.

Richa
On Tue, Jun 11, 2013 at 12:33 PM, Lefty Leverenz <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Dynamic partitions are described in the Hive design docs here:  https://cwiki.apache.org/confluence/display/Hive/DynamicPartitions.

For the configuration parameters, though, you need to look in the language manual here:  https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties (search for "dynamic" to find various parameters related to dynamic partitions).

– Lefty

On Mon, Jun 10, 2013 at 7:06 AM, Owen O'Malley <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
You need to create the partitioned table and then copy the rows into it.

create table foo_staging (int x, int y);

create table foo(int x) partitioned by (int y) clustered by (x) into 16 buckets;

set hive.exec.dynamic.partition=true;
set hive.exec.dynamic.partition.mode=nonstrict;
set hive.enforce.bucketing = true;

insert overwrite table partition (y) select * from foo_staging;
On Mon, Jun 10, 2013 at 6:38 AM, Nitin Pawar <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
If a table is not partitioned and then you want to partition the table on the data already written but data is not in partition format, that is not doable.

Best approach would be, create a new table definition with the partition columns you want.
turn on the dynamic partitioning system before you load data into new table

set hive.exec.dynamic.partition=true;
set hive.exec.dynamic.partition.mode=nonstrict;

insert overwrite table partitioned(columns) select * from old
+
Richa Sharma 2013-06-12, 06:20
+
Peter Marron 2013-06-12, 09:18
+
Richa Sharma 2013-06-10, 14:05