Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Noob question on creating tables


+
Mark 2013-03-29, 17:19
+
Sanjay Subramanian 2013-03-29, 17:40
+
Mark 2013-03-29, 18:16
+
Dean Wampler 2013-03-29, 18:37
+
Sanjay Subramanian 2013-03-29, 19:45
+
Mark 2013-03-29, 20:25
+
Sanjay Subramanian 2013-03-29, 20:38
+
Dean Wampler 2013-03-29, 17:32
+
Mark 2013-03-29, 18:16
Copy link to this message
-
Re: Noob question on creating tables
yes
On Fri, Mar 29, 2013 at 11:46 PM, Mark <[EMAIL PROTECTED]> wrote:

> Thanks
>
> Does this mean I need to create a partition for each day manually? There
> is no way to have infer that from my directory structure?
>
> On Mar 29, 2013, at 10:32 AM, Dean Wampler <
> [EMAIL PROTECTED]> wrote:
>
>
>
> On Fri, Mar 29, 2013 at 12:19 PM, Mark <[EMAIL PROTECTED]> wrote:
>
>> We have existing log data in directories in the format of YEAR/MONTH/DAY.
>>
>> - How can we create a table over this table without hive modifying and/or
>> moving it?
>>
>
> create external table foo (...) partitioned by (year  int, month int, day
> int);
> ...
>
> - How can we tell Hive to partition this data so it knows about each day
>> of logs?
>>
>
> alter table foo add partition(year = 2013, month = 3, day = 29) location
> '/path/to/2013/03/29';
>
>
>> - Does hive out of the box work with reading compressed files?
>>
>
> yes, if you're using a compression scheme supported by Hadoop.
>
>
>>
>> Thanks
>
>
>
>
> --
> *Dean Wampler, Ph.D.*
> thinkbiganalytics.com
> +1-312-339-1330
>
>
>
--
Nitin Pawar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB