| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
105 (0.121s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Hive skipping first line - Hive - [mail # user]
|
|
...Since you have a text file, have you visually inspected the first few lines to make sure there's nothing unusual, like a missing line feed, field separator, or anything like that? The missin...
|
|
|
Author: Dean Wampler,
2013-05-23, 12:01
|
|
|
Re: hive.metastore.warehouse.dir - Should it point to a physical directory - Hive - [mail # user]
|
|
...No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS. Also there's a typo in your hive.xml: Shou...
|
|
|
Author: Dean Wampler,
2013-05-21, 18:06
|
|
|
Re: hive.metastore.warehouse.dir - Should it point to a physical directory - Hive - [mail # user]
|
|
...The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore...
|
|
|
Author: Dean Wampler,
2013-05-21, 17:44
|
|
|
Re: [ANNOUNCE] Apache Hive 0.11.0 Released - Hive - [mail # user]
|
|
...Congratulations! On Thu, May 16, 2013 at 4:19 PM, Owen O'Malley wrote: Dean Wampler, Ph.D. @deanwampler http://polyglotprogramming.com...
|
|
|
Author: Dean Wampler,
2013-05-16, 21:32
|
|
|
Re: Hive query problem on S3 table - Hive - [mail # user]
|
|
...I'm not sure what's happening here, but one suggestion; use s3n://... instead of s3://... The "new" version is supposed to provide better performance. dean On Thu, Apr 18, 2013 ...
|
|
|
Author: Dean Wampler,
2013-04-18, 14:25
|
|
|
Re: Partition performance - Hive - [mail # user]
|
|
...Also, how big are the files in each directory? Are they roughly the size of one HDFS block or a multiple. Lots of small files will mean lots of mapper tasks will little to do. You can ...
|
|
|
Author: Dean Wampler,
2013-04-04, 23:28
|
|
|
Re: Metastore question - Hive - [mail # user]
|
|
...Yes, the property name is misleading. The DATA is stored under that directory (for managed tables, as opposed to external tables where you explicit tell Hive the location). The METADATA is s...
|
|
|
Author: Dean Wampler,
2013-04-04, 00:30
|
|
|
Re: Bucketing external tables - Hive - [mail # user]
|
|
...The table can be external. You should be able to use this data with other tools, because all bucketing does is ensure that all occurrences for records with a given key are written into the s...
|
|
|
Author: Dean Wampler,
2013-03-31, 00:00
|
|
|
Re: Bucketing external tables - Hive - [mail # user]
|
|
...I don't know of any way to avoid creating new tables and moving the data. In fact, that's the official way to do it, from a temp table to the final table, so Hive can ensure the bucketing is...
|
|
|
Author: Dean Wampler,
2013-03-29, 22:57
|
|
|
Re: Noob question on creating tables - Hive - [mail # user]
|
|
...That's a drawback of external tables, but it's actually not as difficult as it sounds. It's easy to write a nightly "cron" job that creates the partition for the next day (or a job per month...
|
|
|
Author: Dean Wampler,
2013-03-29, 18:37
|
|
|
|
