| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
20 (0.086s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: Exception when joining HIVE tables - Hive - [mail # user]
|
|
..."select * from table" does not use map-reduce so it seems your error has to do with hadoop/map-reduce, not hive i would run some test for map-reduce On Wed, Sep 21, 2011 at 4:11 PM, Kr...
|
|
|
Author: Koert Kuipers,
2011-09-21, 20:49
|
|
|
remove duplicates based on one (or a few) columns - Hive - [mail # user]
|
|
...what is the easiest way to remove rows which are considered duplicates based upon a few columns in the rows? so "create table deduped as select distinct * from table" won't do......
|
|
|
Author: Koert Kuipers,
2011-09-14, 21:10
|
|
|
Re: Hive thrift interface and user permissions / user auditing - Hive - [mail # user]
|
|
...ah sorry the user "thrift" that was a typo by me. it actually says ugi=hive in my logs. i missed that the first time you asked. regarding JDBC, i was mainly interested if JDBC would be...
|
|
|
Author: Koert Kuipers,
2011-09-07, 17:16
|
|
|
Re: Hive thrift interface and user permissions / user auditing - Hive - [mail # user]
|
|
...The metastore is running as user "hive", and we are indeed running unsecured mode. Do i understand it correctly that in the thrift interface does provide a way to communicate the identity bu...
|
|
|
Author: Koert Kuipers,
2011-09-06, 16:09
|
|
|
Hive thrift interface and user permissions / user auditing - Hive - [mail # user]
|
|
...When i run a query from the hive command line client i can see that it is being run as me (for example, in HDFS log i see INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=...
|
|
|
Author: Koert Kuipers,
2011-09-06, 15:22
|
|
|
Re: UDAF and group by - Hive - [mail # user]
|
|
...Thanks for your response. My thinking was that by turning off hive.map.aggr hive would do the following: col3 becomes the key in mapping. All rows with same col3 go to same reducer. In the r...
|
|
|
Author: Koert Kuipers,
2011-09-05, 16:54
|
|
|
Re: UDAF and group by - Hive - [mail # user]
|
|
...Hey, my question wasn't very clear. I have a UDAF that I apply per group. The UDAF does not support terminatePartial() and merge(). So to do this i run: set hive.map.aggr=false; select...
|
|
|
Author: Koert Kuipers,
2011-09-04, 15:08
|
|
|
UDAF and group by - Hive - [mail # user]
|
|
...If i run my own UDAF with group by, can i be sure that a single UDAF instance initialized once will process all members in a group? Or should i code so as to take into account the situation ...
|
|
|
Author: Koert Kuipers,
2011-08-30, 13:34
|
|
|
Re: Re: multiple tables join with only one hug table. - Hive - [mail # user]
|
|
...I am not aware of any optimization that does something like that. Anyone? Also your suggestion means 10 hash tables would have to be in memory. I think that with a normal map-reduce jo...
|
|
|
Author: Koert Kuipers,
2011-08-14, 00:58
|
|
|
Re: multiple tables join with only one hug table. - Hive - [mail # user]
|
|
...A mapjoin does what you described: it builds hash tables for the smaller tables. In recent versions of hive (like the one i am using with cloudera cdh3u1) a mapjoin will be done for you auto...
|
|
|
Author: Koert Kuipers,
2011-08-12, 17:17
|
|
|
|