| clear query|facets|time |
Search criteria: .
Results from 21 to 30 from
24503 (0.317s).
|
|
|
Loading phrases to help you
refine your search...
|
|
[expand - 2 more]
[collapse]
-
RE: HDFS small files to Sequence file using Hive
- Hive - [mail # user]
|
| ...HiI’m not sure how this will solve the issue you were mentioned, but just for the fun of it –Here is the code.Duduset textinputformat.record.delimiter='\0';set hive.mapred.supports.subdirect... |
|
|
|
|
| |
|
|
Re: HDFS small files to Sequence file using Hive
- Hive - [mail # user]
|
| ...Do you care that it is a sequence file?The HDFS HAR format was invented for this particular problem, check if the "hadoop archive" command works for you and offers a filesystem abstraction.O... |
|
|
Author: Gopal Vijayaraghavan,
2016-09-23, 23:16
|
|
|
HDFS small files to Sequence file using Hive
- Hive - [mail # user]
|
| ...I'm trying to resolve small files issue using Hive.Is there a way to create an external table on a directory, extract 'key' asfile name and 'value' as file content and write to a sequence fi... |
|
|
Author: Arun Patel,
2016-09-23, 16:04
|
|
|
|
|
[HIVE-14713] LDAP Authentication Provider should be covered with unit tests
- Hive - [issue]
|
| ...Currently LdapAuthenticationProviderImpl class is not covered with unit tests. To make this class testable some minor refactoring will be required.... |
|
|
|
|
|
|
|
[HIVE-14412] Add a timezone-aware timestamp
- Hive - [issue]
|
| ...Java's Timestamp stores the time elapsed since the epoch. While it's by itself unambiguous, ambiguity comes when we parse a string into timestamp, or convert a timestamp to string, causing p... |
|
|
|
|
|
|
|
[HIVE-9423] HiveServer2: Provide the user with different error messages depending on the Thrift client exception code
- Hive - [issue]
|
| ...An example of where it is needed: it has been reported that when # of client connections is greater than hive.server2.thrift.max.worker.threads, HiveServer2 stops accepting new connec... |
|
|
|
|
|
|
|
[HIVE-14829] metastore.sh fails due to classpath conflict with hive-service-rpc
- Hive - [issue]
|
| ...NO PRECOMMIT TESTSWhen attempting to run metastore.sh to start a new HMS server, then the script fails that the metastore class cannot be found on the classpath. This issue happens because a... |
|
|
|
|
|
|
|
[HIVE-14833] Add vectorization support for date truncation UDFs
- Hive - [issue]
|
|
|
|
|
|
|
|
|
[HIVE-14832] Add support for 'date' and 'interval' types to date truncation UDFs
- Hive - [issue]
|
|
|
|
|
|
|
|
|
[expand - 10 more]
[collapse]
-
Re: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...Slow changing dimensions are the common use-case for Hive's ACID MERGE.The feature you need is most likely covered by https://issues.apache.org/jira/browse/HIVE-109242nd comment from that JI... |
|
|
|
|
| |
|
|
Re: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...Another solution is to use HIVE over HBase.When you insert in this table, HIVE do an upsert.2016-09-23 21:00 GMT+02:00 Mich Talebzadeh :... |
|
|
Author: Damien Carol,
2016-09-24, 12:26
|
|
|
Re: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...The fundamental question is: do you need these recurring updates todimension tables throttling your Hive tables.Besides why bother with ETL when one can do ELT.For dimension table just add t... |
|
|
Author: Mich Talebzadeh,
2016-09-23, 19:00
|
|
|
Re: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...Hi Vijay,If dimensional tables are reasonable size and frequently updated, then youcan deploy *Spark SQL* to get data directly from your MySQL table throughJDBC and do your join with your fa... |
|
|
Author: Mich Talebzadeh,
2016-09-23, 12:17
|
|
|
RE: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...Dimensions change, and I'd rather do update than recreate a snapshot.On 23-Sep-2016 17:23, "Markovitz, Dudu" wrote:... |
|
|
Author: Vijay Ramachandran,
2016-09-23, 11:58
|
|
|
RE: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...If these are dimension tables, what do you need to update there?DuduFrom: Vijay Ramachandran [mailto:[EMAIL PROTECTED]]Sent: Friday, September 23, 2016 1:46 PMTo: [EMAIL PROTECTED]Subject: R... |
|
|
Author: Markovitz, Dudu,
2016-09-23, 11:53
|
|
|
RE: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...You may however use a code similar to the following.The main idea is to work with 2 target tables.Instead of merging the source table into a target table, we create an additional target tabl... |
|
|
Author: Markovitz, Dudu,
2016-09-23, 10:46
|
|
|
Re: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...On Fri, Sep 23, 2016 at 3:47 PM, Mich Talebzadeh wrote:Hi Mich.Exactly, I'm looking at dimension tables.thanks,... |
|
|
Author: Vijay Ramachandran,
2016-09-23, 10:46
|
|
|
Re: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...Hi Vijay,What is the use case for UPSERT in Hive. The functionality does not existbut there are other solutions.Are we talking about a set of dimension tables with primary keys hat needto be... |
|
|
Author: Mich Talebzadeh,
2016-09-23, 10:17
|
|
|
RE: on duplicate update equivalent?
- Hive - [mail # user]
|
| ...We’re not there yet…https://issues.apache.org/jira/browse/HIVE-10924DuduFrom: Vijay Ramachandran [mailto:[EMAIL PROTECTED]]Sent: Friday, September 23, 2016 11:47 AMTo: [EMAIL PROTECTED]Subje... |
|
|
Author: Markovitz, Dudu,
2016-09-23, 10:01
|
|
|
on duplicate update equivalent?
- Hive - [mail # user]
|
| ...Hello.Is there a way to write a query with a behaviour equivalent to mysql's "onduplicate update"? i.e., try to insert, and if key exists, update the rowinstead?thanks,... |
|
|
Author: Vijay Ramachandran,
2016-09-23, 08:46
|
|
|
|
|
[HIVE-14830] Move a majority of the MiniLlapCliDriver tests to use an inline AM
- Hive - [issue]
|
|
|
|
|
|
|
|
|
[HIVE-14731] Use Tez cartesian product edge in Hive (unpartitioned case only)
- Hive - [issue]
|
| ...Given cartesian product edge is available in Tez now (see TEZ-3230), let's integrate it into Hive on Tez. This allows us to have more than one reducer in cross product queries.... |
|
|
|
|
|
|
|
|