| clear query|facets|time |
Search criteria: .
Results from 41 to 50 from
54 (0.305s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: set mapred.map.tasks=1 not work - Hive - [mail # user]
|
|
...I've tried jvm reuse, useless too.. Total time is about 130s, data only 10M and all small files, 2 nodes. hive/hadoop will run 350+ maps ... 2010/6/10 Edward Capriolo ...
|
|
|
Author: wd,
2010-06-11, 02:26
|
|
|
Re: set mapred.map.tasks=1 not work - Hive - [mail # user]
|
|
...set *hive.input.format=*org.apache.hadoop.hive.ql.io.CombineHiveInputFormat; and set hive.merge.size.per.task=1000000; set hive.merge.mapfiles=true; seames all useless here...
|
|
|
Author: wd,
2010-06-10, 06:52
|
|
|
Re: set mapred.map.tasks=1 not work - Hive - [mail # user]
|
|
...Thanks everyone, I'll try CombineHiveInputFormat. :) 2010/6/10 Namit Jain ...
|
|
|
Author: wd,
2010-06-10, 06:21
|
|
|
Re: set mapred.map.tasks=1 not work - Hive - [mail # user]
|
|
...I have lots of small files in hive, the mapred is too slow .... Is there a way to improve the speed ? 2010/6/10 Edward Capriolo ...
|
|
|
Author: wd,
2010-06-10, 01:55
|
|
|
Re: set mapred.map.tasks=1 not work - Hive - [mail # user]
|
|
...I've tried hive 0.5, the option not work too. And find this page[ http://markmail.org/message/k32nrcb2ncsq67ef?q=mapred.map.tasks+#query:mapred.map.tasks%20+page:1+mid:k32nrcb2ncsq67ef+state...
|
|
|
Author: wd,
2010-06-09, 07:04
|
|
|
set mapred.map.tasks=1 not work - Hive - [mail # user]
|
|
...hi, I'm using hive svn rev946854. And try to set mapred.map.tasks=1 at hive cli, but seemes it doesn't work, total map tasks still over 300+. Is this a svn version problem?...
|
|
|
Author: wd,
2010-06-09, 03:20
|
|
|
Re: [ANNOUNCE] Hive 0.5.0 released - Hive - [mail # user]
|
|
...Nice job~ Congratulations. 2010/2/24 Zheng Shao ...
|
|
|
Author: wd,
2010-02-24, 09:12
|
|
|
Re: hive map reduce output - Hive - [mail # user]
|
|
...Sorry about this mail, I think I should try it use current version. I will do it later. 2010/2/9 Jeff Hammerbacher ...
|
|
|
Author: wd,
2010-02-09, 09:08
|
|
|
Re: hive map reduce output - Hive - [mail # user]
|
|
...sorry , I forget report my environment. Hadoop 0.19.1 hive 0.4.0 2010/2/9 Zheng Shao ...
|
|
|
Author: wd,
2010-02-09, 09:06
|
|
|
hive map reduce output - Hive - [mail # user]
|
|
...hi, I've use hive map reduce to process some log files. I found out that hive will output like "num1 rows loaded to table_name" message every run. But the "num1" not equal to "select c...
|
|
|
Author: wd,
2010-02-09, 03:05
|
|
|
|
