| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
19 (0.442s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: How can I limit reducers to one-per-node? - MapReduce - [mail # user]
|
|
...those nodes with 2 reducers were running these two r at the same time? if yes, I think you can change mapred-site.xml as I suggested, if no, i.e. your goal is to make all nodes ...
|
|
|
Author: Nan Zhu,
2013-02-09, 04:59
|
|
|
Re: How can I limit reducers to one-per-node? - MapReduce - [mail # user]
|
|
...I haven't use AWS MR before…..if your instances are configured with 3 reducer slots, it means that 3 reducers can run at the same time in this node, what do you mean by "this p...
|
|
|
Author: Nan Zhu,
2013-02-09, 04:30
|
|
|
Re: How can I limit reducers to one-per-node? - MapReduce - [mail # user]
|
|
...I think set tasktracker.reduce.tasks.maximum to be 1 may meet your requirement Best, Nan Zhu School of Computer Science, McGill University On Friday, 8...
|
|
|
Author: Nan Zhu,
2013-02-09, 03:59
|
|
|
what will happen when HDFS restarts but with some dead nodes - MapReduce - [mail # user]
|
|
...Hi, all I'm wondering if HDFS is stopped, and some of the machines of the cluster are moved, some of the block replication are definitely lost for moving machines when I r...
|
|
|
Author: Nan Zhu,
2013-01-30, 03:04
|
|
|
Re: Fair Scheduler is not Fair why? - MapReduce - [mail # user]
|
|
...BTW, what I mentioned is fairsharepreemption not minimum share an alternative way to achieve that is to set minimum share of two queues to be equal(or other allocation scheme yo...
|
|
|
Author: Nan Zhu,
2013-01-16, 16:50
|
|
|
Re: Fair Scheduler is not Fair why? - MapReduce - [mail # user]
|
|
...I think you should do that, so that when the allocation is inconsistent with fair share, the tasks in the queue which occupies more beyond it's fair share will be killed, and the available s...
|
|
|
Author: Nan Zhu,
2013-01-16, 16:43
|
|
|
Re: response time measurement - MapReduce - [mail # dev]
|
|
...yes, you can do that and actually there some counters implementations, public static enum Counter { NUM_FAILED_MAPS, NUM_FAILED_...
|
|
|
Author: Nan Zhu,
2012-11-17, 14:19
|
|
|
Re: response time measurement - MapReduce - [mail # dev]
|
|
...There is no such a counter in default Hadoop implementation you can instrument your own code in JobInProgress.java to calculate it, there is also an implemented counter in JobI...
|
|
|
Author: Nan Zhu,
2012-11-13, 00:41
|
|
|
Re: Fair Scheduler question: Fair share and its effect on max capacity - MapReduce - [mail # user]
|
|
...You set maxMaps to 200, so the maximum running mappers should be no more than 200 Best, Nan Zhu School of Computer Science, McGill University On Thursd...
|
|
|
Author: Nan Zhu,
2012-11-08, 23:18
|
|
|
Any existing counter for map/reduce response time? - MapReduce - [mail # dev]
|
|
...Hi, all is there any existing counter to reflect the response time of a job in map and reduce phase respectively? Best, Nan Zhu School of Computer Science, McGill Univers...
|
|
|
Author: Nan Zhu,
2012-10-30, 16:22
|
|
|
|
