| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
31 (0.17s).
|
|
|
Loading phrases to help you
refine your search...
|
|
[MAPREDUCE-4863] Adding aggregationWaitMap for node-level combiner. - MapReduce - [issue]
|
|
...To manage node/rack-level combining, MRAppMaster needs to have a management information about outputs of completed MapTasks to be aggregated. AggregationWaitMap is used so that MRAppMa...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4863
Author: Tsuyoshi OZAWA,
2013-01-18, 05:56
|
|
|
Re: Fault injection framework for testing - MapReduce - [mail # dev]
|
|
...I confirmed that tests code with Groovy works well. I'll throw patch when I finish to write my test case. Thanks, Tsuyoshi On Wed, Jan 16, 2013 at 2:21 PM, Tsuyoshi OZAWA w...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-16, 08:01
|
|
|
Re: Fault injection framework for testing - MapReduce - [mail # dev]
|
|
...added. I see, I've understood its simplicity may be acceptable. I'll try it. Tsuyoshi On Wed, Jan 16, 2013 at 1:32 PM, Konstantin Boudnik wrote: OZAWA Ts...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-16, 05:21
|
|
|
Re: Fault injection framework for testing - MapReduce - [mail # dev]
|
|
...Thanks for your comment. Your comment is helpful for me. I'd like to go with 2nd approach - MOP with Groovy. In that case, how can I add test code to the trunk? Is it acceptable for Ha...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-16, 04:18
|
|
|
Fault injection framework for testing - MapReduce - [mail # dev]
|
|
...Hi, I've created patch for MAPREDUCE-4502. Now, I confirmed that it works well for usual case, and I also added code to handle MapTask failure. As a next step, I need to add test...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-15, 17:19
|
|
|
Re: queues in haddop - MapReduce - [mail # user]
|
|
...You can also use fluentd. http://fluentd.org/ "Fluentd receives logs as JSON streams, buffers them, and sends them to other systems like Amazon S3, MongoDB, Hadoop, or other Fluentds." It ha...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-11, 14:08
|
|
|
Re: "attempt*" directories in user logs - MapReduce - [mail # user]
|
|
...Hi Oleg, Speculative tasks can be launched as TaskAttempt in MR jobs. And, if no reducer class is set, MR launches default Reducer class(IdentityReducer). Thanks, Tsuyoshi ...
|
|
|
Author: Tsuyoshi OZAWA,
2012-12-10, 08:18
|
|
|
Re: Assigning reduce tasks to specific nodes - MapReduce - [mail # user]
|
|
...Hi Hioryuki, Lately I've changed scheduler for improving hadoop, so I may help you. RMContainerAllocator#handleEvent decides MapTasks to allocated containers. You can impl...
|
|
|
Author: Tsuyoshi OZAWA,
2012-12-08, 07:59
|
|
|
[MAPREDUCE-4525] Combiner per node - MapReduce - [issue]
|
|
...This JIRA is to implement the combining per container(MAPREDUCE-3902 is related), coordinating containers by application master without breaking fault tolerance of jobs....
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4525
Author: Tsuyoshi OZAWA,
2012-09-11, 02:41
|
|
|
[MAPREDUCE-4582] [MAPREDUCE-3902] ScheduledRequests#remove should remove the elements from mapsHostMapping and mapsRackMapping - MapReduce - [issue]
|
|
...ScheduledRequests#remove only remove the specified TaskAttemptId from "maps".It's inefficient, and the method should remove the elements from mapsHostMapping and mapsRackMapping....
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4582
Author: Tsuyoshi OZAWA,
2012-09-04, 19:17
|
|
|
|
