| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
35 (0.081s).
|
|
|
Loading phrases to help you
refine your search...
|
|
[MAPREDUCE-4911] Add node-level aggregation flag feature(setNodeLevelAggregation(boolean)) to JobConf - MapReduce - [issue]
|
|
...This JIRA adds node-level aggregation flag feature(setLocalAggregation(boolean)) to JobConf.This task is subtask of MAPREDUCE-4502....
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4911
Author: Tsuyoshi OZAWA,
2013-01-21, 09:38
|
|
|
[MAPREDUCE-4910] Adding AggregationWaitMap to some components(MRAppMaster, TaskAttemptListener, JobImpl, MapTaskImpl). - MapReduce - [issue]
|
|
...To implement MR-4502, AggregationWaitMap need to be used by some components(MRAppMaster, TaskAttemptListener, JobImpl, MapTaskImpl)....
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4910
Author: Tsuyoshi OZAWA,
2013-01-18, 05:57
|
|
|
[MAPREDUCE-4865] Launching node-level combiner at the end stage of MapTask and ignoring aggregated inputs at ReduceTask - MapReduce - [issue]
|
|
...MapTask needs to start node-level aggregation against local outputs at the end stage of MapTask after calling getAggregationTargets().This feature is implemented with Merger and CombinerRunn...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4865
Author: Tsuyoshi OZAWA,
2013-01-18, 05:57
|
|
|
[MAPREDUCE-4864] Adding new umbilical protocol RPC, "getAggregationTargets()", for node-level combiner. - MapReduce - [issue]
|
|
...MapTasks need to know whether or not they should start node-level combiner agaist outputs of mapper on their node. The new umbilical RPC, getAggregationTargets(), is used to get outputs to b...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4864
Author: Tsuyoshi OZAWA,
2013-01-18, 05:57
|
|
|
[MAPREDUCE-4863] Adding aggregationWaitMap for node-level combiner. - MapReduce - [issue]
|
|
...To manage node/rack-level combining, MRAppMaster needs to have a management information about outputs of completed MapTasks to be aggregated. AggregationWaitMap is used so that MRAppMa...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4863
Author: Tsuyoshi OZAWA,
2013-01-18, 05:56
|
|
|
Re: Fault injection framework for testing - MapReduce - [mail # dev]
|
|
...I confirmed that tests code with Groovy works well. I'll throw patch when I finish to write my test case. Thanks, Tsuyoshi On Wed, Jan 16, 2013 at 2:21 PM, Tsuyoshi OZAWA w...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-16, 08:01
|
|
|
Re: Fault injection framework for testing - MapReduce - [mail # dev]
|
|
...added. I see, I've understood its simplicity may be acceptable. I'll try it. Tsuyoshi On Wed, Jan 16, 2013 at 1:32 PM, Konstantin Boudnik wrote: OZAWA Ts...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-16, 05:21
|
|
|
Re: Fault injection framework for testing - MapReduce - [mail # dev]
|
|
...Thanks for your comment. Your comment is helpful for me. I'd like to go with 2nd approach - MOP with Groovy. In that case, how can I add test code to the trunk? Is it acceptable for Ha...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-16, 04:18
|
|
|
Fault injection framework for testing - MapReduce - [mail # dev]
|
|
...Hi, I've created patch for MAPREDUCE-4502. Now, I confirmed that it works well for usual case, and I also added code to handle MapTask failure. As a next step, I need to add test...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-15, 17:19
|
|
|
Re: queues in haddop - MapReduce - [mail # user]
|
|
...You can also use fluentd. http://fluentd.org/ "Fluentd receives logs as JSON streams, buffers them, and sends them to other systems like Amazon S3, MongoDB, Hadoop, or other Fluentds." It ha...
|
|
|
Author: Tsuyoshi OZAWA,
2013-01-11, 14:08
|
|
|
|
