Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 41 to 50 from 58 (0.071s).
Loading phrases to help you
refine your search...
[MAPREDUCE-4911] Add node-level aggregation flag feature(setNodeLevelAggregation(boolean)) to JobConf - MapReduce - [issue]
...This JIRA adds node-level aggregation flag feature(setLocalAggregation(boolean)) to JobConf.This task is subtask of MAPREDUCE-4502....
http://issues.apache.org/jira/browse/MAPREDUCE-4911    Author: Tsuyoshi OZAWA, 2013-01-21, 09:38
[MAPREDUCE-4910] Adding AggregationWaitMap to some components(MRAppMaster, TaskAttemptListener, JobImpl, MapTaskImpl). - MapReduce - [issue]
...To implement MR-4502, AggregationWaitMap need to be used by some components(MRAppMaster, TaskAttemptListener, JobImpl, MapTaskImpl)....
http://issues.apache.org/jira/browse/MAPREDUCE-4910    Author: Tsuyoshi OZAWA, 2013-01-18, 05:57
[MAPREDUCE-4865] Launching node-level combiner at the end stage of MapTask and ignoring aggregated inputs at ReduceTask - MapReduce - [issue]
...MapTask needs to start node-level aggregation against local outputs at the end stage of MapTask after calling getAggregationTargets().This feature is implemented with Merger and CombinerRunn...
http://issues.apache.org/jira/browse/MAPREDUCE-4865    Author: Tsuyoshi OZAWA, 2013-01-18, 05:57
[MAPREDUCE-4864] Adding new umbilical protocol RPC, "getAggregationTargets()", for node-level combiner. - MapReduce - [issue]
...MapTasks need to know whether or not they should start node-level combiner agaist outputs of mapper on their node. The new umbilical RPC, getAggregationTargets(), is used to get outputs to b...
http://issues.apache.org/jira/browse/MAPREDUCE-4864    Author: Tsuyoshi OZAWA, 2013-01-18, 05:57
[MAPREDUCE-4863] Adding aggregationWaitMap for node-level combiner. - MapReduce - [issue]
...To manage node/rack-level combining, MRAppMaster needs to have a management information about outputs of completed MapTasks to be aggregated.  AggregationWaitMap is used so that MRAppMa...
http://issues.apache.org/jira/browse/MAPREDUCE-4863    Author: Tsuyoshi OZAWA, 2013-01-18, 05:56
[expand - 3 more] - Re: Fault injection framework for testing - MapReduce - [mail # dev]
...I confirmed that tests code with Groovy works well. I'll throw patch when I finish to write my test case.  Thanks, Tsuyoshi  On Wed, Jan 16, 2013 at 2:21 PM, Tsuyoshi OZAWA  w...
   Author: Tsuyoshi OZAWA, 2013-01-16, 08:01
Re: queues in haddop - MapReduce - [mail # user]
...You can also use fluentd. http://fluentd.org/ "Fluentd receives logs as JSON streams, buffers them, and sends them to other systems like Amazon S3, MongoDB, Hadoop, or other Fluentds." It ha...
   Author: Tsuyoshi OZAWA, 2013-01-11, 14:08
Re: "attempt*" directories in user logs - MapReduce - [mail # user]
...Hi Oleg,  Speculative tasks can be launched as TaskAttempt in MR jobs. And, if no reducer class is set, MR launches default Reducer class(IdentityReducer).  Thanks, Tsuyoshi  ...
   Author: Tsuyoshi OZAWA, 2012-12-10, 08:18
Re: Assigning reduce tasks to specific nodes - MapReduce - [mail # user]
...Hi Hioryuki,  Lately I've changed scheduler for improving hadoop, so I may help you.  RMContainerAllocator#handleEvent decides MapTasks to allocated containers.   You can impl...
   Author: Tsuyoshi OZAWA, 2012-12-08, 07:59
[MAPREDUCE-4525] Combiner per node - MapReduce - [issue]
...This JIRA is to implement the combining per container(MAPREDUCE-3902 is related), coordinating containers by application master without breaking fault tolerance of jobs....
http://issues.apache.org/jira/browse/MAPREDUCE-4525    Author: Tsuyoshi OZAWA, 2012-09-11, 02:41
Hadoop (51)
MapReduce (47)
YARN (33)
Tez (11)
HDFS (6)
Drill (4)
Zookeeper (3)
Hive (2)
HBase (1)
mail # dev (29)
issue (22)
mail # user (7)
last 7 days (0)
last 30 days (5)
last 90 days (11)
last 6 months (13)
last 9 months (58)
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (309)
Todd Lipcon (215)
Amar Kamat (181)
Thomas Graves (165)
Jason Lowe (159)
Amareshwari Sriramadasu (152)
Sandy Ryza (124)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Owen O'Malley (105)
Devaraj K (103)
Ramya Sunil (103)
Alejandro Abdelnur (101)
Robert Joseph Evans (101)
Hemanth Yamijala (97)
Steve Loughran (90)
Ted Yu (78)
Eli Collins (77)
Ravi Gummadi (76)
Karthik Kambatla (70)
Mahadev konar (67)
Ravi Prakash (66)
Tsuyoshi OZAWA