Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 51 to 60 from 62 (0.055s).
Loading phrases to help you
refine your search...
Re: queues in haddop - MapReduce - [mail # user]
...You can also use fluentd. http://fluentd.org/ "Fluentd receives logs as JSON streams, buffers them, and sends them to other systems like Amazon S3, MongoDB, Hadoop, or other Fluentds." It ha...
   Author: Tsuyoshi OZAWA, 2013-01-11, 14:08
Re: "attempt*" directories in user logs - MapReduce - [mail # user]
...Hi Oleg,  Speculative tasks can be launched as TaskAttempt in MR jobs. And, if no reducer class is set, MR launches default Reducer class(IdentityReducer).  Thanks, Tsuyoshi  ...
   Author: Tsuyoshi OZAWA, 2012-12-10, 08:18
Re: Assigning reduce tasks to specific nodes - MapReduce - [mail # user]
...Hi Hioryuki,  Lately I've changed scheduler for improving hadoop, so I may help you.  RMContainerAllocator#handleEvent decides MapTasks to allocated containers.   You can impl...
   Author: Tsuyoshi OZAWA, 2012-12-08, 07:59
[MAPREDUCE-4525] Combiner per node - MapReduce - [issue]
...This JIRA is to implement the combining per container(MAPREDUCE-3902 is related), coordinating containers by application master without breaking fault tolerance of jobs....
http://issues.apache.org/jira/browse/MAPREDUCE-4525    Author: Tsuyoshi OZAWA, 2012-09-11, 02:41
[MAPREDUCE-4582] [MAPREDUCE-3902] ScheduledRequests#remove should remove the elements from mapsHostMapping and mapsRackMapping - MapReduce - [issue]
...ScheduledRequests#remove only remove the specified TaskAttemptId from "maps".It's inefficient, and the method should remove the elements from mapsHostMapping and mapsRackMapping....
http://issues.apache.org/jira/browse/MAPREDUCE-4582    Author: Tsuyoshi OZAWA, 2012-09-04, 19:17
[MAPREDUCE-4615] [MAPREDUCE-3902] RMContainerAllocator#assign should be split into functions - MapReduce - [issue]
...Currently, the RMContainerAllocator#assign functions does a lot of works inside the one function. This is a bit confusing and make the changes difficult, so this ticket is for refactoring th...
http://issues.apache.org/jira/browse/MAPREDUCE-4615    Author: Tsuyoshi OZAWA, 2012-08-31, 23:02
[MAPREDUCE-4609] [MAPREDUCE-3902] RMContainerAllocator#scheduleInterval should be configurable - MapReduce - [issue]
...Currently, RMContainerAllocator#scheduleInterval is fixed. It should be configurable....
http://issues.apache.org/jira/browse/MAPREDUCE-4609    Author: Tsuyoshi OZAWA, 2012-08-31, 21:20
[MAPREDUCE-4599] [MAPREDUCE-3902] Ensure not to launch container on blacklisted hosts - MapReduce - [issue]
...The current implementation of RMContainerAllocator doesn't ensure not to launch containers on blacklisted nodes. This may cause some skews by tasks on bad nodes....
http://issues.apache.org/jira/browse/MAPREDUCE-4599    Author: Tsuyoshi OZAWA, 2012-08-29, 19:32
Re: How to reduce total shuffle time - MapReduce - [mail # user]
...It depends of workload. Could you tell us more specification about your job? In general case which reducers are bottleneck, there are some tuning techniques as follows: 1. Allocate more memo...
   Author: Tsuyoshi OZAWA, 2012-08-28, 08:37
[MAPREDUCE-4581] [MAPREDUCE-3902] TaskHeartbeatHandler should extends HeartbeatHandlerBase - MapReduce - [issue]
...TaskHeartbeatHandler extends AbstractService currently, however, this causes code duplication between TaskHeartbeatHandler and HeartbeatHandlerBase. TaskHeartbeatHandler should extends Heart...
http://issues.apache.org/jira/browse/MAPREDUCE-4581    Author: Tsuyoshi OZAWA, 2012-08-25, 21:27
Hadoop (57)
MapReduce (51)
YARN (36)
Tez (12)
HDFS (6)
Drill (4)
Zookeeper (3)
Hive (2)
HBase (1)
mail # dev (29)
issue (26)
mail # user (7)
last 7 days (0)
last 30 days (1)
last 90 days (10)
last 6 months (15)
last 9 months (62)
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (309)
Todd Lipcon (223)
Amar Kamat (181)
Thomas Graves (166)
Jason Lowe (162)
Amareshwari Sriramadasu (152)
Sandy Ryza (124)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Owen O'Malley (105)
Alejandro Abdelnur (103)
Devaraj K (103)
Ramya Sunil (103)
Robert Joseph Evans (101)
Hemanth Yamijala (97)
Steve Loughran (90)
Ted Yu (80)
Eli Collins (77)
Ravi Gummadi (76)
Karthik Kambatla (71)
Mahadev konar (67)
Ravi Prakash (66)
Tsuyoshi OZAWA