Edward J. Yoon
Arun C Murthy
Vinod Kumar Vavilapalli
Jarek Jarcec Cecho
mail # dev
mail # general
last 7 days (2)
last 30 days (2)
last 90 days (5)
last 6 months (8)
last 9 months (60)
newest on top
oldest on top
. Results from
Loading phrases to help you
refine your search...
[YARN-2904] Use linux cgroups to enhance container tear down
...If we are launching yarn containers within cgroups, linux provides some guarantees that can help completely tear down a container. Specifically, linux guarantees that tasks can't escap...
, 2017-08-18, 20:24
[HDFS-8873] Allow the directoryScanner to be rate-limited
...The new 2-level directory layout can make directory scans expensive in terms of disk seeks (see HDFS-8791) for details. It would be good if the directoryScanner() had a configurable duty cyc...
, 2017-08-18, 11:23
[YARN-6775] CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls
...There are several things in assignContainers() that are done multiple times even though the result cannot change (canAssignToUser, canAssignToQueue). Add some local caching to take advantage...
, 2017-07-19, 23:26
[YARN-4834] ProcfsBasedProcessTree doesn't track daemonized processes
...Currently the algorithm uses ppid from /proc/<pid>/stat which can be 1 if a child process has daemonized itself. This causes potentially large processes from not being monitored. sessi...
, 2017-07-06, 11:23
[HDFS-11661] GetContentSummary uses excessive amounts of memory
...ContentSummaryComputationContext::nodeIncluded() is being used to keep track of all INodes visited during the current content summary calculation. This can be all of the INodes in the filesy...
, 2017-06-07, 23:56
[HDFS-11755] Underconstruction blocks can be considered missing
...Following sequence of events can lead to a block underconstruction being considered missing. pipeline of 3 DNs, DN1->DN2->DN3 DN3 has a failing disk so some updates take a long time Cl...
, 2017-05-12, 16:21
[YARN-4287] Capacity Scheduler: Rack Locality improvement
...YARN-4189 does an excellent job describing the issues with the current delay scheduling algorithms within the capacity scheduler. The design proposal also seems like a good direction.This ji...
, 2017-03-20, 15:06
[TEZ-3440] Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs
...Haven't verified yet but certainly looks like tez needs same fix as MAPREDUCE-5308 in IFile.Specifically saw this because downstream tasks were reporting enough fetch failures that long-runn...
, 2017-03-14, 03:50
[MAPREDUCE-5883] "Total megabyte-seconds" in job counters is slightly misleading
...The following counters are in milliseconds so "megabyte-seconds" might be better stated as "megabyte-milliseconds"MB_MILLIS_MAPS.name= Total ...
, 2017-01-06, 07:39
[MAPREDUCE-6518] Set SO_KEEPALIVE on shuffle connections
...Shuffle handler does not set SO_KEEPALIVE so we've seen cases where FDs/sockets get stuck in ESTABLISHED state indefinitely because the server did not see the client leave (network cut or ot...
, 2017-01-06, 07:38
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by