Vinod Kumar Vavilapalli
Matthias J. Sax
Jarek Jarcec Cecho
mail # dev
last 7 days (2)
last 30 days (2)
last 90 days (5)
last 6 months (10)
last 9 months (48)
newest on top
oldest on top
. Results from
Loading phrases to help you
refine your search...
[HDFS-11661] GetContentSummary uses excessive amounts of memory
...ContentSummaryComputationContext::nodeIncluded() is being used to keep track of all INodes visited during the current content summary calculation. This can be all of the INodes in the filesy...
, 2017-04-28, 22:04
[HDFS-8873] Allow the directoryScanner to be rate-limited
...The new 2-level directory layout can make directory scans expensive in terms of disk seeks (see HDFS-8791) for details. It would be good if the directoryScanner() had a configurable duty cyc...
, 2017-04-27, 22:06
[YARN-4287] Capacity Scheduler: Rack Locality improvement
...YARN-4189 does an excellent job describing the issues with the current delay scheduling algorithms within the capacity scheduler. The design proposal also seems like a good direction.This ji...
, 2017-03-20, 15:06
[TEZ-3440] Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs
...Haven't verified yet but certainly looks like tez needs same fix as MAPREDUCE-5308 in IFile.Specifically saw this because downstream tasks were reporting enough fetch failures that long-runn...
, 2017-03-14, 03:50
[YARN-2904] Use linux cgroups to enhance container tear down
...If we are launching yarn containers within cgroups, linux provides some guarantees that can help completely tear down a container. Specifically, linux guarantees that tasks can't escap...
, 2017-03-07, 03:50
[MAPREDUCE-5883] "Total megabyte-seconds" in job counters is slightly misleading
...The following counters are in milliseconds so "megabyte-seconds" might be better stated as "megabyte-milliseconds"MB_MILLIS_MAPS.name= Total ...
, 2017-01-06, 07:39
[MAPREDUCE-6518] Set SO_KEEPALIVE on shuffle connections
...Shuffle handler does not set SO_KEEPALIVE so we've seen cases where FDs/sockets get stuck in ESTABLISHED state indefinitely because the server did not see the client leave (network cut or ot...
, 2017-01-06, 07:38
[MAPREDUCE-6474] ShuffleHandler can possibly exhaust nodemanager file descriptors
...The async nature of the shufflehandler can cause it to open a huge number offile descriptors, when it runs out it crashes.Scenario:Job with 6K reduces, slow start set to 0.95, about 40 map o...
, 2017-01-06, 07:31
[HDFS-7645] Rolling upgrade is restoring blocks from trash multiple times
...When performing an HDFS rolling upgrade, the trash directory is getting restored twice when under normal circumstances it shouldn't need to be restored at all. iiuc, the only time these bloc...
, 2016-12-01, 23:26
[YARN-5356] NodeManager should communicate physical resource capability to ResourceManager
...Currently ResourceUtilization contains absolute quantities of resource used (e.g. 4096MB memory used). It would be good if the NM also communicated the actual physical resource capabilities ...
, 2016-11-08, 22:21
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by