Jarek Jarcec Cecho
Jaimin D Jetly
Edward J. Yoon
Joseph K. Bradley
Vinod Kumar Vavilapalli
mail # dev
last 7 days (0)
last 30 days (3)
last 90 days (6)
last 6 months (12)
last 9 months (50)
and all its sub project:
newest on top
oldest on top
. Results from
Loading phrases to help you
refine your search...
[MAPREDUCE-5883] "Total megabyte-seconds" in job counters is slightly misleading
...The following counters are in milliseconds so "megabyte-seconds" might be better stated as "megabyte-milliseconds"MB_MILLIS_MAPS.name= Total ...
, 2017-01-06, 07:39
[MAPREDUCE-6518] Set SO_KEEPALIVE on shuffle connections
...Shuffle handler does not set SO_KEEPALIVE so we've seen cases where FDs/sockets get stuck in ESTABLISHED state indefinitely because the server did not see the client leave (network cut or ot...
, 2017-01-06, 07:38
[MAPREDUCE-6474] ShuffleHandler can possibly exhaust nodemanager file descriptors
...The async nature of the shufflehandler can cause it to open a huge number offile descriptors, when it runs out it crashes.Scenario:Job with 6K reduces, slow start set to 0.95, about 40 map o...
, 2017-01-06, 07:31
[YARN-2904] Use linux cgroups to enhance container tear down
...If we are launching yarn containers within cgroups, linux provides some guarantees that can help completely tear down a container. Specifically, linux guarantees that tasks can't escap...
, 2016-12-16, 17:09
[HDFS-7645] Rolling upgrade is restoring blocks from trash multiple times
...When performing an HDFS rolling upgrade, the trash directory is getting restored twice when under normal circumstances it shouldn't need to be restored at all. iiuc, the only time these bloc...
, 2016-12-01, 23:26
[YARN-5356] NodeManager should communicate physical resource capability to ResourceManager
...Currently ResourceUtilization contains absolute quantities of resource used (e.g. 4096MB memory used). It would be good if the NM also communicated the actual physical resource capabilities ...
, 2016-11-08, 22:21
[TEZ-3440] Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs
...Haven't verified yet but certainly looks like tez needs same fix as MAPREDUCE-5308 in IFile.Specifically saw this because downstream tasks were reporting enough fetch failures that long-runn...
, 2016-10-05, 15:32
[YARN-5540] scheduler spends too much time looking at empty priorities
...We're starting to see the capacity scheduler run out of scheduling horsepower when running 500-1000 applications on clusters with 4K nodes or so.This seems to be amplified by TEZ application...
, 2016-09-19, 21:43
[YARN-5202] Dynamic Overcommit of Node Resources - POC
...This Jira is to present a proof-of-concept implementation (collaboration between Jason Lowe and myself) of a dynamic over-commit implementation in YARN. The type of over-commit impleme...
, 2016-08-26, 23:01
[YARN-5352] Allow container-executor to use private /tmp
...It's very common for user code to create things in /tmp. Yes, applications have means to specify alternate tmp directories but doing so is opt-in and therefore doesn't happen in many case. &...
, 2016-08-24, 15:39
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by