Search Hadoop -
Jarek Jarcec Cecho
Jaimin D Jetly
Edward J. Yoon
Joseph K. Bradley
Vinod Kumar Vavilapalli
mail # dev
last 7 days (1)
last 30 days (2)
last 90 days (7)
last 6 months (14)
last 9 months (49)
and all its subprojects:
newest on top
oldest on top
. Results from
Loading phrases to help you
refine your search...
[YARN-5356] NodeManager should communicate physical resource capability to ResourceManager
...Currently ResourceUtilization contains absolute quantities of resource used (e.g. 4096MB memory used). It would be good if the NM also communicated the actual physical resource capabilities ...
, 2016-10-20, 21:22
[TEZ-3440] Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs
...Haven't verified yet but certainly looks like tez needs same fix as MAPREDUCE-5308 in IFile.Specifically saw this because downstream tasks were reporting enough fetch failures that long-runn...
, 2016-10-05, 15:32
[YARN-5540] scheduler spends too much time looking at empty priorities
...We're starting to see the capacity scheduler run out of scheduling horsepower when running 500-1000 applications on clusters with 4K nodes or so.This seems to be amplified by TEZ application...
, 2016-09-19, 21:43
[HDFS-7645] Rolling upgrade is restoring blocks from trash multiple times
...When performing an HDFS rolling upgrade, the trash directory is getting restored twice when under normal circumstances it shouldn't need to be restored at all. iiuc, the only time these bloc...
, 2016-08-30, 05:38
[YARN-5202] Dynamic Overcommit of Node Resources - POC
...This Jira is to present a proof-of-concept implementation (collaboration between Jason Lowe and myself) of a dynamic over-commit implementation in YARN. The type of over-commit impleme...
, 2016-08-26, 23:01
[YARN-5352] Allow container-executor to use private /tmp
...It's very common for user code to create things in /tmp. Yes, applications have means to specify alternate tmp directories but doing so is opt-in and therefore doesn't happen in many case. &...
, 2016-08-24, 15:39
[YARN-3388] Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit
...When there are multiple active users in a queue, it should be possible for those users to make use of capacity up-to max_capacity (or close). The resources should be fairly distributed among...
, 2016-08-20, 00:08
[MAPREDUCE-6631] shuffle handler would benefit from per-local-dir threads
...Jason Lowe and I discussed this while investigating I/O starvation we have been seeing on our clusters lately (possibly amplified by increased tez workloads). If a particular disk is being s...
, 2016-07-21, 04:14
[YARN-4768] getAvailablePhysicalMemorySize can be inaccurate on linux
...Algorithm currently uses "MemFree" + "Inactive" from /proc/meminfo"Inactive" may not be a very good indication of how much memory can be readily freed because it contains both: Pages mapped ...
, 2016-06-07, 13:44
[YARN-4834] ProcfsBasedProcessTree doesn't track daemonized processes
...Currently the algorithm uses ppid from /proc/<pid>/stat which can be 1 if a child process has daemonized itself. This causes potentially large processes from not being monitored. sessi...
, 2016-06-07, 13:44
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by