Edward J. Yoon
Arun C Murthy
Vinod Kumar Vavilapalli
Jarek Jarcec Cecho
mail # dev
mail # general
mail # user
last 7 days (3)
last 30 days (4)
last 90 days (12)
last 6 months (15)
last 9 months (525)
newest on top
oldest on top
. Results from
Loading phrases to help you
refine your search...
[SPARK-21501] Spark shuffle index cache size should be memory based
...Right now the spark shuffle service has a cache for index files. It is based on a # of files cached (spark.shuffle.service.index.cache.entries). This can cause issues if people have a lot of...
, 2017-07-21, 16:21
[SPARK-15703] Make ListenerBus event queue size configurable
...The Spark UI doesn't seem to be showing all the tasks and metrics.I ran a job with 100000 tasks but Detail stage page says it completed 93029:Summary Metrics for 93029 Completed TasksThe Sta...
, 2017-07-18, 18:21
[SPARK-21383] YARN can allocate too many executors
...The YarnAllocator doesn't properly track containers being launched but not yet running. If it takes time to launch the containers on the NM they don't show up as numExecutorsRunning, b...
, 2017-07-17, 08:02
[SPARK-20898] spark.blacklist.killBlacklistedExecutors doesn't work in YARN
...I was trying out the new spark.blacklist.killBlacklistedExecutors on YARN but it doesn't appear to work. Everytime I get:17/05/26 16:28:12 WARN BlacklistTracker: Not attempting to kill...
, 2017-06-26, 16:17
[SPARK-20923] TaskMetrics._updatedBlockStatuses uses a lot of memory
...The driver appears to use a ton of memory in certain cases to store the task metrics updated block status'. For instance I had a user reading data form hive and caching it. The #...
, 2017-06-23, 01:25
[SPARK-20589] Allow limiting task concurrency per stage
...It would be nice to have the ability to limit the number of concurrent tasks per stage. This is useful when your spark job might be accessing another service and you don't want to DOS ...
, 2017-06-14, 14:26
[SPARK-20178] Improve Scheduler fetch failures
...We have been having a lot of discussions around improving the handling of fetch failures. There are 4 jira currently related to this. We should try to get a list of things we wan...
, 2017-06-08, 23:27
[SPARK-20970] Deprecate TaskMetrics._updatedBlockStatuses
...TaskMetrics._updatedBlockStatuses isn't used anywhere internally by spark. It could be used by users though since its exposed by SparkListenerTaskEnd. We made it configurable to ...
, 2017-06-02, 19:29
[SPARK-20713] Speculative task that got CommitDenied exception shows up as failed
...When running speculative tasks you can end up getting a task failure on a speculative task (the other task succeeded) because that task got a CommitDenied exception when really it was "kille...
, 2017-05-23, 10:07
[SPARK-19112] add codec for ZStandard
...ZStandard: https://github.com/facebook/zstd and http://facebook.github.io/zstd/ has been in use for a while now. v1.0 was recently released. Hadoop (https://issues.apache.org/jira/browse/HAD...
, 2017-05-08, 15:24
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by