Edward J. Yoon
Arun C Murthy
Vinod Kumar Vavilapalli
Jarek Jarcec Cecho
Matthias J. Sax
mail # dev
mail # general
mail # user
last 7 days (1)
last 30 days (2)
last 90 days (7)
last 6 months (25)
last 9 months (541)
newest on top
oldest on top
. Results from
Loading phrases to help you
refine your search...
[SPARK-22577] executor page blacklist status should update with TaskSet level blacklisting
...right now the executor blacklist status only updates with the BlacklistTracker after a task set has finished and propagated the blacklisting to the application level. We should change that t...
, 2018-01-19, 14:54
[SPARK-13365] should coalesce do anything if coalescing to same number of partitions without shuffle
...Currently if a user does a coalesce to the same number of partitions as already exist it spends a bunch of time doing stuff when it seems like it shouldn't do anything.for instance I have an...
, 2018-01-04, 14:25
[SPARK-20970] Deprecate TaskMetrics._updatedBlockStatuses
...TaskMetrics._updatedBlockStatuses isn't used anywhere internally by spark. It could be used by users though since its exposed by SparkListenerTaskEnd. We made it configurable to ...
, 2017-12-17, 15:33
[SPARK-22653] executorAddress registered in CoarseGrainedSchedulerBackend.executorDataMap is null
...In CoarseGrainedSchedulerBackend.RegisterExecutor the executor data address (executorRef.address) can be null. val data = new ExecutorData(executorRef, executorRef.address, hostname,&nb...
, 2017-12-01, 07:23
[SPARK-22620] Deadlock in blacklisting when executor is removed due to a heartbeat timeout
...I ran into a deadlock dealing with blacklisting where the application was stuck in a state that it thought it had executors to schedule on but it really didn't because those executors were d...
, 2017-11-28, 21:46
[SPARK-21753] running pi example with pypy on spark fails to serialize
...I'm trying to run the pi example (https://github.com/apache/spark/blob/master/examples/src/main/python/pi.py) on pyspark using pypy 2.5.1 but everything I've tried results in a seriali...
, 2017-11-08, 00:02
[SPARK-19112] add codec for ZStandard
...ZStandard: https://github.com/facebook/zstd and http://facebook.github.io/zstd/ has been in use for a while now. v1.0 was recently released. Hadoop (https://issues.apache.org/jira/browse/HAD...
, 2017-11-01, 13:54
[HDFS-12670] can't renew HDFS tokens with only the hdfs client jar
...It looks like the meta inf file for the hdfs token renewer is in the hadoop-hdfs.jar rather then the hadoop-hdfs-client.jar. This prevents a client from renewing a token because the service ...
, 2017-10-17, 16:13
[SPARK-20589] Allow limiting task concurrency per stage
...It would be nice to have the ability to limit the number of concurrent tasks per stage. This is useful when your spark job might be accessing another service and you don't want to DOS ...
, 2017-10-09, 21:05
[SPARK-22218] spark shuffle services fails to update secret on application re-attempts
...Running on yarn, If you have any application re-attempts using the spark 2.2 shuffle service, the external shuffle service does not update the credentials properly and the application re-att...
, 2017-10-09, 19:57
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by