Search Hadoop -
Jarek Jarcec Cecho
Jaimin D Jetly
Edward J. Yoon
Joseph K. Bradley
Vinod Kumar Vavilapalli
mail # dev
mail # general
last 7 days (2)
last 30 days (4)
last 90 days (15)
last 6 months (35)
last 9 months (411)
and all its subprojects:
newest on top
oldest on top
. Results from
Loading phrases to help you
refine your search...
[SPARK-16711] YarnShuffleService doesn't re-init properly on YARN rolling upgrade
...When a yarn rolling upgrade happens the Spark YarnShuffleService isn't re-initializing the tokens soon enough which causes running applications to fail with NullPointerExceptions rather then...
, 2016-08-19, 14:24
[STORM-1695] Create trident spout that uses the new kafka consumer API
...In storm-822 we added a new kafka spout (org.apache.storm.kafka.spout.KafkaSpout) that uses the new consumer Api in Kafka 0.9. We decided in that one to handle the Trident support sepa...
, 2016-08-18, 10:13
[SPARK-12384] Allow -Xms to be set differently then -Xmx
...Currently Spark automatically sets the -Xms parameter to be the same as the -Xmx parameter. We should allow the user to set this separately.The main use case here is if I'm running the spark...
, 2016-08-15, 21:27
[SPARK-15703] Make ListenerBus event queue size configurable
...The Spark UI doesn't seem to be showing all the tasks and metrics.I ran a job with 100000 tasks but Detail stage page says it completed 93029:Summary Metrics for 93029 Completed TasksThe Sta...
, 2016-07-26, 18:25
[SPARK-16650] Improve documentation of spark.task.maxFailures
...The documentation for spark.task.maxFailures isn't clear as to whether this is just the number of total task failures or if its a single task failing multiple attempts. It turns out it...
, 2016-07-22, 11:42
[SPARK-16630] Blacklist a node if executors won't launch on it.
...On YARN, its possible that a node is messed or misconfigured such that a container won't launch on it. For instance if the Spark external shuffle handler didn't get loaded on it , mayb...
, 2016-07-19, 19:53
[SPARK-14963] YarnShuffleService should use YARN getRecoveryPath() for leveldb location
...The YarnShuffleService, currently just picks a directly in the yarn local dirs to store the leveldb file. YARN added an interface in hadoop 2.5 getRecoverPath() to get the location whe...
, 2016-07-14, 08:29
[SPARK-16422] maven 3.3.3 missing from mirror, breaks older builds
...Trying to build spark 1.6.2 but it fails because the maven 3.3.3 is gone.https://www.apache.org/dyn/closer.lua?action=download&filename=/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-b...
, 2016-07-08, 13:47
[SPARK-15700] Spark 2.0 dataframes using more memory (reading/writing parquet)
...I was running a large 15TB join job with 100000 map tasks, 20000 reducers that I frequently have run on Spark 1.6 successfully (with very little GC) and it failed with an out of heap memory ...
, 2016-06-27, 23:13
[SPARK-13723] YARN - Change behavior of --num-executors when spark.dynamicAllocation.enabled true
...I think we should change the behavior when --num-executors is specified when dynamic allocation is enabled. Currently if --num-executors is specified dynamic allocation is disabled and it ju...
, 2016-06-23, 19:41
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by