Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 52 (0.195s).
Loading phrases to help you
refine your search...
Re: Are lazy values created once per node or once per partition? - Spark - [mail # user]
...I would think that it has to be per worker.On Wed, Dec 17, 2014, 6:32 PM Ashic Mahtab  wrote: ...
   Author: Aniket Bhatnagar, 2014-12-17, 14:33
[expand - 1 more] - Re: Spark 1.1.0 does not spawn more than 6 executors in yarn-client mode and ignores --num-executors - Spark - [mail # user]
...Hi guysI am hoping someone might have a clue on why this is happening. Otherwise Iwill have to dwell into YARN module's source code to better understand theissue.On Wed, Dec 10, 2014, 11:54 ...
   Author: Aniket Bhatnagar, 2014-12-16, 18:28
[expand - 1 more] - Re: Streaming | Partition count mismatch exception while saving data in RDD - Spark - [mail # user]
...It turns out that this happens when checkpoint is set to a local directorypath. I have opened a JIRA SPARK-4862 for Spark streaming to output bettererror message.Thanks,AniketOn Tue Dec 16 2...
   Author: Aniket Bhatnagar, 2014-12-16, 16:36
[SPARK-4862] Streaming | Setting checkpoint as a local directory results in Checkpoint RDD has different partitions error - Spark - [issue]
...If the checkpoint is set as a local filesystem directory, it results in weird error messages like the following:org.apache.spark.SparkException: Checkpoint RDD CheckpointRDD[467] at ...
http://issues.apache.org/jira/browse/SPARK-4862    Author: Aniket Bhatnagar, 2014-12-16, 16:35
[expand - 1 more] - Re: Run Spark job on Playframework + Spark Master/Worker in one Mac - Spark - [mail # user]
...Seems you are using standalone mode. Can you check spark worker logs orapplication logs in spark work directory to find any errors?On Tue, Dec 16, 2014, 9:09 AM Tomoya Igarashi <[EMAIL PR...
   Author: Aniket Bhatnagar, 2014-12-16, 06:34
Re: Spark with HBase - Spark - [mail # user]
...In case you are still looking for help, there has been multiple discussionsin this mailing list that you can try searching for. Or you can simply usehttps://github.com/unicredit/hbase-rdd :-...
   Author: Aniket Bhatnagar, 2014-12-15, 09:59
Re: Serialization issue when using HBase with Spark - Spark - [mail # user]
..."The reason not using sc.newAPIHadoopRDD is it only support one scan eachtime."I am not sure is that's true. You can use multiple scans as following:val scanStrings = scans.map(scan => co...
   Author: Aniket Bhatnagar, 2014-12-15, 09:54
[SPARK-3640] KinesisUtils should accept a credentials object instead of forcing DefaultCredentialsProvider - Spark - [issue]
...KinesisUtils should accept AWS Credentials as a parameter and should default to DefaultCredentialsProvider if no credentials are provided. Currently, the implementation forces usage of Defau...
http://issues.apache.org/jira/browse/SPARK-3640    Author: Aniket Bhatnagar, 2014-12-14, 13:16
[expand - 2 more] - Re: Having problem with Spark streaming with Kinesis - Spark - [mail # user]
...The reason is because of the following code:val numStreams = numShardsval kinesisStreams = (0 until numStreams).map { i =>  KinesisUtils.createStream(ssc, streamName, endpointUr...
   Author: Aniket Bhatnagar, 2014-12-14, 13:12
[expand - 1 more] - Re: Programmatically running spark jobs using yarn-client - Spark - [mail # user]
...Thanks Akhil. I was wondering why it isn't available to find the class eventhough it existed in the same class loader as SparkContext. As aworkaround, I used the following code the add all d...
   Author: Aniket Bhatnagar, 2014-12-09, 15:13
Sort:
project
Spark (35)
Kafka (16)
Impala (1)
type
mail # user (45)
issue (5)
mail # dev (2)
date
last 7 days (0)
last 30 days (11)
last 90 days (18)
last 6 months (36)
last 9 months (52)
author
Ted Yu (1840)
Harsh J (1303)
Jun Rao (1016)
Todd Lipcon (998)
Stack (986)
Andrew Purtell (882)
Jonathan Ellis (854)
stack (765)
Jean-Daniel Cryans (751)
Jarek Jarcec Cecho (747)
Yusaku Sako (745)
Eric Newton (707)
Hitesh Shah (684)
Jonathan Hsieh (684)
Josh Elser (678)
Roman Shaposhnik (678)
Steve Loughran (651)
Namit Jain (648)
Siddharth Seth (644)
Brock Noland (635)
Owen O'Malley (623)
Hyunsik Choi (584)
Neha Narkhede (568)
Arun C Murthy (548)
Eli Collins (545)
Aniket Bhatnagar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB