Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 79 (0.364s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: OOM in SizeEstimator while using combineByKey - Spark - [mail # user]
...I am setting spark.executor.memory as 1024m on a 3 node cluster with eachnode having 4 cores and 7 GB RAM. The combiner functions are taking scalacase classes as input and are generating mut...
   Author: Aniket Bhatnagar, 2015-04-15, 08:09
[SPARK-3638] Commons HTTP client dependency conflict in extras/kinesis-asl module - Spark - [issue]
...Followed instructions as mentioned @ https://github.com/apache/spark/blob/master/docs/streaming-kinesis-integration.md and when running the example, I get the following error:Caused by: java...
http://issues.apache.org/jira/browse/SPARK-3638    Author: Aniket Bhatnagar, 2015-04-01, 19:46
Saprk 1.2.0 | Spark job fails with MetadataFetchFailedException - Spark - [mail # user]
...I have a job that sorts data and runs a combineByKey operation and itsometimes fails with the following error. The job is running on spark 1.2.0cluster with yarn-client deployment mode. Any ...
   Author: Aniket Bhatnagar, 2015-03-19, 12:27
[SPARK-5143] spark-network-yarn 2.11 depends on spark-network-shuffle 2.10 - Spark - [issue]
...It seems that spark-network-yarn compiled for scala 2.11 depends on spark-network-shuffle compiled for scala 2.10. This causes builds with SBT 0.13.7 to fail with the error "Conflicting cros...
http://issues.apache.org/jira/browse/SPARK-5143    Author: Aniket Bhatnagar, 2015-03-05, 05:01
[SPARK-3640] KinesisUtils should accept a credentials object instead of forcing DefaultCredentialsProvider - Spark - [issue]
...KinesisUtils should accept AWS Credentials as a parameter and should default to DefaultCredentialsProvider if no credentials are provided. Currently, the implementation forces usage of Defau...
http://issues.apache.org/jira/browse/SPARK-3640    Author: Aniket Bhatnagar, 2015-03-01, 18:12
Re: No executors allocated on yarn with latest master branch - Spark - [mail # user]
...This is tricky to debug. Check logs of node and resource manager of YARN tosee if you can trace the error. In the past I have to closely look atarguments getting passed to YARN container (th...
   Author: Aniket Bhatnagar, 2015-02-12, 14:14
[expand - 2 more] - Re: Data source API | sizeInBytes should be to *Scan - Spark - [mail # dev]
...Circling back on this. Did you get a chance to re-look at this?Thanks,AniketOn Sun, Feb 8, 2015, 2:53 AM Aniket Bhatnagar wrote: ...
   Author: Aniket Bhatnagar, 2015-02-11, 18:47
[HBASE-12108] HBaseConfiguration: set classloader before loading xml files - HBase - [issue]
...IN the setup wherein HBase jars are loaded in child classloader whose parent had loaded hadoop-common jar, HBaseConfiguration.create() throws "hbase-default.xml file seems to be for and old ...
http://issues.apache.org/jira/browse/HBASE-12108    Author: Aniket Bhatnagar, 2015-02-07, 06:24
Re: Spark Job running on localhost on yarn cluster - Spark - [mail # user]
...Have you set master in SparkConf/SparkContext in your code? Driver logsshow in which mode the spark job is running. Double check if the logsmention local or yarn-cluster.Also, what's the err...
   Author: Aniket Bhatnagar, 2015-02-04, 14:16
[expand - 2 more] - Re: Programmatic Spark 1.2.0 on EMR | S3 filesystem is not working when using - Spark - [mail # user]
...Alright.. I found the issue. I wasn't setting "fs.s3.buffer.dir"configuration. Here is the final spark conf snippet that works:"spark.hadoop.fs.s3n.impl": "com.amazon.ws.emr.hadoop.fs.EmrFil...
   Author: Aniket Bhatnagar, 2015-02-03, 05:50
Sort:
project
Spark (61)
Kafka (16)
HBase (1)
Impala (1)
type
mail # user (63)
issue (10)
mail # dev (6)
date
last 7 days (0)
last 30 days (1)
last 90 days (10)
last 6 months (42)
last 9 months (79)
author
Ted Yu (2037)
Harsh J (1318)
Jun Rao (1100)
Andrew Purtell (1017)
Todd Lipcon (1016)
Stack (1004)
GitHub Import (895)
Josh Elser (875)
Jonathan Ellis (865)
stack (829)
Jarek Jarcec Cecho (814)
Hitesh Shah (800)
Yusaku Sako (793)
Siddharth Seth (780)
Jean-Daniel Cryans (752)
Eric Newton (739)
Brock Noland (723)
Steve Loughran (721)
Jonathan Hsieh (702)
James Taylor (692)
Roman Shaposhnik (687)
Hyunsik Choi (648)
Namit Jain (648)
Owen O'Malley (617)
Bikas Saha (584)
Aniket Bhatnagar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB