Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 35 (0.218s).
Loading phrases to help you
refine your search...
[Streaming] Non-blocking recommendation in custom receiver documentation and KinesisReceiver's worker.run blocking calll - Spark - [mail # user]
...Hi allReading through Spark streaming's custom receiver documentation, it isrecommended that onStart and onStop methods should not block indefinitely.However, looking at the source code of K...
   Author: Aniket Bhatnagar, 2014-09-24, 07:30
[expand - 3 more] - Re: Spark streaming stops computing while the receiver keeps running without any errors reported - Spark - [mail # user]
...Hi allI was finally able to get this working by settingthe SPARK_EXECUTOR_INSTANCES to a high number. However, I am wondering ifthis is a bug because the app gets submitted but ceases to run...
   Author: Aniket Bhatnagar, 2014-09-24, 06:07
[expand - 2 more] - Re: Dependency hell in Spark applications - Spark - [mail # dev]
...I have submitted a defect in JIRA for this:https://issues.apache.org/jira/browse/SPARK-3638 and have submitted a PR (https://github.com/apache/spark/pull/2489) that temporarily fixes theissu...
   Author: Aniket Bhatnagar, 2014-09-22, 11:15
[expand - 1 more] - Re: Bulk-load to HBase - Spark - [mail # user]
...Agreed that the bulk import would be faster. In my case, I wasn't expectinga lot of data to be uploaded to HBase and also, I didn't want to take thepain of importing generated HFiles into HB...
   Author: Aniket Bhatnagar, 2014-09-19, 12:41
[expand - 2 more] - Re: Out of memory with Spark Streaming - Spark - [mail # user]
...Hi allSorry but this was totally my mistake. In my persistence logic, I wascreating async http client instance in RDD foreach but was never closing itleading to memory leaks.Apologies for wa...
   Author: Aniket Bhatnagar, 2014-09-12, 12:34
[expand - 1 more] - Re: Re[2]: HBase 0.96+ with Spark 1.0+ - Spark - [mail # user]
...Hi ReinisTry if the exclude suggestion from me and Sean works for you. If not, canyou turn on verbose class loading to see from wherejavax.servlet.ServletRegistration is loaded? The class sh...
   Author: Aniket Bhatnagar, 2014-09-12, 12:30
Re: Spark on Raspberry Pi? - Spark - [mail # user]
...Just curiois... What's the use case you are looking to implement?On Sep 11, 2014 10:50 PM, "Daniil Osipov"  wrote: ...
   Author: Aniket Bhatnagar, 2014-09-11, 17:41
Using Spark's ActionSystem for performing analytics using Akka - Spark - [mail # user]
...Sorry about the noob question, but I was just wondering if we use Spark'sActorSystem (SparkEnv.actorSystem), would it distribute actors acrossworker nodes or would the actors only run in dri...
   Author: Aniket Bhatnagar, 2014-09-02, 14:13
[Streaming] Triggering an action in absence of data - Spark - [mail # user]
...Hi allI am struggling to implement a use case wherein I need to trigger an actionin case no data has been received for X amount of time. I haven't been ableto figure out an easy way to do th...
   Author: Aniket Bhatnagar, 2014-09-01, 12:25
[expand - 1 more] - Re: [Stream] Checkpointing | chmod: cannot access `/cygdrive/d/tmp/spark/f8e594bf-d940-41cb-ab0e-0fd3710696cb/rdd-57/.part-00001-attempt-215': No such file or directory - Spark - [mail # user]
...Hi everyoneIt turns out that  I had chef installed and it's chmod has higherpreference than cygwin's chmod in the PATH. I fixed the environmentvariable and now its working fine.On 1 Sep...
   Author: Aniket Bhatnagar, 2014-09-01, 06:38
Spark (18)
Kafka (16)
Impala (1)
mail # user (33)
mail # dev (2)
last 7 days (2)
last 30 days (10)
last 90 days (18)
last 6 months (19)
last 9 months (35)
Ted Yu (1649)
Harsh J (1293)
Jun Rao (1034)
Todd Lipcon (1001)
Stack (973)
Jonathan Ellis (842)
Andrew Purtell (799)
Jean-Daniel Cryans (753)
jacques@... (738)
stack (716)
Yusaku Sako (715)
Jarek Jarcec Cecho (699)
Eric Newton (697)
Jonathan Hsieh (675)
Roman Shaposhnik (660)
Brock Noland (656)
Neha Narkhede (650)
Namit Jain (649)
Hitesh Shah (626)
Owen O'Malley (625)
Steve Loughran (615)
Siddharth Seth (614)
Josh Elser (571)
Eli Collins (545)
Arun C Murthy (543)
Aniket Bhatnagar