Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 32 (0.326s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Client Offset Storage - Kafka - [mail # user]
...Basically, don't want to use ZK, for the reasons driving the new clientoffset features in 0.8.2.So we are looking for a library we could use that provides an alternativeclient offset impleme...
   Author: Surendranauth Hiraman, 2014-12-12, 18:19
Re: RDD.aggregate versus accumulables... - Spark - [mail # user]
...We use Algebird for calculating things like min/max, stddev, variance, etc.https://github.com/twitter/algebird/wiki-SurenOn Mon, Nov 17, 2014 at 11:32 AM, Daniel Siegmann wrote:SUREN HIRAMAN...
   Author: Surendranauth Hiraman, 2014-11-17, 16:57
Re: Play framework - Spark - [mail # user]
...Mohammed,Jumping in for Daniel, we actually address the configuration issue bypulling values from environment variables or command line options. Maybethat may handle at least some of your ne...
   Author: Surendranauth Hiraman, 2014-10-16, 16:43
Re: Spark And Mapr - Spark - [mail # user]
...As Sungwook said, the classpath pointing to the mapr jar is the key forthat error.MapR has a Spark install that hopefully makes it easier. I don't have theinstructions handy but you can aski...
   Author: Surendranauth Hiraman, 2014-10-02, 00:18
Re: All of the tasks have been completed but the Stage is still shown as "Active"? - Spark - [mail # user]
...History Server is also very helpful.On Thu, Jul 10, 2014 at 7:37 AM, Haopu Wang  wrote:SUREN HIRAMAN, VP TECHNOLOGYVelosAccelerating Machine Learning440 NINTH AVENUE, 11TH FLOORNEW YORK...
   Author: Surendranauth Hiraman, 2014-07-10, 12:16
Re: CPU/Disk/network performance instrumentation - Spark - [mail # dev]
...+1 on advanced tab.On Wed, Jul 9, 2014 at 5:20 PM, Mridul Muralidharan wrote:SUREN HIRAMAN, VP TECHNOLOGYVelosAccelerating Machine Learning440 NINTH AVENUE, 11TH FLOORNEW YORK, NY 10001O: (9...
   Author: Surendranauth Hiraman, 2014-07-09, 21:44
Re: Purpose of spark-submit? - Spark - [mail # user]
...Are there any gaps beyond convenience and code/config separation in usingspark-submit versus SparkConf/SparkContext if you are willing to set yourown config?If there are any gaps, +1 on havi...
   Author: Surendranauth Hiraman, 2014-07-09, 12:31
[expand - 5 more] - Re: Comparative study - Spark - [mail # user]
...Aaron,I don't think anyone was saying Spark can't handle this data size, giventestimony from the Spark team, Bizo, etc., on large datasets. This has keptus trying different things to get our...
   Author: Surendranauth Hiraman, 2014-07-08, 20:42
[expand - 1 more] - Re: Spark memory optimization - Spark - [mail # user]
...Using persist() is a sort of a "hack" or a hint (depending on yourperspective :-)) to make the RDD use disk, not memory. As I mentionedthough, the disk io has consequences, mainly (I think) ...
   Author: Surendranauth Hiraman, 2014-07-07, 12:31
Re: Enable Parsing Failed or Incompleted jobs on HistoryServer (YARN mode) - Spark - [mail # user]
...I've had some odd behavior with jobs showing up in the history server in1.0.0. Failed jobs do show up but it seems they can show up minutes orhours later. I see in the history server logs me...
   Author: Surendranauth Hiraman, 2014-07-03, 10:57
Sort:
project
Spark (25)
Kafka (7)
type
mail # user (24)
mail # dev (8)
date
last 7 days (0)
last 30 days (1)
last 90 days (4)
last 6 months (13)
last 9 months (32)
author
Ted Yu (1832)
Harsh J (1302)
Jun Rao (1014)
Todd Lipcon (995)
Stack (986)
Andrew Purtell (875)
Jonathan Ellis (854)
stack (758)
Jean-Daniel Cryans (751)
Jarek Jarcec Cecho (747)
Yusaku Sako (743)
Eric Newton (706)
Jonathan Hsieh (683)
Hitesh Shah (680)
Roman Shaposhnik (677)
Josh Elser (673)
Steve Loughran (651)
Namit Jain (648)
Siddharth Seth (643)
Brock Noland (634)
Owen O'Malley (623)
Hyunsik Choi (582)
Neha Narkhede (566)
Arun C Murthy (548)
Eli Collins (545)
Surendranauth Hiraman
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB