Home | About | Sematext search-lucene.com search-hadoop.com search-devops.com metrics + logs = try SPM and Logsene for free
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 70 (0.418s).
Loading phrases to help you
refine your search...
[expand - 2 more] - Re: Removing the Mesos fine-grained mode - Spark - [mail # dev]
...Hi guys,Can someone confirm if it is true that dynamic allocation on mesos "is designed to run one executor per slave with the configured amount of resources." I copied this sentence from th...
   Author: Jerry Lam, 2015-11-23, 14:24
[expand - 1 more] - Re: Very slow startup for jobs containing millions of tasks - Spark - [mail # user]
...Hi Ted, That looks exactly what happens. It has been 5 hrs now. The code was built for 1.4. Thank you very much! Best Regards,JerrySent from my iPhone ...
   Author: Jerry Lam, 2015-11-15, 06:04
[expand - 4 more] - [Spark-SQL]: Disable HiveContext from instantiating in spark-shell - Spark - [mail # user]
...Hi spark users and developers,Is it possible to disable HiveContext from being instantiated when usingspark-shell? I got the following errors when I have more than one sessionstarts. Since I...
   Author: Jerry Lam, 2015-11-06, 16:53
Re: Spark EC2 script on Large clusters - Spark - [mail # user]
...Does Qubole use Yarn or Mesos for resource management?Sent from my iPhone ...
   Author: Jerry Lam, 2015-11-06, 03:01
Re: Please reply if you use Mesos fine grained mode - Spark - [mail # dev]
...We "used" Spark on Mesos to build interactive data analysis platformbecause the interactive session could be long and might not use Spark forthe entire session. It is very wasteful of resour...
   Author: Jerry Lam, 2015-11-04, 01:48
Re: Unchecked contribution (JIRA and PR) - Spark - [mail # dev]
...Sergio, you are not alone for sure. Check the RowSimilarity implementation[SPARK-4823]. It has been there for 6 months. It is very likely those whichdon't merge in the version of spark that ...
   Author: Jerry Lam, 2015-11-03, 15:30
[expand - 3 more] - Re: spark sql partitioned by date... read last date - Spark - [mail # user]
...Hi Koert,If the partitioned table is implemented properly, I would think "selectdistinct(date) as dt from table order by dt DESC limit 1" would return thelatest dates without scanning the wh...
   Author: Jerry Lam, 2015-11-01, 20:18
[expand - 1 more] - Re: Spark -- Writing to Partitioned Persistent Table - Spark - [mail # user]
...Hi Bryan,Did you read the email I sent few days ago. There are more issues with partitionBy down the road: https://www.mail-archive.com/[EMAIL PROTECTED]/msg39512.html Best Regards,Jerry&nbs...
   Author: Jerry Lam, 2015-10-28, 22:29
[expand - 2 more] - Re: [Spark-SQL]: Unable to propagate hadoop configuration after SparkContext is initialized - Spark - [mail # user]
...Hi Marcelo,I tried setting the properties before instantiating spark context viaSparkConf. It works fine.Originally, the code I have read hadoop configurations from hdfs-site.xmlwhich works ...
   Author: Jerry Lam, 2015-10-27, 19:13
[expand - 5 more] - Re: [Spark SQL]: Spark Job Hangs on the refresh method when saving over 1 million files - Spark - [mail # user]
...Hi spark guys,I think I hit the same issue SPARK-8890https://issues.apache.org/jira/browse/SPARK-8890. It is marked as resolved.However it is not. I have over a million output directories fo...
   Author: Jerry Lam, 2015-10-26, 00:50
Spark (62)
HBase (4)
Pig (3)
Mesos (1)
Ted Yu (1174)
Siddharth Seth (934)
stack (922)
Josh Elser (900)
GitHub Import (895)
Jonathan Ellis (895)
Reynold Xin (855)
Hitesh Shah (850)
Andrew Purtell (838)
Hyunsik Choi (834)
James Taylor (795)
Yusaku Sako (763)
Todd Lipcon (751)
Andrew Onischuk (746)
Jarek Jarcec Cecho (685)
Sergey Shelukhin (685)
Antonenko Alexander (667)
Jonathan Hsieh (658)
Eric Newton (657)
Jaimin D Jetly (642)
Brock Noland (639)
Xiangrui Meng (630)
Edward J. Yoon (620)
Bikas Saha (619)
Namit Jain (616)
Roman Shaposhnik (603)
Andrii Babiichuk (590)
Andrii Tkach (587)
Oleg Nechiporenko (562)
Steve Loughran (549)
Srimanth Gunturi (546)
Sean Busbey (543)
Siddharth Wagle (521)
Jun Rao (504)
Alejandro Abdelnur (502)
Amareshwari Sriramadasu (487)
Vinod Kumar Vavilapalli (484)
Vinod Kone (473)
Chris Nauroth (466)
Aleksandr Kovalenko (455)
Joseph K. Bradley (454)
Robert Kanter (450)
Stephan Ewen (445)
Eli Collins (442)
Keith Turner (442)
Owen O'Malley (441)
Konstantin Boudnik (426)
Colin Patrick McCabe (425)
Patrick Wendell (420)
Rohini Palaniswamy (419)
Jerry Lam (0)
mail # user (57)
mail # dev (8)
issue (5)
last 7 days (1)
last 30 days (9)
last 90 days (26)
last 6 months (42)
last 9 months (70)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB