Home | About | Sematext search-lucene.com search-hadoop.com search-devops.com metrics + logs = try SPM and Logsene for free
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 106 (0.201s).
Loading phrases to help you
refine your search...
[SPARK-12105] Add a DataFrame.show() with argument for output PrintStream - Spark - [issue]
...It would be nice to send the output of DataFrame.show(...) to a different output stream than stdout, including just capturing the string itself. This is useful, e.g., for testing. Actually, ...
http://issues.apache.org/jira/browse/SPARK-12105    Author: Dean Wampler, 2016-01-27, 10:05
Re: Trying to understand dynamic resource allocation - Spark - [mail # user]
...It works on Mesos, too. I'm not sure about Standalone mode.Dean Wampler, Ph.D.Author: Programming Scala, 2nd Edition (O'Reilly)Typesafe @deanwampler http://polyglotprogramming.comOn Mon...
   Author: Dean Wampler, 2016-01-11, 16:10
Re: Spark Context not getting initialized in local mode - Spark - [mail # user]
...ClassNotFoundException usually means one of a few problems:1. Your app assembly is missing the jar files with those classes.2. You mixed jar files from imcompatible versions in your assembly...
   Author: Dean Wampler, 2016-01-08, 16:29
[expand - 1 more] - Re: Networking problems in Spark 1.6.0 - Spark - [mail # user]
...ConcurrentHashMap.keySet() returning a KeySetView is a Java 8 method. TheJava 7 method returns a Set. Are you running Java 7? What happens if yourun Java 8?Dean Wampler, Ph.D.Author: Program...
   Author: Dean Wampler, 2016-01-05, 14:34
[expand - 1 more] - Re: Akka with Spark - Spark - [mail # dev]
...Note that Akka is being removed from Spark. Even if it weren't, I wouldconsider keeping Akka processes separate from Spark processes, so you canmonitor, debug, and scale them independently. ...
   Author: Dean Wampler, 2015-12-27, 03:01
[expand - 1 more] - Re: Spark data frame - Spark - [mail # user]
...More specifically, you could have TBs of data across thousands ofpartitions for a single RDD. If you call collect(), BOOM!Dean Wampler, Ph.D.Author: Programming Scala, 2nd Edition (O'Re...
   Author: Dean Wampler, 2015-12-22, 22:35
Re: Using inteliJ for spark development - Spark - [mail # user]
...The easiest way is to import an SBT project into IntelliJ that has theSpark jars as dependencies. Then you can work in local mode (--masterlocal[*]). You could start with the build files in ...
   Author: Dean Wampler, 2015-12-22, 16:54
Re: spark streaming updateStateByKey state is nonsupport other type except ClassTag such as list? - Spark - [mail # user]
...There are ClassTags for Array, List, and Map, as well as for Int, etc. thatyou might have inside those collections. What do you mean by sql? Could youpost more of your code?Dean Wampler, Ph....
   Author: Dean Wampler, 2015-12-22, 16:46
[SPARK-12052] DataFrame with self-join fails unless toDF() column aliases provided - Spark - [issue]
...Joining with the same DF twice appears to match on the wrong column unless the columns in the results of the first join are aliased with "toDF". Here is an example program:val rdd = sc.paral...
http://issues.apache.org/jira/browse/SPARK-12052    Author: Dean Wampler, 2015-11-30, 18:17
Re: [ANNOUNCE] Spark 1.6.0 Release Preview - Spark - [mail # dev]
...I'm seeing an RPC timeout with the 2.11 build, but not the Hadoop1, 2.10build: The following session with two uses of sc.parallize causes it almostevery the time. Occasionally I don't see th...
   Author: Dean Wampler, 2015-11-23, 21:36
Spark (103)
Hive (2)
Mesos (1)
Ted Yu (1270)
Siddharth Seth (971)
stack (971)
Josh Elser (938)
Reynold Xin (931)
Jonathan Ellis (900)
GitHub Import (895)
Hitesh Shah (874)
James Taylor (863)
Andrew Purtell (855)
Hyunsik Choi (846)
Andrew Onischuk (815)
Yusaku Sako (773)
Todd Lipcon (755)
Sergey Shelukhin (747)
Antonenko Alexander (721)
Jarek Jarcec Cecho (720)
Eric Newton (680)
Jonathan Hsieh (665)
Jaimin D Jetly (650)
Brock Noland (641)
Xiangrui Meng (638)
Bikas Saha (631)
Andrii Babiichuk (629)
Edward J. Yoon (626)
Namit Jain (616)
Andrii Tkach (614)
Roman Shaposhnik (607)
Oleg Nechiporenko (597)
Steve Loughran (589)
Sean Busbey (577)
Srimanth Gunturi (552)
Siddharth Wagle (535)
Jun Rao (528)
Alejandro Abdelnur (502)
Konstantin Boudnik (502)
Amareshwari Sriramadasu (495)
Stephan Ewen (491)
Chris Nauroth (486)
Vinod Kone (486)
Vinod Kumar Vavilapalli (486)
Aleksandr Kovalenko (478)
Joseph K. Bradley (473)
Nick Dimiduk (463)
Robert Kanter (459)
Keith Turner (448)
Eli Collins (443)
Rohini Palaniswamy (443)
Dmitry Lysnichenko (441)
Owen O'Malley (441)
Dean Wampler (0)
mail # user (92)
mail # dev (9)
issue (5)
last 7 days (0)
last 30 days (3)
last 90 days (15)
last 6 months (33)
last 9 months (106)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB