Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 107 (0.202s).
Loading phrases to help you
refine your search...
Re: distributing Scala Map datatypes to RDD - Spark - [mail # user]
...is the following what you are looking for?scala >  sc.parallelize(myMap.map{ case (k,v) => (k,v) }.toSeq)res2: org.apache.spark.rdd.RDD[(String, Int)] = ParallelCollectionRDD[0] a...
   Author: Stephen Boesch, 2014-10-13, 21:59
[expand - 1 more] - Re: Building pyspark with maven? - Spark - [mail # user]
...Looking more closely, inside the core/pom.xml there are a few references tothe python buildThis question mostly has  to do with my limited  of knowledge of pythonenvironment . &nbs...
   Author: Stephen Boesch, 2014-10-08, 21:13
Setup/Cleanup for RDD closures? - Spark - [mail # user]
...Consider there is some connection / external resource allocation requiredto be accessed/mutated by each of the rows from within a single workerthread.  That connection should only  ...
   Author: Stephen Boesch, 2014-10-03, 04:47
[expand - 1 more] - Re: Implicit conversion RDD -> SchemaRDD - Spark - [mail # user]
...Here is the specific code    val sc = new SparkContext(s"local[$NWorkers]", "HBaseTestsSparkContext")    val ctx = new SQLContext(sc)    import c...
   Author: Stephen Boesch, 2014-10-02, 14:20
[expand - 1 more] - Re: Hbase-Testing-Util jar files are empty (except meta-inf and dirs) on maven central repo? - HBase - [mail # user]
...Thanks for responding Andrew.   Now that you pointed this out, actually itis in yet a different jar:  hbase-server:test-jar.  Unfortunately - as seenin my OP there is no sourc...
   Author: Stephen Boesch, 2014-09-28, 02:42
[expand - 1 more] - Re: testCacheMultiThreadedSingleKey producing "unable to create new native thread" in 0.98 branch? - HBase - [mail # user]
...Thanks Ted. Spot on.  I am running the small and medium tests now - and ithas well passed the point of the threads issue.2014-09-27 13:41 GMT-07:00 Ted Yu : ...
   Author: Stephen Boesch, 2014-09-27, 21:07
Re: Right Tool - Kafka - [mail # user]
...Hi Patrick,   Kafka can be used at any scale including small ones(initially anyways). The issues I ran into personally various issues withZooKeeper management and a bug in deleting topi...
   Author: Stephen Boesch, 2014-09-12, 23:05
[expand - 4 more] - Re: Nested data structures examples for HBase - HBase - [mail # user]
...Thanks Sean.  We have some internal requirements that lead us to mostlikely need to stick with native HBase API's.  But the suggestion is stillappreciated - I was not aware of that...
   Author: Stephen Boesch, 2014-09-10, 19:41
[SPARK-2686] Add Length support to Spark SQL and HQL and Strlen support to SQL - Spark - [issue]
...Syntactic, parsing, and operational support have been added for LEN(GTH) and STRLEN functions.Examples:SQL:import org.apache.spark.sql._case class TestData(key: Int, value: String)val sqlc =...
http://issues.apache.org/jira/browse/SPARK-2686    Author: Stephen Boesch, 2014-09-02, 23:17
[SPARK-2638] Improve concurrency of fetching Map outputs - Spark - [issue]
...This issue was noticed while perusing the MapOutputTracker source code. Notice that the synchronization is on the containing "fetching" collection - which makes ALL fetches wait if any fetch...
http://issues.apache.org/jira/browse/SPARK-2638    Author: Stephen Boesch, 2014-09-02, 01:29
Sort:
project
Spark (27)
Hive (22)
MapReduce (21)
HBase (16)
Hadoop (15)
HDFS (3)
Kafka (3)
type
mail # user (88)
mail # dev (13)
issue (6)
date
last 7 days (0)
last 30 days (6)
last 90 days (19)
last 6 months (37)
last 9 months (107)
author
Ted Yu (1700)
Harsh J (1294)
Jun Rao (1059)
Todd Lipcon (1001)
Stack (978)
Jonathan Ellis (844)
Andrew Purtell (822)
Jean-Daniel Cryans (753)
Yusaku Sako (733)
stack (714)
Jarek Jarcec Cecho (702)
Eric Newton (698)
Jonathan Hsieh (673)
Brock Noland (668)
Neha Narkhede (667)
Roman Shaposhnik (665)
Namit Jain (649)
Hitesh Shah (627)
Owen O'Malley (625)
Steve Loughran (624)
Siddharth Seth (614)
Josh Elser (590)
Eli Collins (545)
Arun C Murthy (543)
Doug Cutting (533)
Stephen Boesch