Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 168 (0.322s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Can a map function return null - Spark - [mail # user]
...So you imagine something like this: JavaRDD words = ... JavaRDD> wordsFiltered = words.map(newFunction>() {    @Override    public Optional call...
   Author: Steve Lewis, 2015-04-19, 19:17
Fwd: Numbering RDD members Sequentially - Spark - [mail # user]
...From: Steve Lewis Date: Wed, Mar 11, 2015 at 9:13 AMSubject: Re: Numbering RDD members SequentiallyTo: "Daniel, Ronald (ELS-SDG)" perfect - exactly what I was looking for, not quite sure why...
   Author: Steve Lewis, 2015-03-12, 00:18
Numbering RDD members Sequentially - Spark - [mail # user]
...I have Hadoop Input Format which reads records and producesJavaPairRDD locatedData  where_1() is a formatted version of the file location - like"000012690",, "000024386 ."000027523 ..._...
   Author: Steve Lewis, 2015-03-11, 00:32
Distributing Computation across slaves - Spark - [mail # user]
... I have a job involving two sets of data indexed with the same type of key.I have an expensive operation that I want to run on pairs sharing the samekey. The following code works BUT al...
   Author: Steve Lewis, 2015-01-15, 21:18
Is there a way to read a parquet database without generating an RDD - Spark - [mail # user]
...I have an application where a function needs access to the results of aselect from a parquet database. Creating a JavaSQLContext and from ita  JavaSchemaRDDas shown below works but the ...
   Author: Steve Lewis, 2015-01-06, 19:36
Developing with Pycharm - Spark - [mail # user]
...I am trying to use PyCharm for Spark development on a windows 8.1 Machine -I have installed py4j, added Spark pythin as a content root and have Cygwinin my pathAlso Using intelliJ works for ...
   Author: Steve Lewis, 2015-01-05, 18:18
Is there a way (in Java) to turn Java Iterable into a JavaRDD? - Spark - [mail # user]
...I notice new methods such as JavaSparkContext makeRDD (with few usefulexamples) - It takes a Seq but while there are ways to turn a list into aSeq I see nothing that uses an Iterable ...
   Author: Steve Lewis, 2014-12-19, 18:26
Who is using Spark and related technologies for bioinformatics applications? - Spark - [mail # user]
...I am aware of the ADAM project in Berkeley and I am working on Proteomicsearches -anyone else working in this space ...
   Author: Steve Lewis, 2014-12-17, 16:28
[expand - 2 more] - Re: how to convert an rdd to a single output file - Spark - [mail # user]
...what would good spill settings be?On Fri, Dec 12, 2014 at 2:45 PM, Sameer Farooqui wrote:Steven M. Lewis PhD4221 105th Ave NEKirkland, WA 98033206-384-1340 (cell)Skype lordjoe_com ...
   Author: Steve Lewis, 2014-12-12, 23:07
In Java how can I create an RDD with a large number of elements - Spark - [mail # user]
...assume I don't care about values which may be created in a later map - inscala I can sayval rdd = sc.parallelize(1 to 1000000000, numSlices = 1000)but in Java JavaSparkContext can only paral...
   Author: Steve Lewis, 2014-12-09, 02:18
Sort:
project
MapReduce (74)
Spark (50)
Hadoop (39)
HDFS (5)
type
mail # user (168)
date
last 7 days (0)
last 30 days (1)
last 90 days (3)
last 6 months (25)
last 9 months (168)
author
Ted Yu (2036)
Harsh J (1318)
Jun Rao (1099)
Andrew Purtell (1016)
Todd Lipcon (1016)
Stack (1003)
GitHub Import (895)
Josh Elser (872)
Jonathan Ellis (865)
stack (828)
Jarek Jarcec Cecho (813)
Hitesh Shah (799)
Yusaku Sako (793)
Siddharth Seth (780)
Jean-Daniel Cryans (752)
Eric Newton (739)
Brock Noland (723)
Steve Loughran (720)
Jonathan Hsieh (701)
James Taylor (691)
Roman Shaposhnik (687)
Hyunsik Choi (648)
Namit Jain (648)
Owen O'Malley (617)
Bikas Saha (584)
Steve Lewis
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB