Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 125 (0.17s).
Loading phrases to help you
refine your search...
Looking for a good sample of Using Spark to do things Hadoop can do - Spark - [mail # user]
...Assume I have a large book with many Chapters and many lines of text. Assume I have a function that tells me the similarity of two lines oftext. The objective is to find the most simila...
   Author: Steve Lewis, 2014-09-13, 05:32
[expand - 1 more] - Re: Is the structure for a jar file for running Spark applications the same as that for Hadoop - Spark - [mail # user]
...In modern projects there are a bazillion dependencies - when I use Hadoop Ijust put them in a lib directory in the jar - If I have a project thatdepends on 50 jars I need a way to deliver th...
   Author: Steve Lewis, 2014-09-10, 22:49
[expand - 2 more] - Re: Mapping Hadoop Reduce to Spark - Spark - [mail # user]
...Assume I define a partitioner like   /**  * partition on the first letter   */    public class PartitionByStart extends Partitioner {  ...
   Author: Steve Lewis, 2014-09-04, 23:58
[expand - 1 more] - I am looking for a Java sample of a Partitioner - Spark - [mail # user]
...Assume say JavaWord countI call the equivalent of a Mapper JavaPairRDD ones = words.mapToPair(,,,Now right here I want to guarantee that each word starting with aparticular letter is pr...
   Author: Steve Lewis, 2014-09-02, 23:18
What happens if I have a function like a PairFunction but which might return multiple values - Spark - [mail # user]
...In many cases when I work with Map Reduce my mapper or my reducer mighttake a single value and map it to multiple keys -The reducer might also take a single key and emit multiple valuesI don...
   Author: Steve Lewis, 2014-08-28, 19:18
[expand - 1 more] - Re: How do you hit breakpoints using IntelliJ In functions used by an RDD - Spark - [mail # user]
...????That was not quite in EnglishMy Flatmap code is shown belowI know the code is called since the answers are correct but would like toput a break point in dropNonLetters to make sure that ...
   Author: Steve Lewis, 2014-08-25, 17:42
How to start master and workers on Windows - Spark - [mail # user]
...Thank you for your advice - I really need this help and promise to post ablog entry once it worksI ranand this ran successfully and I got a web page at http://localhost:8080this saysSpark Ma...
   Author: Steve Lewis, 2014-08-22, 18:57
I am struggling to run Spark Examples on my local machine - Spark - [mail # user]
...I download the binaries for spark-1.0.2-hadoop1 and unpack it on my Widows8 box.I can execute spark-shell.com and get a command window which does theproper thingsI open a browser to http:/lo...
   Author: Steve Lewis, 2014-08-21, 16:38
[expand - 2 more] - Re: Does anyone have a stand alone spark instance running on Windows - Spark - [mail # user]
...I have made a little progress - by downloading a prebuilt version of SparkI can call spark-shell.cmd and bring up a spark shell.In the shell things run.Next I go to my development environmen...
   Author: Steve Lewis, 2014-08-20, 16:55
[expand - 3 more] - Re: What configuration parameters cause a Hadoop 2.x job to run on the cluster - Hadoop - [mail # user]
...I am using MR and know the job.setJar command - I can add all dependenciesto the jar in the lib directory but I was wondering if Hadoop would copy ajar from my local machine to the cluster -...
   Author: Steve Lewis, 2014-04-25, 17:14
Sort:
project
MapReduce (74)
Hadoop (37)
Spark (9)
HDFS (5)
type
mail # user (125)
date
last 7 days (2)
last 30 days (9)
last 90 days (9)
last 6 months (11)
last 9 months (125)
author
Ted Yu (1638)
Harsh J (1293)
Jun Rao (1028)
Todd Lipcon (1002)
Stack (974)
Jonathan Ellis (842)
Andrew Purtell (795)
Jean-Daniel Cryans (753)
jacques@... (738)
stack (716)
Yusaku Sako (705)
Jarek Jarcec Cecho (699)
Eric Newton (697)
Jonathan Hsieh (675)
Roman Shaposhnik (656)
Brock Noland (653)
Namit Jain (649)
Neha Narkhede (646)
Hitesh Shah (626)
Owen O'Malley (625)
Steve Loughran (617)
Siddharth Seth (614)
Josh Elser (561)
Eli Collins (545)
Arun C Murthy (543)
Steve Lewis