Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 31 to 37 from 37 (0.089s).
Loading phrases to help you
refine your search...
Re: question about processing XML file - Hadoop - [mail # user]
...Look at the classes org.apache.hadoop.mapreduce.lib.input.LineRecordReader and org.apache.hadoop.mapreduce.lib.input.TextInputFormat  What you need to do  is copy those and change ...
   Author: Steve Lewis, 2010-10-12, 17:10
Re: I am looking for a minimal Map-Reduce task - Hadoop - [mail # user]
...Answering my own question - the following code will send  a key of 1 and a value of "foo" to a mapper and pass it on to a reducer - just the one key It is a good example of a custom inp...
   Author: Steve Lewis, 2010-10-10, 22:36
Re: return a parameter using Map only - Hadoop - [mail # user]
...what distinguishes this record and will every mapper know it? It sounds like all you need to do is ignore non-matching records and  then run other code in the mapper - I am assuming acr...
   Author: Steve Lewis, 2010-09-22, 21:32
Re: How to enumerate files in the directories? - Hadoop - [mail # user]
...   @Override     public HDFSFile[] getFiles(String directory) {         String result = executeCommand("hadoop fs -ls " + directory);     &n...
   Author: Steve Lewis, 2010-08-25, 16:04
Re: large parameter file, too many intermediate output - Hadoop - [mail # user]
...I don't think of half a  billion key value pairs as that large a number - nor 20,000 per task - these are not atypical for hadoop tasks and many users will see these as small numbers wh...
   Author: Steve Lewis, 2010-08-12, 21:47
Problems accessing the local file system on AWS MapReduce - Hadoop - [mail # user]
...I am trying to use Distributes Cache on AWS Elastic Map educe  Using S3Fox I see I have two files in my bucket lordjoe FeeFie.txt and Hello   In My main I say public static void ma...
   Author: Steve Lewis, 2010-08-03, 15:44
Re: Distance Calculation problem - Hadoop - [mail # user]
...Well my first suggestion is since the original String is used as a key - repeat the parse steps in the Mapper in the reduce code using the text from the key - then verify that the values you...
   Author: Steve Lewis, 2010-07-28, 18:53
MapReduce (74)
Hadoop (37)
HDFS (5)
mail # user (37)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (3)
last 9 months (37)
Harsh J (554)
Owen O'Malley (396)
Steve Loughran (378)
Todd Lipcon (238)
Eli Collins (181)
Alejandro Abdelnur (162)
Arun C Murthy (161)
Chris Nauroth (141)
Allen Wittenauer (124)
Tom White (118)
Nigel Daley (115)
Ted Yu (114)
Daryn Sharp (110)
Konstantin Shvachko (106)
Aaron Kimball (93)
Doug Cutting (93)
Edward Capriolo (87)
Colin Patrick McCabe (86)
Mark Kerzner (86)
jason hadoop (82)
Hairong Kuang (74)
Runping Qi (72)
Konstantin Boudnik (70)
Benoy Antony (69)
Suresh Srinivas (63)
Steve Lewis