Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 31 to 39 from 39 (0.123s).
Loading phrases to help you
refine your search...
Statistics and Early Keys to Reducers - Hadoop - [mail # user]
...Imaging I have the following problem - I want to call a standard word count program but instead of having the reducer output the word and its count I want it to output the word and the count...
   Author: Steve Lewis, 2010-10-28, 15:53
[expand - 1 more] - Re: Approached to combing the output of reducers - Hadoop - [mail # user]
...will assign the output intended for a single file to a single reducer (in some cases multiple output files might be supported - one per reducer - On issue is how to allow the reducer to writ...
   Author: Steve Lewis, 2010-10-23, 23:19
Re: question about processing XML file - Hadoop - [mail # user]
...Look at the classes org.apache.hadoop.mapreduce.lib.input.LineRecordReader and org.apache.hadoop.mapreduce.lib.input.TextInputFormat  What you need to do  is copy those and change ...
   Author: Steve Lewis, 2010-10-12, 17:10
[expand - 1 more] - Re: I am looking for a minimal Map-Reduce task - Hadoop - [mail # user]
...Answering my own question - the following code will send  a key of 1 and a value of "foo" to a mapper and pass it on to a reducer - just the one key It is a good example of a custom inp...
   Author: Steve Lewis, 2010-10-10, 22:36
Re: return a parameter using Map only - Hadoop - [mail # user]
...what distinguishes this record and will every mapper know it? It sounds like all you need to do is ignore non-matching records and  then run other code in the mapper - I am assuming acr...
   Author: Steve Lewis, 2010-09-22, 21:32
Re: How to enumerate files in the directories? - Hadoop - [mail # user]
...   @Override     public HDFSFile[] getFiles(String directory) {         String result = executeCommand("hadoop fs -ls " + directory);     &n...
   Author: Steve Lewis, 2010-08-25, 16:04
[expand - 1 more] - Re: large parameter file, too many intermediate output - Hadoop - [mail # user]
...I don't think of half a  billion key value pairs as that large a number - nor 20,000 per task - these are not atypical for hadoop tasks and many users will see these as small numbers wh...
   Author: Steve Lewis, 2010-08-12, 21:47
Problems accessing the local file system on AWS MapReduce - Hadoop - [mail # user]
...I am trying to use Distributes Cache on AWS Elastic Map educe  Using S3Fox I see I have two files in my bucket lordjoe FeeFie.txt and Hello   In My main I say public static void ma...
   Author: Steve Lewis, 2010-08-03, 15:44
Re: Distance Calculation problem - Hadoop - [mail # user]
...Well my first suggestion is since the original String is used as a key - repeat the parse steps in the Mapper in the reduce code using the text from the key - then verify that the values you...
   Author: Steve Lewis, 2010-07-28, 18:53
Sort:
project
MapReduce (74)
Spark (50)
Hadoop (39)
HDFS (5)
type
mail # user (39)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (2)
last 9 months (39)
author
Harsh J (571)
Steve Loughran (435)
Owen O'Malley (393)
Todd Lipcon (239)
Allen Wittenauer (208)
Eli Collins (184)
Alejandro Abdelnur (179)
Chris Nauroth (176)
Ted Yu (169)
Arun C Murthy (168)
Tom White (120)
Daryn Sharp (117)
Nigel Daley (115)
Konstantin Shvachko (111)
Colin Patrick McCabe (110)
Doug Cutting (96)
Aaron Kimball (94)
Edward Capriolo (88)
Mark Kerzner (87)
jason hadoop (82)
Akira AJISAKA (75)
Hairong Kuang (75)
Kai Zheng (75)
Benoy Antony (73)
Runping Qi (73)
Steve Lewis
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB