| clear query|facets|time |
Search criteria: .
Results from 41 to 50 from
55 (0.108s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Is there a way to use the Cloudera Distribution without root access - Hadoop - [mail # user]
|
|
...We are trying set up a cluster using the latest Cloudera distribution. The issue is that IT will not give us root access to the systems in the cluster. The people trying to set up the cluste...
|
|
|
Author: Steve Lewis,
2010-11-09, 00:20
|
|
|
Is there any reliable way for a reducer to determine the number of mappers used in a job - Hadoop - [mail # user]
|
|
...Short of having every mapper increment a counter Steven M. Lewis PhD 4221 105th Ave Ne Kirkland, WA 98033 206-384-1340 (cell) Institute for Systems Biology Seattle WA...
|
|
|
Author: Steve Lewis,
2010-11-04, 20:28
|
|
|
Is there an any way to change the number of reduce jobs on a local hadoop job - Hadoop - [mail # user]
|
|
...I frequently run small versions of my Hadoop jobs as local single machine jobs to debug my logic. When I do this I always get only a single reduce task even when I call setNumReduceTasks wit...
|
|
|
Author: Steve Lewis,
2010-10-29, 18:10
|
|
|
Statistics and Early Keys to Reducers - Hadoop - [mail # user]
|
|
...Imaging I have the following problem - I want to call a standard word count program but instead of having the reducer output the word and its count I want it to output the word and the count...
|
|
|
Author: Steve Lewis,
2010-10-28, 15:53
|
|
|
Re: Approached to combing the output of reducers - Hadoop - [mail # user]
|
|
...will assign the output intended for a single file to a single reducer (in some cases multiple output files might be supported - one per reducer - On issue is how to allow the reducer to writ...
|
|
|
Author: Steve Lewis,
2010-10-23, 23:19
|
|
|
Approached to combing the output of reducers - Hadoop - [mail # user]
|
|
...Once I run a map-reduce job I get output in the form of part-r-00000 part-r-00001 ... In many cases the output is significantly smaller than the original input - take the classic word ...
|
|
|
Author: Steve Lewis,
2010-10-23, 22:08
|
|
|
Re: question about processing XML file - Hadoop - [mail # user]
|
|
...Look at the classes org.apache.hadoop.mapreduce.lib.input.LineRecordReader and org.apache.hadoop.mapreduce.lib.input.TextInputFormat What you need to do is copy those and change ...
|
|
|
Author: Steve Lewis,
2010-10-12, 17:10
|
|
|
Re: I am looking for a minimal Map-Reduce task - Hadoop - [mail # user]
|
|
...Answering my own question - the following code will send a key of 1 and a value of "foo" to a mapper and pass it on to a reducer - just the one key It is a good example of a custom inp...
|
|
|
Author: Steve Lewis,
2010-10-10, 22:36
|
|
|
I am looking for a minimal Map-Reduce task - Hadoop - [mail # user]
|
|
...For development purposes I need to run some code in a mapper and / or reducer ( imagine I am trying to verify that files in distributed cache are properly deployed) I am looking for co...
|
|
|
Author: Steve Lewis,
2010-10-09, 20:21
|
|
|
Re: return a parameter using Map only - Hadoop - [mail # user]
|
|
...what distinguishes this record and will every mapper know it? It sounds like all you need to do is ignore non-matching records and then run other code in the mapper - I am assuming acr...
|
|
|
Author: Steve Lewis,
2010-09-22, 21:32
|
|
|
|
