| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
106 (0.123s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Merge Reducers Outputs - MapReduce - [mail # user]
|
|
...On 07/26/2011 06:52 PM, Mohamed Riadh Trad wrote: Not within the map-reduce job, but you can merge it after the job is done. At my previous company we used FileUtil.copyMer...
|
|
|
Author: David Rosenstrauch,
2011-07-27, 14:55
|
|
|
Re: Example on how to decompress the output file? - MapReduce - [mail # user]
|
|
...On 07/05/2011 11:24 AM, Pedro Sa Costa wrote: Write a Java app which read from an input stream (until EOF), where the input stream is like so: FileSystem fs = FileSystem.ge...
|
|
|
Author: David Rosenstrauch,
2011-07-05, 15:34
|
|
|
Re: How does a ReduceTask determine which MapTask output to read? - MapReduce - [mail # user]
|
|
...On 06/29/2011 05:28 PM, Virajith Jalaparti wrote: You're missing 2 key steps in here. After the mappers, a sort step gets run (to sort the records in key order) and then a ...
|
|
|
Author: David Rosenstrauch,
2011-06-29, 22:37
|
|
|
Re: How to select random n records using mapreduce ? - MapReduce - [mail # user]
|
|
...Building on this, you could do something like the following to make it more random: if (numRecordsWritten < NUM_RECORDS_DESIRED) { int n = generateARandomNumberBetween1and100...
|
|
|
Author: David Rosenstrauch,
2011-06-27, 20:35
|
|
|
Re: controlling no. of mapper tasks - MapReduce - [mail # user]
|
|
...Yes, that is correct. It is indeed looking at the data size. Please carefully read through again what I wrote - particularly the part about files getting broken into ...
|
|
|
Author: David Rosenstrauch,
2011-06-20, 19:47
|
|
|
Re: controlling no. of mapper tasks - MapReduce - [mail # user]
|
|
...On 06/20/2011 03:24 PM, [EMAIL PROTECTED] wrote: The number of map tasks is determined dynamically based on the number of input chunks you have. If you want fewer map tasks...
|
|
|
Author: David Rosenstrauch,
2011-06-20, 19:38
|
|
|
Re: Passing an Object to All Reducers - MapReduce - [mail # user]
|
|
...On 05/06/2011 01:12 PM, Geoffry Roberts wrote: Serialize it to a string, set it as a configuration setting on the job's configuration, then have each reducer read it from out of ...
|
|
|
Author: David Rosenstrauch,
2011-05-06, 17:56
|
|
|
Re: Three Questions - MapReduce - [mail # user]
|
|
...On 05/03/2011 05:49 PM, Geoffry Roberts wrote: My apologies, I sent you the wrong link. Should be this: http://hadoop.apache.org/mapreduce/docs/r0.21.0/api/org/apache/hadoo...
|
|
|
Author: David Rosenstrauch,
2011-05-03, 22:08
|
|
|
Re: Three Questions - MapReduce - [mail # user]
|
|
...On 05/03/2011 01:21 PM, Geoffry Roberts wrote: You can find an individual map or reduce task's logs here: * click on (e.g.) the word "reduce" in the UI, which brings you to the &...
|
|
|
Author: David Rosenstrauch,
2011-05-03, 20:39
|
|
|
How to change logging level for an individual job - MapReduce - [mail # user]
|
|
...Is it possible to change the logging level for an individual job? (As opposed to the cluster as a whole.) E.g., is there some key that I can set on the job's configur...
|
|
|
Author: David Rosenstrauch,
2011-04-13, 15:36
|
|
|
|
