| clear query|facets|time |
Search criteria: .
Results from 41 to 50 from
106 (0.116s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: change number of slots in MR - MapReduce - [mail # user]
|
|
...On 03/25/2011 03:07 PM, Pedro Costa wrote: Sorry, my mistake. Set these in the mapred-site.xml file on each node: mapred.tasktracker.reduce.tasks.maximum &nbs...
|
|
|
Author: David Rosenstrauch,
2011-03-25, 19:25
|
|
|
Re: change number of slots in MR - MapReduce - [mail # user]
|
|
...On 03/25/2011 02:26 PM, Pedro Costa wrote: Yes. See the mapred.map.tasks and mapred.reduce.tasks settings. HTH, DR...
|
|
|
Author: David Rosenstrauch,
2011-03-25, 18:44
|
|
|
Re: A way to monitor HDFS for a file to come live, and then kick off a job? - MapReduce - [mail # user]
|
|
...On 03/24/2011 01:09 PM, Jonathan Coveney wrote: I suppose you could do this using HDFS, but this sounds to me like Zookeeper is much better suited to this type of application. &n...
|
|
|
Author: David Rosenstrauch,
2011-03-24, 17:16
|
|
|
Re: Sequence File usage queries - MapReduce - [mail # user]
|
|
...On 02/23/2011 07:24 PM, Mapred Learn wrote: We wrote our own sequence file dumper app. DR...
|
|
|
Author: David Rosenstrauch,
2011-03-08, 00:21
|
|
|
Job-wide cleanup functionality? - MapReduce - [mail # user]
|
|
...Perhaps this has been covered before, but I wasn't able to dig up any info. Is there any way to run a custom "job cleanup" for a map/reduce job? I know that each map and re...
|
|
|
Author: David Rosenstrauch,
2011-02-03, 16:39
|
|
|
Re: How to set object in Configuration - MapReduce - [mail # user]
|
|
...On 01/26/2011 05:43 AM, Joan wrote: The object needs to be a String or something that is easily convertible to a String (e.g., integer). This is so it can be serialized and...
|
|
|
Author: David Rosenstrauch,
2011-01-26, 15:52
|
|
|
Re: Dose one map instance only handle one input path at the same time? - MapReduce - [mail # user]
|
|
...Take a look at CombineFileInputFormat. DR On 01/21/2011 09:24 AM, lei liu wrote: o I , so ample: " dentity are...
|
|
|
Author: David Rosenstrauch,
2011-01-21, 14:49
|
|
|
Re: how to write custom object using M/R - MapReduce - [mail # user]
|
|
...Maybe change "id" to be an IntWritable, and "str" to be a Text? HTH, DR On 01/19/2011 09:36 AM, Joan wrote: ); ect. ob h"); )); 0000 ) 83) 51) 32) ize(SequenceFileRecordRea...
|
|
|
Author: David Rosenstrauch,
2011-01-19, 20:04
|
|
|
Re: question for understanding partitioning - MapReduce - [mail # user]
|
|
...On 01/18/2011 03:09 PM, Mapred Learn wrote: You should probably read the Yahoo tutorial to brush up on the topic before asking on the list. http://developer.yahoo.com/hadoo...
|
|
|
Author: David Rosenstrauch,
2011-01-18, 20:32
|
|
|
Re: how to write custom object using M/R - MapReduce - [mail # user]
|
|
...I assumed you were already doing this but yes, Alain is correct, you need to set the output format too. I initialize writing to sequence files like so: job.setOutputFormatC...
|
|
|
Author: David Rosenstrauch,
2011-01-18, 18:56
|
|
|
|
