| clear query|facets|time |
Search criteria: .
Results from 51 to 60 from
106 (2.963s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: how to write custom object using M/R - MapReduce - [mail # user]
|
|
...Sounds to me like your custom object isn't serializing properly. You might want to read up on how to do it correctly here: http://developer.yahoo.com/hadoop/tutorial/module5.html...
|
|
|
Author: David Rosenstrauch,
2011-01-18, 18:49
|
|
|
Re: Getting a temporary directory in map jobs - MapReduce - [mail # user]
|
|
...On 12/21/2010 09:50 PM, Chase Bradford wrote: Mostly correct. But just FYI, the temp file does not automatically get deleted (see: http://download.oracle.com/javase/6...
|
|
|
Author: David Rosenstrauch,
2010-12-22, 17:40
|
|
|
Re: How to Influence Reduce Task Location. - MapReduce - [mail # user]
|
|
...Not a very good approach for numerous reasons. (e.g., you generally don't want to run another processing-intensive app - like a database - on a hadoop node, you don't want ...
|
|
|
Author: David Rosenstrauch,
2010-12-20, 03:36
|
|
|
Re: Reduce Task Priority / Scheduler - MapReduce - [mail # user]
|
|
...On 12/19/2010 10:39 AM, Martin Becker wrote: Not that I know of. And again, this kind of defeats the whole purpose of Hadoop. The whole idea is that tasks are execute...
|
|
|
Author: David Rosenstrauch,
2010-12-20, 03:32
|
|
|
Re: How to Influence Reduce Task Location. - MapReduce - [mail # user]
|
|
...It doesn't. But you really can't do what you're asking. Nor, I think, would you really want to. The whole idea behind Hadoop is that it's a distributed system w...
|
|
|
Author: David Rosenstrauch,
2010-12-20, 03:30
|
|
|
Re: How to Influence Reduce Task Location. - MapReduce - [mail # user]
|
|
...And, as a follow-up, yes, we use the partitioner class to achieve this. Our partioner runs a hashing algorithm which ensures that a given user key will always map to a spe...
|
|
|
Author: David Rosenstrauch,
2010-12-20, 03:28
|
|
|
Re: How to Influence Reduce Task Location. - MapReduce - [mail # user]
|
|
...On 12/18/2010 12:43 PM, Jane Chen wrote: We don't do exactly that, but we do something similar. We don't make specific reducers run on specific hosts. But we do speci...
|
|
|
Author: David Rosenstrauch,
2010-12-20, 03:26
|
|
|
Re: Passing messages - MapReduce - [mail # user]
|
|
...On 12/18/2010 11:04 AM, Martin Becker wrote: You could use Zookeeper to do this. DR...
|
|
|
Author: David Rosenstrauch,
2010-12-20, 03:24
|
|
|
Re: M/R file gather/scatter issue - MapReduce - [mail # user]
|
|
...Seems like CombineFileInputFormat.createPool() might help here. But I'm a little unclear on usage. That method is protected ... and so then I guess only accessible by...
|
|
|
Author: David Rosenstrauch,
2010-12-08, 22:21
|
|
|
Re: M/R file gather/scatter issue - MapReduce - [mail # user]
|
|
...Bit of a snag here: Since I'm thinking this app needs to use CombineFileInputFormat (since lots of small files) this throws a wrench into these plans a bit. CombineFileInpu...
|
|
|
Author: David Rosenstrauch,
2010-12-08, 16:25
|
|
|
|
