| clear query|facets|time |
Search criteria: .
Results from 101 to 110 from
162 (0.784s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Partitioner in Hadoop 0.20 - MapReduce - [mail # user]
|
|
...On Aug 4, 2010, at 8:38 AM, David Rosenstrauch wrote: The short answer is that it doesn't need to. If you make your partitioner either Configured or JobConfigurable, it will be...
|
|
|
Author: Owen O'Malley,
2010-08-04, 16:30
|
|
|
Re: Reading File in constructor of Mapper - MapReduce - [mail # user]
|
|
...Usually, you'd do that kind of processing in the setConf method of the Mapper (assuming you mark it Configurable). That will let you get the configuration which can contain the location of t...
|
|
|
Author: Owen O'Malley,
2010-07-25, 15:47
|
|
|
[MAPREDUCE-1456] Undeprecate the Job constructors that don't include Cluster. - MapReduce - [issue]
|
|
...There is no reason to break compatibility in the Job API. We should just construct the Cluster automatically as the compatibility layer already does....
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-1456
Author: Owen O'Malley,
2010-07-02, 00:04
|
|
|
Re: limit of values in reduce phase? - MapReduce - [mail # user]
|
|
...On Jun 21, 2010, at 5:14 PM, Torsten Curdt wrote: There is no assumption that all of the values fit into memory. The iterator is really the result of a merge sort from disk and...
|
|
|
Author: Owen O'Malley,
2010-06-22, 05:47
|
|
|
Re: custom Configuration values - MapReduce - [mail # user]
|
|
...On Fri, Jun 11, 2010 at 8:17 AM, Torsten Curdt wrote: https://issues.apache.org/jira/browse/MAPREDUCE-1456 I guess I'll do that patch next week. *smile* ...
|
|
|
Author: Owen O'Malley,
2010-06-11, 15:35
|
|
|
Re: custom Configuration values - MapReduce - [mail # user]
|
|
...On Fri, Jun 11, 2010 at 5:05 AM, Torsten Curdt wrote: = new Configuration(); .from", time_from); .until", time_until); = new Cluster(conf); Do: Job job = new Job(conf...
|
|
|
Author: Owen O'Malley,
2010-06-11, 14:43
|
|
|
Re: [RT] map reduce "pipelines" - MapReduce - [mail # dev]
|
|
...At Yahoo, we had a framework that was similar to MapReduce called Dreadnaught. When we were converting applications off of Dreadnaught to Hadoop MapReduce, we considered supporting M-R-R. (D...
|
|
|
Author: Owen O'Malley,
2010-06-09, 18:50
|
|
|
Re: InputSplits in Mapper - MapReduce - [mail # user]
|
|
...On Jun 5, 2010, at 11:15 AM, Torsten Curdt wrote: No, there isn't an api for that. The data is actually available in HDFS, but it is considered an internal format and in partic...
|
|
|
Author: Owen O'Malley,
2010-06-05, 19:04
|
|
|
Re: almost sorted map output - MapReduce - [mail # user]
|
|
...On Fri, May 28, 2010 at 10:58 PM, juber patel wrote: The map output sort is efficient for mostly sorted output. The dominant cost is the transfer costs of the shuffle and that wo...
|
|
|
Author: Owen O'Malley,
2010-06-01, 03:11
|
|
|
[MAPREDUCE-1786] Add method to support pre-partitioned data - MapReduce - [issue]
|
|
...There are some applications where the map wants to partition the data itself. This happens in Pipes, if the user has a C++ partitioner. It would make sense to support it in streaming too. Th...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-1786
Author: Owen O'Malley,
2010-05-13, 03:34
|
|
|
|
