| clear query|facets|time |
Search criteria: .
Results from 61 to 70 from
148 (0.075s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: "Map input bytes" vs HDFS_BYTES_READ - MapReduce - [mail # dev]
|
|
...Ravi: Can you illustrate the situation where map output doesn't fit in io.sort.mb ? Thanks On Thu, Feb 3, 2011 at 8:14 PM, Ravi Gummadi wrote: ...
|
|
|
Author: Ted Yu,
2011-02-04, 04:34
|
|
|
Re: "Map input bytes" vs HDFS_BYTES_READ - MapReduce - [mail # dev]
|
|
...bytes of local data file(s) when LocalJobRunner is used. Correct me if I am wrong. On Tue, Feb 1, 2011 at 7:52 PM, Harsh J wrote: ...
|
|
|
Author: Ted Yu,
2011-02-04, 03:22
|
|
|
Re: "Map input bytes" vs HDFS_BYTES_READ - MapReduce - [mail # dev]
|
|
...Harsh: When LocalJobRunner is used, only "Map input bytes" is calculated. Can you comment on this case ? Thanks On Tue, Feb 1, 2011 at 7:52 PM, Harsh J wrote: ...
|
|
|
Author: Ted Yu,
2011-02-03, 18:35
|
|
|
Re: "Map input bytes" vs HDFS_BYTES_READ - MapReduce - [mail # dev]
|
|
...If map task(s) were retried (mapred.map.max.attempts times), how would these two counters be affected ? Thanks On Tue, Feb 1, 2011 at 7:31 PM, Harsh J wrote: ...
|
|
|
Author: Ted Yu,
2011-02-02, 03:39
|
|
|
"Map input bytes" vs HDFS_BYTES_READ - MapReduce - [mail # dev]
|
|
...In hadoop 0.20.2, what's the relationship between "Map input bytes" and HDFS_BYTES_READ ? 203446204073 23413127561 163502600 0 965922136488 296754600 Thanks...
|
|
|
Author: Ted Yu,
2011-02-02, 02:36
|
|
|
UniqValueCount - MapReduce - [mail # dev]
|
|
...Hi, For 0.20.2, the following page doesn't contain usage: http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/lib/aggregate/class-use/UniqValueCount.html where ca...
|
|
|
Author: Ted Yu,
2011-01-07, 18:18
|
|
|
Re: Passing messages - MapReduce - [mail # user]
|
|
...In your reducer, you can utilize Reporter (getCounter and incrCounter methods) to pass this information between reducers. On Sat, Dec 18, 2010 at 8:04 AM, Martin Becker wrote: &n...
|
|
|
Author: Ted Yu,
2010-12-18, 16:44
|
|
|
Re: object Writable and Serialization - MapReduce - [mail # user]
|
|
...Old bits: Can you try adding 'org.apache.hadoop.io. serializer.JavaSerialization,' to the following config ? "C:\hadoop-0.20.2\src\core\core-default.xml"(87,9): io.serialization...
|
|
|
Author: Ted Yu,
2010-12-10, 15:50
|
|
|
Re: How to share Same Counter in Multiple Jobs? - MapReduce - [mail # user]
|
|
...I wrote the following code today. We have our own flow execution logic which calls the following to collect counters. enum COUNT_COLLECTION { ...
|
|
|
Author: Ted Yu,
2010-12-10, 05:51
|
|
|
Re: Memory Manager in Hadoop MR - MapReduce - [mail # user]
|
|
...For 1, TMMT uses ProcessTree to check for task that is running beyond memory-limits and kills it. On Thu, Dec 9, 2010 at 3:05 AM, Pedro Costa wrote: ...
|
|
|
Author: Ted Yu,
2010-12-09, 18:17
|
|
|
|
