| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
13 (0.26s).
|
|
|
Loading phrases to help you
refine your search...
|
|
[MAPREDUCE-3779] Create hard and soft limits for job counters - MapReduce - [issue]
|
|
...The mapreduce.job.counters.limit is not overridable at the job level. While it is necessary to limit the number of counters to reduce overhead, there are times when exceeding the limit...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-3779
Author: Dave Shine,
2013-03-17, 06:18
|
|
|
RE: Exit code 126? - MapReduce - [mail # user]
|
|
...I was referring to https://issues.apache.org/jira/browse/MAPREDUCE-2374 Dave Shine Sr. Software Engineer 321.939.5093 direct | 407.314.0122 mobile CI Boost™ Clients Outper...
|
|
|
Author: Dave Shine,
2013-01-14, 13:11
|
|
|
RE: Exit code 126? - MapReduce - [mail # user]
|
|
...We see this quite a bit. There is a JIRA (I don't remember the number) that addresses this issue. It has been applied to the apache distro, but I don't think it is incorporated i...
|
|
|
Author: Dave Shine,
2013-01-11, 22:05
|
|
|
Task Attempt Failed - MapReduce - [mail # user]
|
|
...I'm starting to see the following error show up, but I don't know what it i s trying to tell me. Does anyone know what this error means? 12/10/08 03:13:12 INFO mapred.JobClient:...
|
|
|
Author: Dave Shine,
2012-10-08, 12:28
|
|
|
RE: Distributing Keys across Reducers - MapReduce - [mail # user]
|
|
...Just wanted to follow up on this issue. It turned out that I was overlooki ng the obvious. Turns out that over 8% of the mapper output had exactly th e same key, which was actual...
|
|
|
Author: Dave Shine,
2012-07-25, 12:21
|
|
|
RE: Distributing Keys across Reducers - MapReduce - [mail # user]
|
|
...Yes, that is a possibility, but it will take some significant rearchitectur e. I was assuming that was what I was going to have to do until I saw the key distribution problem and...
|
|
|
Author: Dave Shine,
2012-07-20, 17:12
|
|
|
RE: Distributing Keys across Reducers - MapReduce - [mail # user]
|
|
...These numbers are with everything I laid out below. The job was running ac ceptably until a couple of days ago when a change increased the output of t he Map phase by about 30%. ...
|
|
|
Author: Dave Shine,
2012-07-20, 16:28
|
|
|
RE: Distributing Keys across Reducers - MapReduce - [mail # user]
|
|
...Thanks John. The key is my own WritableComparable object, and I have created custom Comp arator, Partitioner, and KeyValueGroupingComparator. However, they are all pretty g...
|
|
|
Author: Dave Shine,
2012-07-20, 15:16
|
|
|
RE: Distributing Keys across Reducers - MapReduce - [mail # user]
|
|
...Thanks Syed. I'm not using HBase, so I don't think this is related to my p roblem. Dave Shine Sr. Software Engineer 321.939.5093 direct | 407.314.0122 mobile CI Boost(tm) C...
|
|
|
Author: Dave Shine,
2012-07-20, 15:09
|
|
|
Distributing Keys across Reducers - MapReduce - [mail # user]
|
|
...I have a job that is emitting over 3 billion rows from the map to the reduc e. The job is configured with 43 reduce tasks. A perfectly even distribut ion would amount to about 70...
|
|
|
Author: Dave Shine,
2012-07-20, 13:20
|
|
|
|
