| clear query|facets|time |
Search criteria: .
Results from 91 to 100 from
147 (0.089s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Combiner timing out - MapReduce - [mail # user]
|
|
...Chris, I have filed MAPREDUCE-3376 for this issue. I have no idea when or if I will get around to fi xing it. It looks like a fairly simple change, perhaps even a on...
|
|
|
Author: Robert Evans,
2011-11-08, 16:31
|
|
|
Re: Different ways of configuring the memory to the TaskTracker child process (Mapper and Reduce Tasks) - MapReduce - [mail # user]
|
|
...Praveen, The mapred.job.map.memory.mb is a config that Hadoop uses to decided if you r task is using too much memory and needs to be killed. The memory used by this include...
|
|
|
Author: Robert Evans,
2011-11-08, 16:18
|
|
|
Re: Map Rask has IO exception - MapReduce - [mail # user]
|
|
...I really don't know if there is any more I can do over email. You might wa nt to look at the metrics to see if anything out of the ordinary is happeni ng on these nodes just before or ...
|
|
|
Author: Robert Evans,
2011-11-07, 20:29
|
|
|
Re: Map Rask has IO exception - MapReduce - [mail # user]
|
|
...Did you mean 0.20.2? If so then Wow, that is a bit of a stumper. Line 200 of BZip2Codec.java is the following 196: public void write(int b) throws IOException ...
|
|
|
Author: Robert Evans,
2011-11-07, 17:20
|
|
|
Re: Combiner timing out - MapReduce - [mail # user]
|
|
...OK I found the problem. Line 1148 of Task.java in the OldCombinerRunner cl ass. If your combiner is part of the old mapred API then the reporter is a lways the NULL reporter and ...
|
|
|
Author: Robert Evans,
2011-11-07, 16:53
|
|
|
Re: Map Rask has IO exception - MapReduce - [mail # user]
|
|
...What version of Hadoop are you using? On 11/5/11 11:09 AM, "Steve Lewis" wrote: My job is dying during a map task write. This happened in enough task to k ill the jo...
|
|
|
Author: Robert Evans,
2011-11-07, 16:27
|
|
|
Re: On the relationship between MultithreadedMapper and tasks - MapReduce - [mail # user]
|
|
...What you are doing is commonly called a map/side join. You can often impro ve your performance by increasing the replication count for the smaller fil es, 10 is usually a good number, ...
|
|
|
Author: Robert Evans,
2011-11-07, 16:26
|
|
|
Re: Keeping intermediate results - MapReduce - [mail # user]
|
|
...So you are processing a graph looking for a specific node with a given valu e. The special key is about all I can think of or if you don't need the re st of the graph you can look at j...
|
|
|
Author: Robert Evans,
2011-11-07, 16:18
|
|
|
Re: Combiner timing out - MapReduce - [mail # user]
|
|
...There was a change that went into 0.20.205 https://issues.apache.org/jira/b rowse/MAPREDUCE-2187 where after so many inputs to the combiner progress is automatically reported. I ...
|
|
|
Author: Robert Evans,
2011-11-04, 16:11
|
|
|
Re: Never ending reduce jobs, error Error reading task outputConnection refused - MapReduce - [mail # user]
|
|
...I am not sure what is causing this, but yes they are related. In hadoop th e map output is served to the reducers through jetty, which is an imbedded web server. If the red...
|
|
|
Author: Robert Evans,
2011-11-04, 15:39
|
|
|
|
