| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
13 (0.124s).
|
|
|
Loading phrases to help you
refine your search...
|
|
[MAPREDUCE-4709] Counters that track max values - MapReduce - [issue]
|
|
...A nice feature to help monitor MR jobs would be mapreduce counters that track the maximum of some metric across all workers. These trackers would work just like regular counters except it wo...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4709
Author: Jeremy Lewi,
2013-01-25, 13:50
|
|
|
Re: Counters that track the max value - MapReduce - [mail # user]
|
|
...Done. https://issues.apache.org/jira/browse/MAPREDUCE-4709 Thanks J On Fri, Oct 5, 2012 at 10:13 AM, Harsh J wrote: ...
|
|
|
Author: Jeremy Lewi,
2012-10-05, 17:40
|
|
|
Re: Counters that track the max value - MapReduce - [mail # user]
|
|
...HI Harsh, Thank you very much that will work. How come we can't simply create a modification of a regular mapreduce counter which does this behind the scenes? It seems like we sh...
|
|
|
Author: Jeremy Lewi,
2012-10-05, 15:48
|
|
|
Counters that track the max value - MapReduce - [mail # user]
|
|
...HI hadoop-users, I'm curious if there is an implementation somewhere of a counter which tracks the maximum of some value across all mappers or reducers? Thanks J...
|
|
|
Author: Jeremy Lewi,
2012-10-03, 15:17
|
|
|
Re: Hadoop Streaming job Fails - Permission Denied error - MapReduce - [mail # user]
|
|
...Benjoy to redirect stdout add the lines import sys sys.stdout=sys.stderr to the top of your py files (i.e right after the shebang line). J On Tue, Sep 13, 2011 at 1:4...
|
|
|
Author: Jeremy Lewi,
2011-09-13, 20:09
|
|
|
Re: Hadoop Streaming job Fails - Permission Denied error - MapReduce - [mail # user]
|
|
...Bejoy, The other problem I typically ran into using python streaming jobs was if my mapper or reducer wrote to stdout. Since hadoop uses stdout to pass data back to Hadoop, any erroneo...
|
|
|
Author: Jeremy Lewi,
2011-09-13, 03:36
|
|
|
Re: Hadoop Streaming job Fails - Permission Denied error - MapReduce - [mail # user]
|
|
...I would suggest you try putting your mapper/reducer py files in a directory that is world readable at every level . i.e /tmp/test. I had similar problems when I was using streaming and I bel...
|
|
|
Author: Jeremy Lewi,
2011-09-12, 13:20
|
|
|
Re: mapreduce and python - MapReduce - [mail # user]
|
|
...Hassen, I've been very succesful using Hadoop Streaming, Dumbo, and TypedBytes as a solution for using python to implement mappers and reducers. TypedBytes is a hadoop encoding f...
|
|
|
Author: Jeremy Lewi,
2011-06-21, 05:13
|
|
|
Re: Sequence file format in python and serialization - MapReduce - [mail # user]
|
|
...JJ If you want to use complex types in a streaming job I think you need to encode the values using the typedbytes format within the sequence file; i.e the key and value in the sequence...
|
|
|
Author: Jeremy Lewi,
2011-06-02, 13:12
|
|
|
Re: debug mapreduce basics - MapReduce - [mail # user]
|
|
...Mike, Check out this wiki http://code.google.com/p/hadoop-clusternet/wiki/DebuggingJobsUsingEclipse It shows how if your running in stand alone mode you can run a job in debug mo...
|
|
|
Author: Jeremy Lewi,
2011-04-28, 23:58
|
|
|
|
