| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
99 (0.134s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Writing large output kills job with timeout _ need ideas - MapReduce - [mail # user]
|
|
...I am running a mapper job which generates a large number of output records for every input record. about 32,000,000,000 output records from about 150 mappers - each record about 200 bytes Th...
|
|
|
Author: Steve Lewis,
2012-01-18, 17:49
|
|
|
How do I use a MapFile as an output in 0.202 - MapReduce - [mail # user]
|
|
...MaoFileOutputFormat is in the mapred package but not the MapReducePackage Steven M. Lewis PhD 4221 105th Ave NE Kirkland, WA 98033 206-384-1340 (cell) Skype lordjoe_com...
|
|
|
Author: Steve Lewis,
2012-01-11, 00:47
|
|
|
How can I reduce the number of nodes used by a job - MapReduce - [mail # user]
|
|
...I am reporting on performance of a hadoop task on a cluster with about 50 nodes. I would like to be able to report performance on clusters of 5,10,20 nodes without changing int current clust...
|
|
|
Author: Steve Lewis,
2011-12-15, 22:03
|
|
|
What is the cost of using a counter - MapReduce - [mail # user]
|
|
...I have several counters that I maintain to allow me to keep statistics on critical operations. I have my code incrementing the counters in an inner loop partly to make sure my job is not kil...
|
|
|
Author: Steve Lewis,
2011-12-08, 18:48
|
|
|
How can a Hadoop program determine it is running in stand alone mode - MapReduce - [mail # user]
|
|
...I have some test code that would kill performance (and not work properly on a cluster but can accumulate test data in stand alone mode. I want a way to programatically when the code is runni...
|
|
|
Author: Steve Lewis,
2011-12-02, 00:10
|
|
|
Gratuitous use of CHMOD in windows - MapReduce - [mail # user]
|
|
...I am running a job on a cluster launching from a windows box and " fs.default.name" to point the job to the cluster. Everything works until the last step where I say FileSystem fileSys...
|
|
|
Author: Steve Lewis,
2011-11-21, 23:47
|
|
|
Any way to limit the total tasks running on a node in 0.202 - MapReduce - [mail # user]
|
|
...Hadoop can set the maximum mappers and reducers running on a node but under 0.20.2 I do not see a way to limit the system from running mappers and reducers together with the total exceeding ...
|
|
|
Author: Steve Lewis,
2011-11-10, 03:06
|
|
|
Re: Map Rask has IO exception - MapReduce - [mail # user]
|
|
...I suspect that HDFS and/or its local disk may be full or sick The problem occurs after a job has been running at least 10 hours - I am too new at this to know too much about where to l...
|
|
|
Author: Steve Lewis,
2011-11-07, 20:03
|
|
|
Re: Map Rask has IO exception - MapReduce - [mail # user]
|
|
...0.202 and using that API - On Mon, Nov 7, 2011 at 8:27 AM, Robert Evans wrote: Steven M. Lewis PhD 4221 105th Ave NE Kirkland, WA 98033 206-384-1340 (cell) Sky...
|
|
|
Author: Steve Lewis,
2011-11-07, 16:36
|
|
|
Re: Problems with MR Job running really slowly - MapReduce - [mail # user]
|
|
...1) I am varying both the number of mappers and reducers trying to determine three things a) What are the options I need reducers and mappers to ...
|
|
|
Author: Steve Lewis,
2011-11-07, 05:13
|
|
|
|
