| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
18 (0.118s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: About configuring cluster setup - MapReduce - [mail # user]
|
|
...You can, however note that unless you also run a TaskTracker on that node (bad idea) then any blocks that are replicated to this node won't be available as input to MapReduces and you are lo...
|
|
|
Author: Robert Dyer,
2013-05-14, 16:23
|
|
|
Job cleanup - MapReduce - [mail # user]
|
|
...What does the job cleanup task do? My understanding was it just cleaned up any intermediate/temporary files and moved the reducer output to the output directory? Does it do more?...
|
|
|
Author: Robert Dyer,
2013-04-13, 19:35
|
|
|
Re: Slow MR time and high network utilization with all local data - MapReduce - [mail # user]
|
|
...Thanks for pointing me towards short circuit! I dug around and couldnt find in the logs any mention of the local reader loading, and then spotted a config error. So when I used H...
|
|
|
Author: Robert Dyer,
2013-02-25, 08:17
|
|
|
Re: Slow MR time and high network utilization with all local data - MapReduce - [mail # user]
|
|
...I am using Ganglia. Note I have short circuit reads enabled (I think, I never verified it was working but I do get errors if I run jobs as another user). Also, if Ganglia's netwo...
|
|
|
Author: Robert Dyer,
2013-02-25, 07:41
|
|
|
Slow MR time and high network utilization with all local data - MapReduce - [mail # user]
|
|
...I have a small 6 node dev cluster. I use a 1GB SequenceFile as input to a MapReduce job, using a custom split size of 10MB (to increase the number of maps). Each map call will re...
|
|
|
Author: Robert Dyer,
2013-02-24, 21:05
|
|
|
MapFile.Reader/Writer - MapReduce - [mail # user]
|
|
...Is there a reason why MapFile.Reader/Writer constructors take a String for dirName instead of a Path? This seems inconsistent with SequenceFile.Reader/Writer. Also the order of a...
|
|
|
Author: Robert Dyer,
2013-02-22, 04:54
|
|
|
Re: Namenode failures - MapReduce - [mail # user]
|
|
...Forgot to mention: Hadoop 1.0.4 On Sat, Feb 16, 2013 at 2:38 PM, Robert Dyer wrote: Robert Dyer [EMAIL PROTECTED]...
|
|
|
Author: Robert Dyer,
2013-02-16, 20:39
|
|
|
Namenode failures - MapReduce - [mail # user]
|
|
...I am at a bit of wits end here. Every single time I restart the namenode, I get this crash: 2013-02-16 14:32:42,616 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file ...
|
|
|
Author: Robert Dyer,
2013-02-16, 20:38
|
|
|
Re: Specific HDFS tasks where is passwordless SSH is necessary - MapReduce - [mail # user]
|
|
...The JobTracker will also SSH in to start TaskTracker's. So basically, the masters need SSH to any slave(s) you define. The slave nodes (DN, TT) do not need SSH to each other. &nb...
|
|
|
Author: Robert Dyer,
2013-02-05, 23:37
|
|
|
Re: why not hadoop backup name node data to local disk daily or hourly? - MapReduce - [mail # user]
|
|
...I actually have this exact same error. After running my namenode for awhile (with a snn), it gets to a point where the snn starts crashing and if I try to restart the NN I will get thi...
|
|
|
Author: Robert Dyer,
2012-12-26, 14:17
|
|
|
|
