Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> AW: Under-replication warnings for Distributed Cache?


Copy link to this message
-
AW: Under-replication warnings for Distributed Cache?
> Von: Harsh J [mailto:[EMAIL PROTECTED]]
> Gesendet: Dienstag, 16. August 2011 07:15
> An: [EMAIL PROTECTED]
> Betreff: Re: Under-replication warnings for Distributed Cache?
>
> On Mon, Aug 15, 2011 at 7:10 PM, Christoph Schmitz
> <[EMAIL PROTECTED]> wrote:
> > Still, I have two questions: Shouldn't there be an automatic limit of mapred.submit.replication to the number > of data nodes? And more generally, should I worry about this warning?
>
> 1> That'd somehow bind MR to HDFS more tightly. Besides, your HDFS
> won't attack busy nodes for job jar writes/etc forms of replication.
> if they report themselves as busy (loaded) or unavailable. The idea
> sounds good though, please file a JIRA for this?

Ok, will do! Thank for the help,

Christoph