Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Query regarding the configuration in hdfs-site.xml


Copy link to this message
-
Re: Query regarding the configuration in hdfs-site.xml
Hi Andreina,

You are right! FSNamesystem.java:3156 (and line 3023) has a "less than"
comparison, when in fact it ought to be <= . Could you please file a JIRA?

Thanks
Ravi.

        if (numLive < datanodeThreshold) {
          if (!"".equals(msg)) {
            msg += "\n";
          }
          msg += String.format(
            "The number of live datanodes %d needs an additional %d live "
            + "datanodes to reach the minimum number %d.",
            numLive, (datanodeThreshold - numLive) + 1 , datanodeThreshold);
        }

On Wed, Apr 25, 2012 at 3:19 AM, andreina <[EMAIL PROTECTED]> wrote:

> Hi,****
>
>     When *“dfs.namenode.safemode.min.datanodes”* is configured to n****
>
> So namenode will be in safemode until n DN are registered with the
> namenode .****
>
> ** **
>
> But in UI it displays that n+1 datanodes are additionally needed. And
> “safe mode will be turned off automatically “ message is also displayed .*
> ***
>
> ==========****
>
> “dfs.namenode.safemode.min.datanodes” =2****
>
> Started the NN****
>
> The UI report displays that ****
>
> ** **
>
> “Safe mode is on.The number of live datanodes 0 needs additional *3* live
> inimum number 2. Safe mode will turned off automatically”.****
>
> Scenario 2:****
>
> ========****
>
> “dfs.namenode.safemode.min.datanodes”=2147483647****
>
> ** **
>
> UI report****
>
> “Safemode is on.The number of live datanodes 0  needs additional  live
> datanodes  *-2147483648  *to reach the minimum number 2147483647. Safe
> mode will turned off automatically*”*
>
> ** **
>
> *As per the given description when the configured value is reached the
> namenode comes out of safemode*
>
> *But Why In the UI report shows that it needs additional n+1 datanode
> needed when configured to n ?*
>
> ** **
>
> ** **
> e configuration *dfs.namenode.safemode.threshold-pct*  also adds one
> block extra in the UI report****
>
> Scenario :3****
>
> ==========****
>
> dfs.namenode.safemode.threshold-pct=1****
>
> Started NN,2DN****
>
> Wrote a file with 167 blocks****
>
> Stoped 2DN and NN****
>
> Started NN****
>
> UI report:****
>
> “Safemode is on.The reported blocks 0 needs additional *168 *blocks to
> reach threshold 1.000 0f total blocks 167.Safe mode will turned off
> automatically”.****
>
> ** **
>
>
> Huawei Technologies India Pvt. Ltd.
> Level 3,4 e Leela Palce
> 23, Airport Road, Bangalore - 560008
>
>
> www.huawei.com
>
> -------------------------------------------------------------------------------------------------------------------------------------
> This e-mail and its attachments contain confidential information from
> HUAWEI, which
> is intended only for the person or entity whose address is listed above.
> Any use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender by
> phone or email immediately and delete it!****
>
> ** **
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB