Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Query regarding the configuration in hdfs-site.xml


+
andreina 2012-04-25, 08:19
Copy link to this message
-
Re: Query regarding the configuration in hdfs-site.xml
Ravi Prakash 2012-04-25, 12:07
Hi Andreina,

You are right! FSNamesystem.java:3156 (and line 3023) has a "less than"
comparison, when in fact it ought to be <= . Could you please file a JIRA?

Thanks
Ravi.

        if (numLive < datanodeThreshold) {
          if (!"".equals(msg)) {
            msg += "\n";
          }
          msg += String.format(
            "The number of live datanodes %d needs an additional %d live "
            + "datanodes to reach the minimum number %d.",
            numLive, (datanodeThreshold - numLive) + 1 , datanodeThreshold);
        }

On Wed, Apr 25, 2012 at 3:19 AM, andreina <[EMAIL PROTECTED]> wrote:

> Hi,****
>
>     When *“dfs.namenode.safemode.min.datanodes”* is configured to n****
>
> So namenode will be in safemode until n DN are registered with the
> namenode .****
>
> ** **
>
> But in UI it displays that n+1 datanodes are additionally needed. And
> “safe mode will be turned off automatically “ message is also displayed .*
> ***
>
> ==========****
>
> “dfs.namenode.safemode.min.datanodes” =2****
>
> Started the NN****
>
> The UI report displays that ****
>
> ** **
>
> “Safe mode is on.The number of live datanodes 0 needs additional *3* live
> inimum number 2. Safe mode will turned off automatically”.****
>
> Scenario 2:****
>
> ========****
>
> “dfs.namenode.safemode.min.datanodes”=2147483647****
>
> ** **
>
> UI report****
>
> “Safemode is on.The number of live datanodes 0  needs additional  live
> datanodes  *-2147483648  *to reach the minimum number 2147483647. Safe
> mode will turned off automatically*”*
>
> ** **
>
> *As per the given description when the configured value is reached the
> namenode comes out of safemode*
>
> *But Why In the UI report shows that it needs additional n+1 datanode
> needed when configured to n ?*
>
> ** **
>
> ** **
> e configuration *dfs.namenode.safemode.threshold-pct*  also adds one
> block extra in the UI report****
>
> Scenario :3****
>
> ==========****
>
> dfs.namenode.safemode.threshold-pct=1****
>
> Started NN,2DN****
>
> Wrote a file with 167 blocks****
>
> Stoped 2DN and NN****
>
> Started NN****
>
> UI report:****
>
> “Safemode is on.The reported blocks 0 needs additional *168 *blocks to
> reach threshold 1.000 0f total blocks 167.Safe mode will turned off
> automatically”.****
>
> ** **
>
>
> Huawei Technologies India Pvt. Ltd.
> Level 3,4 e Leela Palce
> 23, Airport Road, Bangalore - 560008
>
>
> www.huawei.com
>
> -------------------------------------------------------------------------------------------------------------------------------------
> This e-mail and its attachments contain confidential information from
> HUAWEI, which
> is intended only for the person or entity whose address is listed above.
> Any use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender by
> phone or email immediately and delete it!****
>
> ** **
>