Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Re: 答复: a question about dfs.replication


Copy link to this message
-
Re: 答复: a question about dfs.replication
yypvsxf19870706 2013-07-01, 15:24
Hi

    Could you please get the property value by using : hdfs getconf -confkey dfs.replication.

发自我的 iPhone

在 2013-7-1,15:51,Francis.Hu <[EMAIL PROTECTED]> 写道:

>  
> Actually, My java client is running with the same configuration as the hadoop's . The dfs.replication is already set as 2 in my hadoop's configuration.
> So i think the dfs.replication is already overrided by my configuration in hdfs-site.xml. but seems it doesn't work even i overrided the parameter evidently.
>  
>  
> 发件人: Емельянов Борис [mailto:[EMAIL PROTECTED]]
> 发送时间: Monday, July 01, 2013 15:18
> 收件人: [EMAIL PROTECTED]
> 主题: Re: a question about dfs.replication
>  
> On 01.07.2013 10:19, Francis.Hu wrote:
> Hi, All
>  
> I am installing a cluster with Hadoop 2.0.5-alpha. I have one namenode and two datanodes. The dfs.replication is set as 2 in hdfs-site.xml. After all configuration work is done, I started all nodes. Then I saved a file into HDFS through java client. nOW I can access hdfs web page: x.x.x.x:50070,and also see the file is already listed in the hdfs list.
> My question is:  The replication column in HDFS web page is showing as 3, not 2.  Does anyone know What the problem is?
>  
> ---Actual setting of hdfs-site.xml
> <property>
> <name>dfs.replication</name>
> <value>2</value>
> </property>
>  
> After that, I typed dfsamdin command to check the file:
> hdfs fsck /test3/
> The result of above command:
> /test3/hello005.txt:  Under replicated BP-609310498-192.168.219.129-1372323727200:blk_-1069303317294683372_1006. Target Replicas is 3 but found 2 replica(s).
> Status: HEALTHY
>  Total size:    35 B
>  Total dirs:    1
>  Total files:   1
>  Total blocks (validated):      1 (avg. block size 35 B)
>  Minimally replicated blocks:   1 (100.0 %)
>  Over-replicated blocks:        0 (0.0 %)
>  Under-replicated blocks:       1 (100.0 %)
>  Mis-replicated blocks:         0 (0.0 %)
>  Default replication factor:    2
>  Average block replication:     2.0
>  Corrupt blocks:                0
>  Missing replicas:              1 (33.333332 %)
>  Number of data-nodes:          3
>  Number of racks:               1
> FSCK ended at Sat Jun 29 16:51:37 CST 2013 in 6 milliseconds
>  
>  
> Thanks,
> Francis Hu
>  
> If I'm not mistaking "dfs.replication" parameter in config sets only default replication factor, which can be overrided when putting file to hdfs.