Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> How to get Under-replicated blocks information [Location]


+
Dhanasekaran Anbalagan 2013-02-27, 10:17
+
Shawn Higgins 2013-02-27, 15:14
Copy link to this message
-
RE: How to get Under-replicated blocks information [Location]
you get the block locations(hoping that you are asking about which node) by two ways..

i) ./hadoop fsck / -files -blocks -locations.(Commandline)
ii) NameNode UI..(GO to UI and click on browse filesystem and then click on files where you want to check..(Below you can see block locations..))

________________________________
From: Dhanasekaran Anbalagan [[EMAIL PROTECTED]]
Sent: Wednesday, February 27, 2013 6:17 PM
To: cdh-user; user
Subject: How to get Under-replicated blocks information [Location]

Hi Guys,

I am running three machine cluster, with replication factor 2, I got problem in replica i changed to 2.
after I ran fsck  i got  Under-replicated blocks: 71 (0.0034828386 %)

 Total size: 105829415143 B
 Total dirs: 9704
 Total files: 2038873 (Files currently being written: 2)
 Total blocks (validated): 2038567 (avg. block size 51913 B) (Total open file blocks (not validated): 2)
 Minimally replicated blocks: 2038567 (100.0 %)
 Over-replicated blocks: 0 (0.0 %)
 Under-replicated blocks: 71 (0.0034828386 %)
 Mis-replicated blocks: 0 (0.0 %)
 Default replication factor: 2
 Average block replication: 1.9999995
 Corrupt blocks: 0
 Missing replicas: 71 (0.0017414198 %)
 Number of data-nodes: 2
 Number of racks: 1
FSCK ended at Wed Feb 27 05:12:31 EST 2013 in 32647 milliseconds
Please guide what the block location of the 71. in HDFS file system.

-Dhanasekaran.
Did I learn something today? If not, I wasted it.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB