Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: how to locate the replicas of a file in HDFS?


Copy link to this message
-
Re: how to locate the replicas of a file in HDFS?
ClientProtocol namenode = DFSClient.createNamenode(conf);
HdfsFileStatus hfs = namenode.getFileInfo("your_hdfs_file_name");
LocatedBlocks lbs = namenode.getBlockLocations("your_hdfs_file_name", 0,
hfs.getLen());

for (LocatedBlock lb : lbs.getLocatedBlocks()) {
  DatanodeInfo[]  info = lb.getLocations() ;
  //you can get data node name or address here.
}
On Tue, Jun 4, 2013 at 2:02 PM, Mahmood Naderan <[EMAIL PROTECTED]>wrote:

> >hadoop fsck mytext.txt -files -locations -blocks
>
>
> I expect something like a tag which is attached to each block (say block
> X) that shows the position of the replicated block of X. The method you
> mentioned is a user level task. Am I right?
>
> Regards,
> Mahmood*
> *
>
>   ------------------------------
>  *From:* Rahul Bhattacharjee <[EMAIL PROTECTED]>
> *To:* "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>; 一凡 李 <
> [EMAIL PROTECTED]>
> *Sent:* Tuesday, June 4, 2013 9:34 AM
> *Subject:* Re: how to locate the replicas of a file in HDFS?
>
> hadoop fsck mytext.txt -files -locations -blocks
>
> Thanks,
> Rahul
>
>
>
> On Tue, Jun 4, 2013 at 10:19 AM, 一凡 李 <[EMAIL PROTECTED]> wrote:
>
> Hi,
>
> Could you tell me how to locate where store each replica of a file in HDFS?
>
> Correctly speaking, if I create a file in HDFS(replicate factor:3),how to
> find the DataNodes which store its each block and replicas?
>
>
> Best Wishes,
> Yifan
> ____________________
>
>
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB