|
|
-
how to find data nodes on which a file is distributed to?
CB 2011-11-28, 15:59
Hi,
I am new to HDFS. I read HDFS documents on the internet but I couldn't figure out the following. Is there a way to find a list of data nodes where a file is distributed to when I executed a command such as
hadoop dfs –copyFromLocal /tmp/testdata /user/chansup/test
Thanks, - Chansup
-
Re: how to find data nodes on which a file is distributed to?
Praveen Sripati 2011-11-28, 16:31
Go to the NameNode web UI (default port is 50070) and select 'Browse the filesystem' and drill down to the file. At the bottom of the page the block report is shown. Or else 'hadoop fsck / -files -blocks -locations' from the CLI will also give the block report for all the files in HDFS.
Thanks, Praveen
On Mon, Nov 28, 2011 at 9:29 PM, CB <[EMAIL PROTECTED]> wrote:
> Hi, > > I am new to HDFS. I read HDFS documents on the internet but I couldn't > figure out the following. > Is there a way to find a list of data nodes where a file is distributed to > when I executed a command such as > > hadoop dfs –copyFromLocal /tmp/testdata /user/chansup/test > > > > Thanks, > - Chansup > >
-
RE: how to find data nodes on which a file is distributed to?
Uma Maheswara Rao G 2011-11-28, 16:59
>From Java API, FileSystem#getFileBlockLocations should give you the blocklocations.
Regards, Uma ________________________________ From: Praveen Sripati [[EMAIL PROTECTED]] Sent: Monday, November 28, 2011 10:01 PM To: [EMAIL PROTECTED] Subject: Re: how to find data nodes on which a file is distributed to?
Go to the NameNode web UI (default port is 50070) and select 'Browse the filesystem' and drill down to the file. At the bottom of the page the block report is shown. Or else 'hadoop fsck / -files -blocks -locations' from the CLI will also give the block report for all the files in HDFS.
Thanks, Praveen
On Mon, Nov 28, 2011 at 9:29 PM, CB <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Hi,
I am new to HDFS. I read HDFS documents on the internet but I couldn't figure out the following. Is there a way to find a list of data nodes where a file is distributed to when I executed a command such as
hadoop dfs –copyFromLocal /tmp/testdata /user/chansup/test Thanks, - Chansup
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext