MapReduce, mail # user - Has anyone written a program to show total use on hdfs by directory

Has anyone written a program to show total use on hdfs by directory

Steve Lewis 2011-10-26, 00:51

While I can see file sizes with the web interface, it is very difficult to
tell which directories are taking up space especially
when nested by several levels

--
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com

Re: Has anyone written a program to show total use on hdfs by directory

Tsz Wo \ 2011-10-26, 01:00

Hi Steve,

You may use the shell command "hadoop fs -count" or calling FileSystem.getContentSummary(Path f) in Java.
Hope it helps.

Tsz-Wo
________________________________
From: Steve Lewis <[EMAIL PROTECTED]>
To: mapreduce-user <[EMAIL PROTECTED]>; [EMAIL PROTECTED]
Sent: Tuesday, October 25, 2011 5:51 PM
Subject: Has anyone written a program to show total use on hdfs by directory
While I can see file sizes with the web interface, it is very difficult to tell which directories are taking up space especially
when nested by several levels

--
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com