Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Re: Maximum Storage size in a Single datanode

Pamecha, Abhishek 2013-01-30, 09:15
jeba earnest 2013-01-30, 10:40
Chris Embree 2013-01-30, 11:52
Bertrand Dechoux 2013-01-30, 09:14
Copy link to this message
RE: Maximum Storage size in a Single datanode
Hi Jeba,


There are other considerations too, for example, if a single node holds 1 PB
of data and if it were to die this would cause a significant amount of
traffic as NameNode arranges for new replicas to be created.




From: Bertrand Dechoux [mailto:[EMAIL PROTECTED]]
Sent: 30 January 2013 09:14
To: [EMAIL PROTECTED]; jeba earnest
Subject: Re: Maximum Storage size in a Single datanode


I would say the hard limit is due to the OS local file system (and your

So short answer for ext3 : it doesn't seems so.

And I am not sure the answer is the most interesting. Even if you could put
1 Peta on one node, what is usually interesting is the ratio


On Wed, Jan 30, 2013 at 9:08 AM, jeba earnest <[EMAIL PROTECTED]> wrote:



Is it possible to keep 1 Petabyte in a single data node?

If not, How much is the maximum storage for a particular data node?


M. Jeba