Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> what exactly does data in HDFS look like?

Copy link to this message
Re: what exactly does data in HDFS look like?
But basically you are right : it is the same concept as with a classical
file system. A file is seen as a sequence of bytes. For various efficiency
reasons, the whole sequence is not stored like that but first splits into
blocks (subsequences). With a local file system, these blocks will be
within the local drives. With HDFS, they are somewhere within the cluster
(and replicated, of course).

So really, the filesystem doesn't care about what is inside the file and
the format is something it is really oblivious to.

On Sat, Jul 19, 2014 at 7:02 AM, Shahab Yunus <[EMAIL PROTECTED]>