Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # general - Why single thread for HDFS?


Copy link to this message
-
Re: Why single thread for HDFS?
Hemanth Yamijala 2010-07-02, 07:55
Hi,

Can you please post this on [EMAIL PROTECTED] ? I suspect the
most qualified people to answer this question would all be on that
list.

Hemanth

On Fri, Jul 2, 2010 at 11:43 AM, elton sky <[EMAIL PROTECTED]> wrote:
> I guess this question was igored, so I just post it again.
>
> From my understanding, HDFS uses a single thread to do read and write.
> Since a file is composed of many blocks and each block is stored as a file
> in the underlying FS, we can do some parallelism on block base.
> When read across multi-blocks, threads can be used to read all blocks. When
> write, we can calculate the offset of each block and write to all of them
> simultaneously.
>
> Is this right?
>