Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> Why single thread for HDFS?

Copy link to this message
Re: Why single thread for HDFS?

Can you please post this on [EMAIL PROTECTED] ? I suspect the
most qualified people to answer this question would all be on that


On Fri, Jul 2, 2010 at 11:43 AM, elton sky <[EMAIL PROTECTED]> wrote:
> I guess this question was igored, so I just post it again.
> From my understanding, HDFS uses a single thread to do read and write.
> Since a file is composed of many blocks and each block is stored as a file
> in the underlying FS, we can do some parallelism on block base.
> When read across multi-blocks, threads can be used to read all blocks. When
> write, we can calculate the offset of each block and write to all of them
> simultaneously.
> Is this right?