Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> Why single thread for HDFS?


Copy link to this message
-
Re: Why single thread for HDFS?
Hi,

Can you please post this on [EMAIL PROTECTED] ? I suspect the
most qualified people to answer this question would all be on that
list.

Hemanth

On Fri, Jul 2, 2010 at 11:43 AM, elton sky <[EMAIL PROTECTED]> wrote:
> I guess this question was igored, so I just post it again.
>
> From my understanding, HDFS uses a single thread to do read and write.
> Since a file is composed of many blocks and each block is stored as a file
> in the underlying FS, we can do some parallelism on block base.
> When read across multi-blocks, threads can be used to read all blocks. When
> write, we can calculate the offset of each block and write to all of them
> simultaneously.
>
> Is this right?
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB