Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # dev >> [VOTE] port HDFS-127 (DFSClient block read failures cause open DFSInputStream to become unusable) to hadoop 0.20/0.21


Copy link to this message
-
Re: [VOTE] port HDFS-127 (DFSClient block read failures cause open DFSInputStream to become unusable) to hadoop 0.20/0.21
+1

On Mon, Oct 19, 2009 at 2:34 PM, Tsz Wo (Nicholas), Sze <
[EMAIL PROTECTED]> wrote:

> DFSClient has a retry mechanism on block acquiring for read.  If the number
> of retries attends to a certain limit (defined by
> dfs.client.max.block.acquire.failures), DFSClient will throw a
> BlockMissingException back to the user application.  In the current
> implementation, DFSClient counts the failures across multiple block
> acquiring operations but the block acquiring operations are supposed to be
> independent.  HDFS-127 fixes this problem by counting the failures within a
> single operation.
>
> I propose to commit HDFS-127 to 0.20 and above since this fix is safe and
> very useful.
>
> Nicholas Sze
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB