Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> What if one of the directory(dfs.name.dir) rw error ?


Copy link to this message
-
Re: What if one of the directory(dfs.name.dir) rw error ?
On Wed, May 25, 2011 at 10:48PM, Thanh Do wrote:
>    You can simulate disk failure by some fault injection techniques.
>    Applying AspectJ is one of them.

Fault injection is there, so you can just check src/test/aop and
src/test/system for references, etc.

>
>    On Wed, May 25, 2011 at 3:07 AM, ccxixicc <[EMAIL PROTECTED]> wrote:
>
>      I'm using 0.20.2.A
>      I had some test. I dont know how to simulate a disk failure, just chmod
>      000 dir1, the namenode shutdown immediately. And NN will hang if the nfs
>      server down.
>      A
>      A
>      ------------------A OriginalA ------------------
>      From: A "Harsh J"<[EMAIL PROTECTED]>;
>      Date: A Wed, May 25, 2011 03:49 PM
>      To: A "hdfs-user"<[EMAIL PROTECTED]>;
>      Subject: A Re: What if one of the directory(dfs.name.dir) rw error ?
>      A
>      Yes. But depending on the version you're using, you may have to
>      manually restart the NN after fixing the mount points, to get the
>      directories in action again.
>
>      2011/5/25 ccxixicc <[EMAIL PROTECTED]>:
>      >
>      > Hi,all
>      > I set dfs.name.dir to a comma-delimited list of directories, dir1 is
>      in
>      > /dev/sdb1 dir2 is in /dev/sdb2 and dir3 is nfs derectory.
>      > What happens if /dev/sdb1 disk error, so dir1 cannot be read and
>      write?
>      > What happens if nfs server down, so dir3 cannot be read and write?
>      > Will hadoop ignore the bad directory and use the good directory and
>      continue
>      > server?
>      > Thanks.
>      >
>
>      --
>      Harsh J
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB