Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Hadoop hardware failure recovery


Copy link to this message
-
Re: Hadoop hardware failure recovery
Hello Harsh,

  Thanks a lot for keeping me updated.

@Aji : Apologies for misguiding you unintentionally.

Regards,
    Mohammad Tariq

On Sun, Aug 12, 2012 at 6:15 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> Aji,
>
> Your question seems to be about data (blocks) loss. Hadoop would
> recover by detecting the blocks you've lost from that disk failure
> (auto) and re-replicate their copies from the other available
> redundant copies in the cluster (Controlled via the configurable
> replication factor).
>
> On Sat, Aug 11, 2012 at 12:08 AM, Aji Janis <[EMAIL PROTECTED]> wrote:
> > I am very new to Hadoop. I am considering setting up a Hadoop cluster
> > consisting of 5 nodes where each node has 3 internal hard drives. I
> > understand HDFS has a configurable redundancy feature but what happens
> if an
> > entire drive crashes (physically) for whatever reason? How does Hadoop
> > recover, if it can, from this situation? What else should I know before
> > setting up my cluster this way? Thanks in advance.
> >
> >
>
>
>
> --
> Harsh J
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB