Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Hadoop hardware failure recovery


Copy link to this message
-
Re: Hadoop hardware failure recovery
Mohammad Tariq 2012-08-12, 17:47
Hello Harsh,

  Thanks a lot for keeping me updated.

@Aji : Apologies for misguiding you unintentionally.

Regards,
    Mohammad Tariq

On Sun, Aug 12, 2012 at 6:15 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> Aji,
>
> Your question seems to be about data (blocks) loss. Hadoop would
> recover by detecting the blocks you've lost from that disk failure
> (auto) and re-replicate their copies from the other available
> redundant copies in the cluster (Controlled via the configurable
> replication factor).
>
> On Sat, Aug 11, 2012 at 12:08 AM, Aji Janis <[EMAIL PROTECTED]> wrote:
> > I am very new to Hadoop. I am considering setting up a Hadoop cluster
> > consisting of 5 nodes where each node has 3 internal hard drives. I
> > understand HDFS has a configurable redundancy feature but what happens
> if an
> > entire drive crashes (physically) for whatever reason? How does Hadoop
> > recover, if it can, from this situation? What else should I know before
> > setting up my cluster this way? Thanks in advance.
> >
> >
>
>
>
> --
> Harsh J
>