Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Hadoop hardware failure recovery


+
Aji Janis 2012-08-10, 18:38
+
Ted Dunning 2012-08-10, 18:55
+
anil gupta 2012-08-10, 19:12
+
Mohammad Tariq 2012-08-10, 19:16
+
Harsh J 2012-08-12, 12:43
+
Arun C Murthy 2012-08-12, 19:07
+
Aji Janis 2012-08-13, 13:57
+
Harsh J 2012-08-13, 14:55
+
Mohammad Tariq 2012-08-10, 18:43
+
Harsh J 2012-08-12, 12:45
Copy link to this message
-
Re: Hadoop hardware failure recovery
Hello Harsh,

  Thanks a lot for keeping me updated.

@Aji : Apologies for misguiding you unintentionally.

Regards,
    Mohammad Tariq

On Sun, Aug 12, 2012 at 6:15 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> Aji,
>
> Your question seems to be about data (blocks) loss. Hadoop would
> recover by detecting the blocks you've lost from that disk failure
> (auto) and re-replicate their copies from the other available
> redundant copies in the cluster (Controlled via the configurable
> replication factor).
>
> On Sat, Aug 11, 2012 at 12:08 AM, Aji Janis <[EMAIL PROTECTED]> wrote:
> > I am very new to Hadoop. I am considering setting up a Hadoop cluster
> > consisting of 5 nodes where each node has 3 internal hard drives. I
> > understand HDFS has a configurable redundancy feature but what happens
> if an
> > entire drive crashes (physically) for whatever reason? How does Hadoop
> > recover, if it can, from this situation? What else should I know before
> > setting up my cluster this way? Thanks in advance.
> >
> >
>
>
>
> --
> Harsh J
>
+
Harsh J 2012-08-13, 15:42
+
Steve Loughran 2012-08-13, 16:10
+
Jeffrey Buell 2012-08-14, 00:15