Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> HDFS Backup nodes


Copy link to this message
-
Re: HDFS Backup nodes
Hey Rand,

It will mark that storage directory as failed and ignore it from then
on. In order to do this correctly, you need a couple of options
enabled on the NFS mount to make sure that it doesn't retry
infinitely. I usually run with the tcp,soft,intr,timeo=10,retrans=10
options set.

-Joey

On Wed, Dec 7, 2011 at 12:37 PM,  <[EMAIL PROTECTED]> wrote:
> What happens then if the nfs server fails or isn't reachable? Does hdfs lock up? Does it gracefully ignore the nfs copy?
>
> Thanks,
> randy
>
> ----- Original Message -----
> From: "Joey Echeverria" <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Sent: Wednesday, December 7, 2011 6:07:58 AM
> Subject: Re: HDFS Backup nodes
>
> You should also configure the Namenode to use an NFS mount for one of
> it's storage directories. That will give the most up-to-date back of
> the metadata in case of total node failure.
>
> -Joey
>
> On Wed, Dec 7, 2011 at 3:17 AM, praveenesh kumar <[EMAIL PROTECTED]> wrote:
>> This means still we are relying on Secondary NameNode idealogy for
>> Namenode's backup.
>> Can OS-mirroring of Namenode is a good alternative keep it alive all the
>> time ?
>>
>> Thanks,
>> Praveenesh
>>
>> On Wed, Dec 7, 2011 at 1:35 PM, Uma Maheswara Rao G <[EMAIL PROTECTED]>wrote:
>>
>>> AFAIK backup node introduced in 0.21 version onwards.
>>> ________________________________________
>>> From: praveenesh kumar [[EMAIL PROTECTED]]
>>> Sent: Wednesday, December 07, 2011 12:40 PM
>>> To: [EMAIL PROTECTED]
>>> Subject: HDFS Backup nodes
>>>
>>> Does hadoop 0.20.205 supports configuring HDFS backup nodes ?
>>>
>>> Thanks,
>>> Praveenesh
>>>
>
>
>
> --
> Joseph Echeverria
> Cloudera, Inc.
> 443.305.9434

--
Joseph Echeverria
Cloudera, Inc.
443.305.9434
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB