Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> HDFS + ZooKeeper


Copy link to this message
-
Re: HDFS + ZooKeeper
Right and AN is not using ZK for the actual NameNode
methods/functions, only for the failover election of the 'backup'
NameNode?

On Sun, Apr 24, 2011 at 4:06 AM, Ozcan ILIKHAN <[EMAIL PROTECTED]> wrote:
> I have read  Dhruba's blog entry about AvatarNode long ago. If I am not
> wrong initially it was not using ZooKeeper. That is way I raised that
> question. Also, AvatorNode is build on HDFS 0.20 but my intension is to
> utilize BackupNode that comes with HDFS 0.21
>
> Thanks,
> Ozcan.
>
> -----Original Message----- From: Jason Rutherglen
> Sent: Saturday, April 23, 2011 1:17 PM
> To: [EMAIL PROTECTED]
> Subject: Re: HDFS + ZooKeeper
>
> This is an interesting question.  AvatarNode doesn't use Zookeeper?
> Is there a drawback to implementing ZK for the NameNode other than the
> potential bugs from a newly engineered feature?
>
> Perhaps this issue is the main one for implementing the NameNode in
> ZK?  HDFS-1623
>
> On Fri, Apr 22, 2011 at 10:41 PM, Jean-Daniel Cryans
> <[EMAIL PROTECTED]> wrote:
>>
>> This is a 1M$ question. You could start thinking about this problem by
>> looking at what "AvatarNode" does:
>> https://issues.apache.org/jira/browse/HDFS-976
>>
>> J-D
>>
>> On Fri, Apr 22, 2011 at 10:17 PM, Ozcan ILIKHAN <[EMAIL PROTECTED]>
>> wrote:
>>>
>>> Hi,
>>> Does anyone have any idea about how we can use HDFS with ZooKeeper? More
>>> elaborately if NameNode fails DataNodes should be able to retrieve
>>> address
>>> of new NameNode from ZooKeeper.
>>>
>>> Thanks,
>>> ---------------------------------
>>> Ozcan ILIKHAN
>>> PhD Student, Graduate Research Assistant
>>> Department of Computer Sciences
>>> University of Wisconsin-Madison
>>> http://pages.cs.wisc.edu/~ilikhan
>>>
>>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB