Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> HDFS + ZooKeeper


+
Ozcan ILIKHAN 2011-04-23, 05:17
+
Jean-Daniel Cryans 2011-04-23, 05:41
+
Jason Rutherglen 2011-04-23, 18:17
+
Dhruba Borthakur 2011-04-23, 22:29
+
Mag Gam 2011-04-24, 01:14
+
Ozcan ILIKHAN 2011-04-24, 11:06
Copy link to this message
-
Re: HDFS + ZooKeeper
Right and AN is not using ZK for the actual NameNode
methods/functions, only for the failover election of the 'backup'
NameNode?

On Sun, Apr 24, 2011 at 4:06 AM, Ozcan ILIKHAN <[EMAIL PROTECTED]> wrote:
> I have read  Dhruba's blog entry about AvatarNode long ago. If I am not
> wrong initially it was not using ZooKeeper. That is way I raised that
> question. Also, AvatorNode is build on HDFS 0.20 but my intension is to
> utilize BackupNode that comes with HDFS 0.21
>
> Thanks,
> Ozcan.
>
> -----Original Message----- From: Jason Rutherglen
> Sent: Saturday, April 23, 2011 1:17 PM
> To: [EMAIL PROTECTED]
> Subject: Re: HDFS + ZooKeeper
>
> This is an interesting question.  AvatarNode doesn't use Zookeeper?
> Is there a drawback to implementing ZK for the NameNode other than the
> potential bugs from a newly engineered feature?
>
> Perhaps this issue is the main one for implementing the NameNode in
> ZK?  HDFS-1623
>
> On Fri, Apr 22, 2011 at 10:41 PM, Jean-Daniel Cryans
> <[EMAIL PROTECTED]> wrote:
>>
>> This is a 1M$ question. You could start thinking about this problem by
>> looking at what "AvatarNode" does:
>> https://issues.apache.org/jira/browse/HDFS-976
>>
>> J-D
>>
>> On Fri, Apr 22, 2011 at 10:17 PM, Ozcan ILIKHAN <[EMAIL PROTECTED]>
>> wrote:
>>>
>>> Hi,
>>> Does anyone have any idea about how we can use HDFS with ZooKeeper? More
>>> elaborately if NameNode fails DataNodes should be able to retrieve
>>> address
>>> of new NameNode from ZooKeeper.
>>>
>>> Thanks,
>>> ---------------------------------
>>> Ozcan ILIKHAN
>>> PhD Student, Graduate Research Assistant
>>> Department of Computer Sciences
>>> University of Wisconsin-Madison
>>> http://pages.cs.wisc.edu/~ilikhan
>>>
>>
>
>
+
Andrew Purtell 2011-04-24, 17:20
+
Mahadev Konar 2011-04-25, 02:12