Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> HDFS + ZooKeeper


Copy link to this message
-
Re: HDFS + ZooKeeper
Will the avatar node be part of 0.22?
On Sat, Apr 23, 2011 at 6:29 PM, Dhruba Borthakur <[EMAIL PROTECTED]> wrote:
> The AvatarNode does use zookeeper (but since this is not directly related to
> Apache HDFS code, if u have more questions, please send it to me directly).
> The latest AvatarNode code is in
> https://github.com/facebook/hadoop-20-append/tree/master/src/contrib/highavailability/src/java/org/apache/hadoop/hdfs
> thanks,
> dhruba
>
> On Sat, Apr 23, 2011 at 11:17 AM, Jason Rutherglen
> <[EMAIL PROTECTED]> wrote:
>>
>> This is an interesting question.  AvatarNode doesn't use Zookeeper?
>> Is there a drawback to implementing ZK for the NameNode other than the
>> potential bugs from a newly engineered feature?
>>
>> Perhaps this issue is the main one for implementing the NameNode in
>> ZK?  HDFS-1623
>>
>> On Fri, Apr 22, 2011 at 10:41 PM, Jean-Daniel Cryans
>> <[EMAIL PROTECTED]> wrote:
>> > This is a 1M$ question. You could start thinking about this problem by
>> > looking at what "AvatarNode" does:
>> > https://issues.apache.org/jira/browse/HDFS-976
>> >
>> > J-D
>> >
>> > On Fri, Apr 22, 2011 at 10:17 PM, Ozcan ILIKHAN <[EMAIL PROTECTED]>
>> > wrote:
>> >> Hi,
>> >> Does anyone have any idea about how we can use HDFS with ZooKeeper?
>> >> More
>> >> elaborately if NameNode fails DataNodes should be able to retrieve
>> >> address
>> >> of new NameNode from ZooKeeper.
>> >>
>> >> Thanks,
>> >> ---------------------------------
>> >> Ozcan ILIKHAN
>> >> PhD Student, Graduate Research Assistant
>> >> Department of Computer Sciences
>> >> University of Wisconsin-Madison
>> >> http://pages.cs.wisc.edu/~ilikhan
>> >>
>> >
>
>
>
> --
> Connect to me at http://www.facebook.com/dhruba
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB