Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> Apache Hadoop works with IPv6?


Copy link to this message
-
Re: Apache Hadoop works with IPv6?
Hi Marcos,

Hadoop won't work in a pure IPv6 environment.  Hadoop might work in a IPv4/IPv6 environment since the default is to prefer IPv4 addresses.  It also might work if they are publishing IPv4 addrs over IPv6.

The main problem is that hadoop heavily relies on strings containing "ip:port".  The string is naively parsed to split on the first colon which obviously isn't going to work on IPv6 addresses since they contain colons.

Awhile back I updated some common apis with IPv6 support in mind -- the support isn't complete though.  Bad news: there are quite a number of places throughout hadoop not using the apis.  Good news: For other reasons, I'm currently fixing many of those places to use the apis.  After that work is complete, enabling IPv6 support might be within relatively easy to moderate reach.

Daryn
On Mar 21, 2012, at 4:45 PM, Marcos Ortiz wrote:

> Regards.
> I'm very interested to know if Apache Hadoop works with IPv6 hosts. One
> of my clients
> has some hosts with this feature and they want to know if Hadoop
> supports this.
> Anyone has tested this?
>
> Best wishes
>
> --
> Marcos Luis Ortíz Valmaseda (@marcosluis2186)
>  Data Engineer at UCI
>  http://marcosluis2186.posterous.com
>
>
>
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci