Marcos Ortiz 2012-03-21, 21:45
-Re: Apache Hadoop works with IPv6?
Daryn Sharp 2012-03-22, 20:02
Hadoop won't work in a pure IPv6 environment. Hadoop might work in a IPv4/IPv6 environment since the default is to prefer IPv4 addresses. It also might work if they are publishing IPv4 addrs over IPv6.
The main problem is that hadoop heavily relies on strings containing "ip:port". The string is naively parsed to split on the first colon which obviously isn't going to work on IPv6 addresses since they contain colons.
Awhile back I updated some common apis with IPv6 support in mind -- the support isn't complete though. Bad news: there are quite a number of places throughout hadoop not using the apis. Good news: For other reasons, I'm currently fixing many of those places to use the apis. After that work is complete, enabling IPv6 support might be within relatively easy to moderate reach.
On Mar 21, 2012, at 4:45 PM, Marcos Ortiz wrote:
> I'm very interested to know if Apache Hadoop works with IPv6 hosts. One
> of my clients
> has some hosts with this feature and they want to know if Hadoop
> supports this.
> Anyone has tested this?
> Best wishes
> Marcos Luis Ortíz Valmaseda (@marcosluis2186)
> Data Engineer at UCI
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
Marcos Ortiz 2012-03-23, 20:01
Daryn Sharp 2012-03-26, 16:03