Marcos Ortiz 2012-03-21, 21:45
Daryn Sharp 2012-03-22, 20:02
-Re: Apache Hadoop works with IPv6?
Marcos Ortiz 2012-03-23, 20:01
Thanks a lot, Daryn.
Do you have any JIRA issue for this work?
It would be nice to work on this.
On 03/22/2012 03:02 PM, Daryn Sharp wrote:
> Hi Marcos,
> Hadoop won't work in a pure IPv6 environment. Hadoop might work in a IPv4/IPv6 environment since the default is to prefer IPv4 addresses. It also might work if they are publishing IPv4 addrs over IPv6.
> The main problem is that hadoop heavily relies on strings containing "ip:port". The string is naively parsed to split on the first colon which obviously isn't going to work on IPv6 addresses since they contain colons.
> Awhile back I updated some common apis with IPv6 support in mind -- the support isn't complete though. Bad news: there are quite a number of places throughout hadoop not using the apis. Good news: For other reasons, I'm currently fixing many of those places to use the apis. After that work is complete, enabling IPv6 support might be within relatively easy to moderate reach.
> On Mar 21, 2012, at 4:45 PM, Marcos Ortiz wrote:
>> I'm very interested to know if Apache Hadoop works with IPv6 hosts. One
>> of my clients
>> has some hosts with this feature and they want to know if Hadoop
>> supports this.
>> Anyone has tested this?
>> Best wishes
Marcos Luis Ortï¿½z Valmaseda (@marcosluis2186)
Data Engineer at UCI
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
Daryn Sharp 2012-03-26, 16:03