Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Re: Hadoop on IPv6


Copy link to this message
-
Re: Hadoop on IPv6
Aji Janis 2013-09-10, 16:12
Harsh,

 We have the config params that you mentioned, but to be clear are you
saying that the suggestions Adam made won't work because of these
configurations ?

Thanks,
Aji
On Mon, Sep 9, 2013 at 4:55 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> For Hadoop JVMs, generally speaking, need to have the following in
> your hadoop-env.sh for HADOOP_OPTS:
>
> export HADOOP_OPTS="-Djava.net.preferIPv4Stack=true $HADOOP_OPTS"
>
> We also ship with this pre-added in the default configs of more recent
> releases.
>
> You may also need these on other JVM based daemons' opts, such as
> HBASE_OPTS/etc. depending on what all you run.
>
> On Tue, Sep 10, 2013 at 2:05 AM, Aji Janis <[EMAIL PROTECTED]> wrote:
> > Adam,
> > Thank you for the suggestion. Could you point me to any documentation
> that
> > can help with the configuration changes I need to make? Thanks.
> >
> > Aji
> >
> >
> > On Mon, Sep 9, 2013 at 1:30 PM, Adam Muise <[EMAIL PROTECTED]>
> wrote:
> >>
> >> Keep the Hadoop cluster and it's network backbone on IPv4. It should be
> >> isolated from the rest of your network for security and performance
> reasons
> >> already anyway.
> >>
> >> Enable IPv6 on your gateway nodes and let clients jump in for access via
> >> the ipv6 network and use the cluster via ipv4 on the gateway node. You
> could
> >> even setup a web proxy for some of the required sites using nginx or
> your
> >> favorite proxy server. Leave the ipv6 conversion of the Hadoop cluster
> until
> >> it is fully supported and well-tested.
> >>
> >>
> >> On Mon, Sep 9, 2013 at 1:19 PM, Aji Janis <[EMAIL PROTECTED]> wrote:
> >>>
> >>> We are moving to a IPv6 network. I know Hadoop installation says to
> >>> disable IPv6. Does anyone have any suggestions for work arround?
> Currently,
> >>> using Cloudera version 0.20.2-cdh3u5. Thanks in advance.
> >>
> >>
> >>
> >>
> >> --
> >>
> >>
> >> Adam Muise
> >> Solution Engineer
> >> Hortonworks
> >> [EMAIL PROTECTED]
> >> 416-417-4037
> >>
> >> Hortonworks - Develops, Distributes and Supports Enterprise Apache
> Hadoop.
> >>
> >> Hortonworks Virtual Sandbox
> >>
> >> Hadoop: Disruptive Possibilities by Jeff Needham
> >>
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or entity
> >> to which it is addressed and may contain information that is
> confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader of
> >> this message is not the intended recipient, you are hereby notified
> that any
> >> printing, copying, dissemination, distribution, disclosure or
> forwarding of
> >> this communication is strictly prohibited. If you have received this
> >> communication in error, please contact the sender immediately and
> delete it
> >> from your system. Thank You.
> >
> >
>
>
>
> --
> Harsh J
>