Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: Hadoop on IPv6


Copy link to this message
-
Re: Hadoop on IPv6
Harsh,

 We have the config params that you mentioned, but to be clear are you
saying that the suggestions Adam made won't work because of these
configurations ?

Thanks,
Aji
On Mon, Sep 9, 2013 at 4:55 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> For Hadoop JVMs, generally speaking, need to have the following in
> your hadoop-env.sh for HADOOP_OPTS:
>
> export HADOOP_OPTS="-Djava.net.preferIPv4Stack=true $HADOOP_OPTS"
>
> We also ship with this pre-added in the default configs of more recent
> releases.
>
> You may also need these on other JVM based daemons' opts, such as
> HBASE_OPTS/etc. depending on what all you run.
>
> On Tue, Sep 10, 2013 at 2:05 AM, Aji Janis <[EMAIL PROTECTED]> wrote:
> > Adam,
> > Thank you for the suggestion. Could you point me to any documentation
> that
> > can help with the configuration changes I need to make? Thanks.
> >
> > Aji
> >
> >
> > On Mon, Sep 9, 2013 at 1:30 PM, Adam Muise <[EMAIL PROTECTED]>
> wrote:
> >>
> >> Keep the Hadoop cluster and it's network backbone on IPv4. It should be
> >> isolated from the rest of your network for security and performance
> reasons
> >> already anyway.
> >>
> >> Enable IPv6 on your gateway nodes and let clients jump in for access via
> >> the ipv6 network and use the cluster via ipv4 on the gateway node. You
> could
> >> even setup a web proxy for some of the required sites using nginx or
> your
> >> favorite proxy server. Leave the ipv6 conversion of the Hadoop cluster
> until
> >> it is fully supported and well-tested.
> >>
> >>
> >> On Mon, Sep 9, 2013 at 1:19 PM, Aji Janis <[EMAIL PROTECTED]> wrote:
> >>>
> >>> We are moving to a IPv6 network. I know Hadoop installation says to
> >>> disable IPv6. Does anyone have any suggestions for work arround?
> Currently,
> >>> using Cloudera version 0.20.2-cdh3u5. Thanks in advance.
> >>
> >>
> >>
> >>
> >> --
> >>
> >>
> >> Adam Muise
> >> Solution Engineer
> >> Hortonworks
> >> [EMAIL PROTECTED]
> >> 416-417-4037
> >>
> >> Hortonworks - Develops, Distributes and Supports Enterprise Apache
> Hadoop.
> >>
> >> Hortonworks Virtual Sandbox
> >>
> >> Hadoop: Disruptive Possibilities by Jeff Needham
> >>
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or entity
> >> to which it is addressed and may contain information that is
> confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader of
> >> this message is not the intended recipient, you are hereby notified
> that any
> >> printing, copying, dissemination, distribution, disclosure or
> forwarding of
> >> this communication is strictly prohibited. If you have received this
> >> communication in error, please contact the sender immediately and
> delete it
> >> from your system. Thank You.
> >
> >
>
>
>
> --
> Harsh J
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB