Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Hadoop configs


Copy link to this message
-
Re: Hadoop configs
Visioner Sadak 2012-11-07, 14:44
got it the culprit was apaches website frm whr i copied the secnamenodeaddrs

http://hadoop.apache.org/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/Federation.html#Configuration

here secondary.http-address.ns1 shud be used instead of
secondaryhttp-address.ns1
<property>
    <name>dfs.namenode.secondaryhttp-address.ns1</name>
    <value>snn-host1:http-port</value>
  </property>

On Wed, Nov 7, 2012 at 1:47 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:

> I have configured a cluster setup of hadoop,shud i create a directory for
> secondary namenode as well if i need one hw to mention tht in core-site.xml
> ,is tmp directory needed in coresite.xml or can i remove tht...
>
> secondly what is rpc-address and http-address currently i am running
> hadoop with rpc-address only is http-address mandatory.......
>
> below are my cluster configs
>
> core-site.xml
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/home/hadoop/tmp</value>
> </property>
> <property>
> <name>fs.default.name</name>
> <value>viewfs:///</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN1Home</name>
> <value>hdfs://132.148.0.10:9001/ns1home</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN2Home</name>
> <value>hdfs://132.148.0.11:9001/ns2home</value>
> </property>
> </configuration>
>
> and
>
> hdfs-site.xml
>
>
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
>  <property>
>   <name>dfs.permissions</name>
>         <value>false</value>
>  </property>
>  <property>
>    <name>dfs.replication</name>
>     <value>2</value>
>  </property>
>  <property>
>       <name>dfs.namenode.name.dir</name>
>       <value>/home/hadoop/nn</value>
>  </property>
>  <property>
>           <name>dfs.datanode.data.dir</name>
>           <value>/home/hadoop/dn</value>
>  </property>
>
>     <property>
>         <name>dfs.webhdfs.enabled</name>
>         <value>true</value>
>     </property>
>
>     <property>
>         <name>dfs.federation.nameservices</name>
>         <value>ns1,ns2</value>
>     </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns1</name>
>         <value>132.148.0.10:9001</value>
>       </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns2</name>
>         <value>132.148.0.11:9001</value>
>       </property>
>
> </configuration>
>
>
>