Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Hadoop configs


+
Visioner Sadak 2012-11-07, 08:17
+
Visioner Sadak 2012-11-07, 09:45
+
Visioner Sadak 2012-11-07, 13:28
Copy link to this message
-
Re: Hadoop configs
got it the culprit was apaches website frm whr i copied the secnamenodeaddrs

http://hadoop.apache.org/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/Federation.html#Configuration

here secondary.http-address.ns1 shud be used instead of
secondaryhttp-address.ns1
<property>
    <name>dfs.namenode.secondaryhttp-address.ns1</name>
    <value>snn-host1:http-port</value>
  </property>

On Wed, Nov 7, 2012 at 1:47 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:

> I have configured a cluster setup of hadoop,shud i create a directory for
> secondary namenode as well if i need one hw to mention tht in core-site.xml
> ,is tmp directory needed in coresite.xml or can i remove tht...
>
> secondly what is rpc-address and http-address currently i am running
> hadoop with rpc-address only is http-address mandatory.......
>
> below are my cluster configs
>
> core-site.xml
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/home/hadoop/tmp</value>
> </property>
> <property>
> <name>fs.default.name</name>
> <value>viewfs:///</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN1Home</name>
> <value>hdfs://132.148.0.10:9001/ns1home</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN2Home</name>
> <value>hdfs://132.148.0.11:9001/ns2home</value>
> </property>
> </configuration>
>
> and
>
> hdfs-site.xml
>
>
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
>  <property>
>   <name>dfs.permissions</name>
>         <value>false</value>
>  </property>
>  <property>
>    <name>dfs.replication</name>
>     <value>2</value>
>  </property>
>  <property>
>       <name>dfs.namenode.name.dir</name>
>       <value>/home/hadoop/nn</value>
>  </property>
>  <property>
>           <name>dfs.datanode.data.dir</name>
>           <value>/home/hadoop/dn</value>
>  </property>
>
>     <property>
>         <name>dfs.webhdfs.enabled</name>
>         <value>true</value>
>     </property>
>
>     <property>
>         <name>dfs.federation.nameservices</name>
>         <value>ns1,ns2</value>
>     </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns1</name>
>         <value>132.148.0.10:9001</value>
>       </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns2</name>
>         <value>132.148.0.11:9001</value>
>       </property>
>
> </configuration>
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB