I have configured a cluster setup of hadoop,shud i create a directory for
secondary namenode as well if i need one hw to mention tht in core-site.xml
,is tmp directory needed in coresite.xml or can i remove tht...

secondly what is rpc-address and http-address currently i am running hadoop
with rpc-address only is http-address mandatory.......

below are my cluster configs

core-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/tmp</value>
</property>
<property>
<name>fs.default.name</name>
<value>viewfs:///</value>
</property>
<property>
<name>fs.viewfs.mounttable.default.link./NN1Home</name>
<value>hdfs://132.148.0.10:9001/ns1home</value>
</property>
<property>
<name>fs.viewfs.mounttable.default.link./NN2Home</name>
<value>hdfs://132.148.0.11:9001/ns2home</value>
</property>
</configuration>

and

hdfs-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
 <property>
  <name>dfs.permissions</name>
        <value>false</value>
 </property>
 <property>
   <name>dfs.replication</name>
    <value>2</value>
 </property>
 <property>
      <name>dfs.namenode.name.dir</name>
      <value>/home/hadoop/nn</value>
 </property>
 <property>
          <name>dfs.datanode.data.dir</name>
          <value>/home/hadoop/dn</value>
 </property>

    <property>
        <name>dfs.webhdfs.enabled</name>
        <value>true</value>
    </property>

    <property>
        <name>dfs.federation.nameservices</name>
        <value>ns1,ns2</value>
    </property>
    <property>
        <name>dfs.namenode.rpc-address.ns1</name>
        <value>132.148.0.10:9001</value>
      </property>
    <property>
        <name>dfs.namenode.rpc-address.ns2</name>
        <value>132.148.0.11:9001</value>
      </property>

</configuration>

also is checkpoint node and secondary name node the same

On Wed, Nov 7, 2012 at 1:47 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:

> I have configured a cluster setup of hadoop,shud i create a directory for
> secondary namenode as well if i need one hw to mention tht in core-site.xml
> ,is tmp directory needed in coresite.xml or can i remove tht...
>
> secondly what is rpc-address and http-address currently i am running
> hadoop with rpc-address only is http-address mandatory.......
>
> below are my cluster configs
>
> core-site.xml
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/home/hadoop/tmp</value>
> </property>
> <property>
> <name>fs.default.name</name>
> <value>viewfs:///</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN1Home</name>
> <value>hdfs://132.148.0.10:9001/ns1home</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN2Home</name>
> <value>hdfs://132.148.0.11:9001/ns2home</value>
> </property>
> </configuration>
>
> and
>
> hdfs-site.xml
>
>
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
>  <property>
>   <name>dfs.permissions</name>
>         <value>false</value>
>  </property>
>  <property>
>    <name>dfs.replication</name>
>     <value>2</value>
>  </property>
>  <property>
>       <name>dfs.namenode.name.dir</name>
>       <value>/home/hadoop/nn</value>
>  </property>
>  <property>
>           <name>dfs.datanode.data.dir</name>
>           <value>/home/hadoop/dn</value>
>  </property>
>
>     <property>
>         <name>dfs.webhdfs.enabled</name>
>         <value>true</value>
>     </property>
>
>     <property>
>         <name>dfs.federation.nameservices</name>
>         <value>ns1,ns2</value>
>     </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns1</name>
>         <value>132.148.0.10:9001</value>
>       </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns2</name>
>         <value>132.148.0.11:9001</value>
>       </property>
>
> </configuration>
>
>
>

I tried configuring secondary namenode but getting this error when i start
it

Exception in thread "main" java.lang.IllegalArgumentException: Target
address cannot be null. any hints..

On Wed, Nov 7, 2012 at 1:47 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:

> I have configured a cluster setup of hadoop,shud i create a directory for
> secondary namenode as well if i need one hw to mention tht in core-site.xml
> ,is tmp directory needed in coresite.xml or can i remove tht...
>
> secondly what is rpc-address and http-address currently i am running
> hadoop with rpc-address only is http-address mandatory.......
>
> below are my cluster configs
>
> core-site.xml
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/home/hadoop/tmp</value>
> </property>
> <property>
> <name>fs.default.name</name>
> <value>viewfs:///</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN1Home</name>
> <value>hdfs://132.148.0.10:9001/ns1home</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN2Home</name>
> <value>hdfs://132.148.0.11:9001/ns2home</value>
> </property>
> </configuration>
>
> and
>
> hdfs-site.xml
>
>
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
>  <property>
>   <name>dfs.permissions</name>
>         <value>false</value>
>  </property>
>  <property>
>    <name>dfs.replication</name>
>     <value>2</value>
>  </property>
>  <property>
>       <name>dfs.namenode.name.dir</name>
>       <value>/home/hadoop/nn</value>
>  </property>
>  <property>
>           <name>dfs.datanode.data.dir</name>
>           <value>/home/hadoop/dn</value>
>  </property>
>
>     <property>
>         <name>dfs.webhdfs.enabled</name>
>         <value>true</value>
>     </property>
>
>     <property>
>         <name>dfs.federation.nameservices</name>
>         <value>ns1,ns2</value>
>     </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns1</name>
>         <value>132.148.0.10:9001</value>
>       </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns2</name>
>         <value>132.148.0.11:9001</value>
>       </property>
>
> </configuration>
>
>
>

got it the culprit was apaches website frm whr i copied the secnamenodeaddrs

http://hadoop.apache.org/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/Federation.html#Configuration

here secondary.http-address.ns1 shud be used instead of
secondaryhttp-address.ns1
<property>
    <name>dfs.namenode.secondaryhttp-address.ns1</name>
    <value>snn-host1:http-port</value>
  </property>

On Wed, Nov 7, 2012 at 1:47 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:

> I have configured a cluster setup of hadoop,shud i create a directory for
> secondary namenode as well if i need one hw to mention tht in core-site.xml
> ,is tmp directory needed in coresite.xml or can i remove tht...
>
> secondly what is rpc-address and http-address currently i am running
> hadoop with rpc-address only is http-address mandatory.......
>
> below are my cluster configs
>
> core-site.xml
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/home/hadoop/tmp</value>
> </property>
> <property>
> <name>fs.default.name</name>
> <value>viewfs:///</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN1Home</name>
> <value>hdfs://132.148.0.10:9001/ns1home</value>
> </property>
> <property>
> <name>fs.viewfs.mounttable.default.link./NN2Home</name>
> <value>hdfs://132.148.0.11:9001/ns2home</value>
> </property>
> </configuration>
>
> and
>
> hdfs-site.xml
>
>
>
> <?xml version="1.0" encoding="UTF-8"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
>  <property>
>   <name>dfs.permissions</name>
>         <value>false</value>
>  </property>
>  <property>
>    <name>dfs.replication</name>
>     <value>2</value>
>  </property>
>  <property>
>       <name>dfs.namenode.name.dir</name>
>       <value>/home/hadoop/nn</value>
>  </property>
>  <property>
>           <name>dfs.datanode.data.dir</name>
>           <value>/home/hadoop/dn</value>
>  </property>
>
>     <property>
>         <name>dfs.webhdfs.enabled</name>
>         <value>true</value>
>     </property>
>
>     <property>
>         <name>dfs.federation.nameservices</name>
>         <value>ns1,ns2</value>
>     </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns1</name>
>         <value>132.148.0.10:9001</value>
>       </property>
>     <property>
>         <name>dfs.namenode.rpc-address.ns2</name>
>         <value>132.148.0.11:9001</value>
>       </property>
>
> </configuration>
>
>
>