Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Hadoop configs


Copy link to this message
-
Hadoop configs
Visioner Sadak 2012-11-07, 08:17
I have configured a cluster setup of hadoop,shud i create a directory for
secondary namenode as well if i need one hw to mention tht in core-site.xml
,is tmp directory needed in coresite.xml or can i remove tht...

secondly what is rpc-address and http-address currently i am running hadoop
with rpc-address only is http-address mandatory.......

below are my cluster configs

core-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/tmp</value>
</property>
<property>
<name>fs.default.name</name>
<value>viewfs:///</value>
</property>
<property>
<name>fs.viewfs.mounttable.default.link./NN1Home</name>
<value>hdfs://132.148.0.10:9001/ns1home</value>
</property>
<property>
<name>fs.viewfs.mounttable.default.link./NN2Home</name>
<value>hdfs://132.148.0.11:9001/ns2home</value>
</property>
</configuration>

and

hdfs-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
 <property>
  <name>dfs.permissions</name>
        <value>false</value>
 </property>
 <property>
   <name>dfs.replication</name>
    <value>2</value>
 </property>
 <property>
      <name>dfs.namenode.name.dir</name>
      <value>/home/hadoop/nn</value>
 </property>
 <property>
          <name>dfs.datanode.data.dir</name>
          <value>/home/hadoop/dn</value>
 </property>

    <property>
        <name>dfs.webhdfs.enabled</name>
        <value>true</value>
    </property>

    <property>
        <name>dfs.federation.nameservices</name>
        <value>ns1,ns2</value>
    </property>
    <property>
        <name>dfs.namenode.rpc-address.ns1</name>
        <value>132.148.0.10:9001</value>
      </property>
    <property>
        <name>dfs.namenode.rpc-address.ns2</name>
        <value>132.148.0.11:9001</value>
      </property>

</configuration>
+
Visioner Sadak 2012-11-07, 09:45
+
Visioner Sadak 2012-11-07, 13:28
+
Visioner Sadak 2012-11-07, 14:44