Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Hadoop configs


I have configured a cluster setup of hadoop,shud i create a directory for
secondary namenode as well if i need one hw to mention tht in core-site.xml
,is tmp directory needed in coresite.xml or can i remove tht...

secondly what is rpc-address and http-address currently i am running hadoop
with rpc-address only is http-address mandatory.......

below are my cluster configs

core-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/tmp</value>
</property>
<property>
<name>fs.default.name</name>
<value>viewfs:///</value>
</property>
<property>
<name>fs.viewfs.mounttable.default.link./NN1Home</name>
<value>hdfs://132.148.0.10:9001/ns1home</value>
</property>
<property>
<name>fs.viewfs.mounttable.default.link./NN2Home</name>
<value>hdfs://132.148.0.11:9001/ns2home</value>
</property>
</configuration>

and

hdfs-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
 <property>
  <name>dfs.permissions</name>
        <value>false</value>
 </property>
 <property>
   <name>dfs.replication</name>
    <value>2</value>
 </property>
 <property>
      <name>dfs.namenode.name.dir</name>
      <value>/home/hadoop/nn</value>
 </property>
 <property>
          <name>dfs.datanode.data.dir</name>
          <value>/home/hadoop/dn</value>
 </property>

    <property>
        <name>dfs.webhdfs.enabled</name>
        <value>true</value>
    </property>

    <property>
        <name>dfs.federation.nameservices</name>
        <value>ns1,ns2</value>
    </property>
    <property>
        <name>dfs.namenode.rpc-address.ns1</name>
        <value>132.148.0.10:9001</value>
      </property>
    <property>
        <name>dfs.namenode.rpc-address.ns2</name>
        <value>132.148.0.11:9001</value>
      </property>

</configuration>
+
Visioner Sadak 2012-11-07, 09:45
+
Visioner Sadak 2012-11-07, 13:28
+
Visioner Sadak 2012-11-07, 14:44
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB