Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> change cache path


Copy link to this message
-
change cache path
Hi,

I want to change cache path because i don't have much space in my root /
fs. I want to change path for hadoop cache files to be create on external
drives. It is standalone hadoop cluster and it is running more than a year.
I want the changes so that it should not effect the running machine. I
don't want to format hdfs also. Below is the configuration. Can i give any
path and restart the services ?

<configuration>
  <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>
  <!-- Immediately exit safemode as soon as one DataNode checks in.
       On a multi-node cluster, these configurations must be removed.  -->
  <property>
    <name>dfs.safemode.extension</name>
    <value>0</value>
  </property>
  <property>
     <name>dfs.safemode.min.datanodes</name>
     <value>1</value>
  </property>
  <property>
     <name>hadoop.tmp.dir</name>
     <value>/var/lib/hadoop-hdfs/cache/${user.name}</value>
  </property>
  <property>
     <name>dfs.namenode.name.dir</name>
     <value>/var/lib/hadoop-hdfs/cache/${user.name}/dfs/name</value>
  </property>
  <property>
     <name>dfs.namenode.checkpoint.dir</name>
     <value>/var/lib/hadoop-hdfs/cache/${user.name
}/dfs/namesecondary</value>
  </property>
  <property>
     <name>dfs.datanode.data.dir</name>
<!--     <value>/var/lib/hadoop-hdfs/cache/${user.name}/dfs/data</value> -->
  <value>/mnt/san1/hdfs/${user.name}/dfs/data,/mnt/san2/hdfs/${user.name
}/dfs/data,/mnt/san3/hdfs/${user.name}/dfs/data,/mnt/san4/hdfs/${user.name
}/dfs/data</value>
  </property>
  <property>
      <name>dfs.permissions.supergroup</name>
      <value>hadmin</value>
  </property>
</configuration>

Thanks,