Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> adding space on existing datanode ?


Copy link to this message
-
Re: adding space on existing datanode ?
Hi Brice,

To add disk space to you datanode you simply need to add another drive,
then add it to the dfs.data.dir or dfs.datanode.data.dir entry. After a
datanode restart, hadoop will start to use it.

It will not balance the existing data between the directories. It will
continue to add to the 2. If one goes full, it will only continue with the
other one. If required, you can balance the data manually. Or depending on
your use case and the options you have, you can stop the datanode, delete
the content of the 2 data directories and restart it. It will stat to
receive data to duplicate and will share it evenly between the 2
directories. This last solution is not recommended. But for a test
environment it might be easier.

JM

2013/2/22 brice lecomte <[EMAIL PROTECTED]>

> Hello there,
> How to add disk space (ext3 partition, or nfs mount....) on an existing
> datanode ?
>
> Thanks,
> Brice
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB