Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> HDFS to a different location other than HADOOP HOME


+
Raj Hadoop 2013-06-11, 14:22
+
Mohammad Mustaqeem 2013-06-11, 14:28
+
Raj Hadoop 2013-06-11, 14:42
+
Mohammad Tariq 2013-06-11, 16:49
+
Shahab Yunus 2013-06-11, 17:33
Copy link to this message
-
Re: HDFS to a different location other than HADOOP HOME
Thank you Pramod and Shahab.

Warm Regards,
Tariq
cloudfront.blogspot.com
On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <[EMAIL PROTECTED]>wrote:

> http://hadoop.apache.org/docs/stable/hdfs-default.html
> dfs.data.dir ${hadoop.tmp.dir}/dfs/dataDetermines where on the local
> filesystem an DFS data node should store its blocks. If this is a
> comma-delimited list of directories, then data will be stored in all named
> directories, typically on different devices. Directories that do not exist
> are ignored.
>
>
> On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <[EMAIL PROTECTED]> wrote:
>
>> Hi Tariq,
>>
>> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
>> this value defined. So what is the default value?
>>
>> Thanks,
>> Raj
>>
>>   *From:* Mohammad Tariq <[EMAIL PROTECTED]>
>> *To:* "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>; Raj Hadoop <
>> [EMAIL PROTECTED]>
>> *Sent:* Tuesday, June 11, 2013 12:49 PM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  Hello Raj,
>>
>>     Although the way which Mustaqeem has told is correct, there is more
>> appropriate way to do this. Add the "dfs.data.dir" property in your
>> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
>> its value. The directory pointed by hadoop.tmp.dir also contains the
>> metadata and some other temporary files, so it's always better to have a
>> dedicated location to store the actual HDFS data.
>>
>>  Warm Regards,
>> Tariq
>> cloudfront.blogspot.com
>>
>>
>> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <[EMAIL PROTECTED]> wrote:
>>
>>
>> Thanks Mustaqeem.
>>
>> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
>> difference in files from the one we create under HADOOP_HOME.
>>
>>
>>
>>   *From:* Mohammad Mustaqeem <[EMAIL PROTECTED]>
>> *To:* user <[EMAIL PROTECTED]>; Raj Hadoop <[EMAIL PROTECTED]>
>> *Sent:* Tuesday, June 11, 2013 10:28 AM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
>> -
>> <property>
>> <name>hadoop.tmp.dir</name>
>> <value>/app/software/app1</value>
>> </property>
>> "/app/software/app1" will be used as location for storing the hdfs files.
>>
>>
>>
>> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <[EMAIL PROTECTED]> wrote:
>>
>>  Hi,
>>
>> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
>> directory
>>
>> /usr/home/hadoop
>>
>> I dont have much space on /usr and want to use other
>> accounts/applications storage which are located at /app/software/app1 etc.,
>>
>> How can I use the /app/software/app1 location for my HDFS files and
>> storage. Is it possible? Please advise.
>>
>> Thanks,
>> Raj
>>
>>
>>
>>
>> --
>> *With regards ---*
>> *Mohammad Mustaqeem*,
>> M.Tech (CSE)
>> MNNIT Allahabad
>> 9026604270
>>
>>
>>
>>
>>
>>
>>
>>
>
+
Sandeep L 2013-06-12, 05:48
+
Sandeep L 2013-06-12, 05:55
+
Pramod N 2013-06-11, 17:19
+
Raj Hadoop 2013-06-14, 17:57