Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> hdfs directory location


Copy link to this message
-
Re: hdfs directory location
Jignesh
 You are absolutely right. In hdfs directory doesn't exist physically. It is just meta data on name node. I don't think such a dir structure would be there in name node lfs as well as it just meta data and hence no physical dir structure is  created.

Regards
Bejoy K S

-----Original Message-----
From: Jignesh Patel <[EMAIL PROTECTED]>
Date: Mon, 10 Oct 2011 16:02:53
To: <[EMAIL PROTECTED]>
Cc: <[EMAIL PROTECTED]>
Subject: Re: hdfs directory location

Bejoy,

copyToLocal makes sense, it worked. But I am still wondering if HDFS has a directory created on local box, somewhere it exist physically but couldn't able to locate it.

Is HDFS directory structure is a virtual structure, doesn't exist physically?

-Jignesh
On Oct 10, 2011, at 3:53 PM, [EMAIL PROTECTED] wrote:

> Jignesh
>        Sorry I didn't get your query, 'how I can link it with HDFS
> directory structure?
> '
>
> You mean putting your unix dir contents into hdfs? If so use hadoop fs -copyFromLocal src destn    
> ------Original Message------
> From: Jignesh Patel
> To: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
> Subject: Re: hdfs directory location
> Sent: Oct 11, 2011 01:18
>
> Bejoy,
>
> If I create a directory in unix box then how I can link it with HDFS directory structure?
>
> -Jignesh
> On Oct 10, 2011, at 2:59 PM, [EMAIL PROTECTED] wrote:
>
>> Jignesh
>>      You are creating a dir in hdfs by that command. The dir won't be in your local file system but it hdfs. Issue a command like
>> hadoop fs -ls /user/hadoop-user/citation/
>> You can see the dir you created in hdfs
>>
>> If you want to create a die on local unix use a simple linux command
>> mkdir /user/hadoop-user/citation/input
>>
>>
>> ------Original Message------
>> From: Jignesh Patel
>> To: [EMAIL PROTECTED]
>> ReplyTo: [EMAIL PROTECTED]
>> Subject: hdfs directory location
>> Sent: Oct 10, 2011 23:45
>>
>> I am using following command to create a file in Unix(i.e. mac) system.
>>
>> bin/hadoop fs -mkdir /user/hadoop-user/citation/input
>>
>> While it creates the directory I need, I am struggling to figure out exact location of the folder in my local box.
>>
>>
>>
>>
>>
>> Regards
>> Bejoy K S
>
>
>
> Regards
> Bejoy K S