I am using following command to create a file in Unix(i.e. mac) system.

bin/hadoop fs -mkdir /user/hadoop-user/citation/input

While it creates the directory I need, I am struggling to figure out exact location of the folder in my local box.

Jignesh
       You are creating a dir in hdfs by that command. The dir won't be in your local file system but it hdfs. Issue a command like
hadoop fs -ls /user/hadoop-user/citation/
You can see the dir you created in hdfs

If you want to create a die on local unix use a simple linux command
mkdir /user/hadoop-user/citation/input
------Original Message------
From: Jignesh Patel
To: [EMAIL PROTECTED]
ReplyTo: [EMAIL PROTECTED]
Subject: hdfs directory location
Sent: Oct 10, 2011 23:45

I am using following command to create a file in Unix(i.e. mac) system.

bin/hadoop fs -mkdir /user/hadoop-user/citation/input

While it creates the directory I need, I am struggling to figure out exact location of the folder in my local box.

Regards
Bejoy K S

Bejoy,

If I create a directory in unix box then how I can link it with HDFS directory structure?

-Jignesh
On Oct 10, 2011, at 2:59 PM, [EMAIL PROTECTED] wrote:

> Jignesh
>       You are creating a dir in hdfs by that command. The dir won't be in your local file system but it hdfs. Issue a command like
> hadoop fs -ls /user/hadoop-user/citation/
> You can see the dir you created in hdfs
>
> If you want to create a die on local unix use a simple linux command
> mkdir /user/hadoop-user/citation/input
>
>
> ------Original Message------
> From: Jignesh Patel
> To: [EMAIL PROTECTED]
> ReplyTo: [EMAIL PROTECTED]
> Subject: hdfs directory location
> Sent: Oct 10, 2011 23:45
>
> I am using following command to create a file in Unix(i.e. mac) system.
>
> bin/hadoop fs -mkdir /user/hadoop-user/citation/input
>
> While it creates the directory I need, I am struggling to figure out exact location of the folder in my local box.
>
>
>
>
>
> Regards
> Bejoy K S

Jignesh
        Sorry I didn't get your query, 'how I can link it with HDFS
directory structure?
'

You mean putting your unix dir contents into hdfs? If so use hadoop fs -copyFromLocal src destn    
------Original Message------
From: Jignesh Patel
To: [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
Subject: Re: hdfs directory location
Sent: Oct 11, 2011 01:18

Bejoy,

If I create a directory in unix box then how I can link it with HDFS directory structure?

-Jignesh
On Oct 10, 2011, at 2:59 PM, [EMAIL PROTECTED] wrote:

> Jignesh
>       You are creating a dir in hdfs by that command. The dir won't be in your local file system but it hdfs. Issue a command like
> hadoop fs -ls /user/hadoop-user/citation/
> You can see the dir you created in hdfs
>
> If you want to create a die on local unix use a simple linux command
> mkdir /user/hadoop-user/citation/input
>
>
> ------Original Message------
> From: Jignesh Patel
> To: [EMAIL PROTECTED]
> ReplyTo: [EMAIL PROTECTED]
> Subject: hdfs directory location
> Sent: Oct 10, 2011 23:45
>
> I am using following command to create a file in Unix(i.e. mac) system.
>
> bin/hadoop fs -mkdir /user/hadoop-user/citation/input
>
> While it creates the directory I need, I am struggling to figure out exact location of the folder in my local box.
>
>
>
>
>
> Regards
> Bejoy K S

Regards
Bejoy K S

Bejoy,

copyToLocal makes sense, it worked. But I am still wondering if HDFS has a directory created on local box, somewhere it exist physically but couldn't able to locate it.

Is HDFS directory structure is a virtual structure, doesn't exist physically?

-Jignesh
On Oct 10, 2011, at 3:53 PM, [EMAIL PROTECTED] wrote:

> Jignesh
>        Sorry I didn't get your query, 'how I can link it with HDFS
> directory structure?
> '
>
> You mean putting your unix dir contents into hdfs? If so use hadoop fs -copyFromLocal src destn    
> ------Original Message------
> From: Jignesh Patel
> To: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
> Subject: Re: hdfs directory location
> Sent: Oct 11, 2011 01:18
>
> Bejoy,
>
> If I create a directory in unix box then how I can link it with HDFS directory structure?
>
> -Jignesh
> On Oct 10, 2011, at 2:59 PM, [EMAIL PROTECTED] wrote:
>
>> Jignesh
>>      You are creating a dir in hdfs by that command. The dir won't be in your local file system but it hdfs. Issue a command like
>> hadoop fs -ls /user/hadoop-user/citation/
>> You can see the dir you created in hdfs
>>
>> If you want to create a die on local unix use a simple linux command
>> mkdir /user/hadoop-user/citation/input
>>
>>
>> ------Original Message------
>> From: Jignesh Patel
>> To: [EMAIL PROTECTED]
>> ReplyTo: [EMAIL PROTECTED]
>> Subject: hdfs directory location
>> Sent: Oct 10, 2011 23:45
>>
>> I am using following command to create a file in Unix(i.e. mac) system.
>>
>> bin/hadoop fs -mkdir /user/hadoop-user/citation/input
>>
>> While it creates the directory I need, I am struggling to figure out exact location of the folder in my local box.
>>
>>
>>
>>
>>
>> Regards
>> Bejoy K S
>
>
>
> Regards
> Bejoy K S

Jignesh
 You are absolutely right. In hdfs directory doesn't exist physically. It is just meta data on name node. I don't think such a dir structure would be there in name node lfs as well as it just meta data and hence no physical dir structure is  created.

Regards
Bejoy K S

-----Original Message-----
From: Jignesh Patel <[EMAIL PROTECTED]>
Date: Mon, 10 Oct 2011 16:02:53
To: <[EMAIL PROTECTED]>
Cc: <[EMAIL PROTECTED]>
Subject: Re: hdfs directory location

Bejoy,

copyToLocal makes sense, it worked. But I am still wondering if HDFS has a directory created on local box, somewhere it exist physically but couldn't able to locate it.

Is HDFS directory structure is a virtual structure, doesn't exist physically?

-Jignesh
On Oct 10, 2011, at 3:53 PM, [EMAIL PROTECTED] wrote:

> Jignesh
>        Sorry I didn't get your query, 'how I can link it with HDFS
> directory structure?
> '
>
> You mean putting your unix dir contents into hdfs? If so use hadoop fs -copyFromLocal src destn    
> ------Original Message------
> From: Jignesh Patel
> To: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
> Subject: Re: hdfs directory location
> Sent: Oct 11, 2011 01:18
>
> Bejoy,
>
> If I create a directory in unix box then how I can link it with HDFS directory structure?
>
> -Jignesh
> On Oct 10, 2011, at 2:59 PM, [EMAIL PROTECTED] wrote:
>
>> Jignesh
>>      You are creating a dir in hdfs by that command. The dir won't be in your local file system but it hdfs. Issue a command like
>> hadoop fs -ls /user/hadoop-user/citation/
>> You can see the dir you created in hdfs
>>
>> If you want to create a die on local unix use a simple linux command
>> mkdir /user/hadoop-user/citation/input
>>
>>
>> ------Original Message------
>> From: Jignesh Patel
>> To: [EMAIL PROTECTED]
>> ReplyTo: [EMAIL PROTECTED]
>> Subject: hdfs directory location
>> Sent: Oct 10, 2011 23:45
>>
>> I am using following command to create a file in Unix(i.e. mac) system.
>>
>> bin/hadoop fs -mkdir /user/hadoop-user/citation/input
>>
>> While it creates the directory I need, I am struggling to figure out exact location of the folder in my local box.
>>
>>
>>
>>
>>
>> Regards
>> Bejoy K S
>
>
>
> Regards
> Bejoy K S

Hi,

I guess what you are wanting is to "see" your HDFS directory through normal
File System commands like ls etc or by browsing your directory structure.

This is not possible as none of your commands or Finder (in Mac) have
ability to read / write HDFS. So they don't have the capability to show HDFS
directories.

Hence, the HDFS directory structure must be viewed using the HDFS tools and
not the Operating System FS commands.

Hope this helps!

Warm regards
Arko

On Mon, Oct 10, 2011 at 3:08 PM, <[EMAIL PROTECTED]> wrote:

> Jignesh
>  You are absolutely right. In hdfs directory doesn't exist physically. It
> is just meta data on name node. I don't think such a dir structure would be
> there in name node lfs as well as it just meta data and hence no physical
> dir structure is  created.
>
> Regards
> Bejoy K S
>
> -----Original Message-----
> From: Jignesh Patel <[EMAIL PROTECTED]>
> Date: Mon, 10 Oct 2011 16:02:53
> To: <[EMAIL PROTECTED]>
> Cc: <[EMAIL PROTECTED]>
> Subject: Re: hdfs directory location
>
> Bejoy,
>
> copyToLocal makes sense, it worked. But I am still wondering if HDFS has a
> directory created on local box, somewhere it exist physically but couldn't
> able to locate it.
>
> Is HDFS directory structure is a virtual structure, doesn't exist
> physically?
>
> -Jignesh
> On Oct 10, 2011, at 3:53 PM, [EMAIL PROTECTED] wrote:
>
> > Jignesh
> >        Sorry I didn't get your query, 'how I can link it with HDFS
> > directory structure?
> > '
> >
> > You mean putting your unix dir contents into hdfs? If so use hadoop fs
> -copyFromLocal src destn
> > ------Original Message------
> > From: Jignesh Patel
> > To: [EMAIL PROTECTED]
> > To: [EMAIL PROTECTED]
> > Subject: Re: hdfs directory location
> > Sent: Oct 11, 2011 01:18
> >
> > Bejoy,
> >
> > If I create a directory in unix box then how I can link it with HDFS
> directory structure?
> >
> > -Jignesh
> > On Oct 10, 2011, at 2:59 PM, [EMAIL PROTECTED] wrote:
> >
> >> Jignesh
> >>      You are creating a dir in hdfs by that command. The dir won't be in
> your local file system but it hdfs. Issue a command like
> >> hadoop fs -ls /user/hadoop-user/citation/
> >> You can see the dir you created in hdfs
> >>
> >> If you want to create a die on local unix use a simple linux command
> >> mkdir /user/hadoop-user/citation/input
> >>
> >>
> >> ------Original Message------
> >> From: Jignesh Patel
> >> To: [EMAIL PROTECTED]
> >> ReplyTo: [EMAIL PROTECTED]
> >> Subject: hdfs directory location
> >> Sent: Oct 10, 2011 23:45
> >>
> >> I am using following command to create a file in Unix(i.e. mac) system.
> >>
> >> bin/hadoop fs -mkdir /user/hadoop-user/citation/input
> >>
> >> While it creates the directory I need, I am struggling to figure out
> exact location of the folder in my local box.
> >>
> >>
> >>
> >>
> >>
> >> Regards
> >> Bejoy K S
> >
> >
> >
> > Regards
> > Bejoy K S
>
>

Jignesh,

Can be done. Use the fuse-dfs feature of HDFS to have your DFS as a
'physical' mount point on Linux. Instructions may be found here:
http://wiki.apache.org/hadoop/MountableHDFS and on other resources
across the web (search around for fuse hdfs).

On Tue, Oct 11, 2011 at 1:32 AM, Jignesh Patel <[EMAIL PROTECTED]> wrote:
> Bejoy,
>
> copyToLocal makes sense, it worked. But I am still wondering if HDFS has a directory created on local box, somewhere it exist physically but couldn't able to locate it.
>
> Is HDFS directory structure is a virtual structure, doesn't exist physically?
>
> -Jignesh
> On Oct 10, 2011, at 3:53 PM, [EMAIL PROTECTED] wrote:
>
>> Jignesh
>>        Sorry I didn't get your query, 'how I can link it with HDFS
>> directory structure?
>> '
>>
>> You mean putting your unix dir contents into hdfs? If so use hadoop fs -copyFromLocal src destn
>> ------Original Message------
>> From: Jignesh Patel
>> To: [EMAIL PROTECTED]
>> To: [EMAIL PROTECTED]
>> Subject: Re: hdfs directory location
>> Sent: Oct 11, 2011 01:18
>>
>> Bejoy,
>>
>> If I create a directory in unix box then how I can link it with HDFS directory structure?
>>
>> -Jignesh
>> On Oct 10, 2011, at 2:59 PM, [EMAIL PROTECTED] wrote:
>>
>>> Jignesh
>>>      You are creating a dir in hdfs by that command. The dir won't be in your local file system but it hdfs. Issue a command like
>>> hadoop fs -ls /user/hadoop-user/citation/
>>> You can see the dir you created in hdfs
>>>
>>> If you want to create a die on local unix use a simple linux command
>>> mkdir /user/hadoop-user/citation/input
>>>
>>>
>>> ------Original Message------
>>> From: Jignesh Patel
>>> To: [EMAIL PROTECTED]
>>> ReplyTo: [EMAIL PROTECTED]
>>> Subject: hdfs directory location
>>> Sent: Oct 10, 2011 23:45
>>>
>>> I am using following command to create a file in Unix(i.e. mac) system.
>>>
>>> bin/hadoop fs -mkdir /user/hadoop-user/citation/input
>>>
>>> While it creates the directory I need, I am struggling to figure out exact location of the folder in my local box.
>>>
>>>
>>>
>>>
>>>
>>> Regards
>>> Bejoy K S
>>
>>
>>
>> Regards
>> Bejoy K S
>
>

--
Harsh J