Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> hdfs directory location


Copy link to this message
-
Re: hdfs directory location
Jignesh
 You are absolutely right. In hdfs directory doesn't exist physically. It is just meta data on name node. I don't think such a dir structure would be there in name node lfs as well as it just meta data and hence no physical dir structure is  created.

Regards
Bejoy K S

-----Original Message-----
From: Jignesh Patel <[EMAIL PROTECTED]>
Date: Mon, 10 Oct 2011 16:02:53
To: <[EMAIL PROTECTED]>
Cc: <[EMAIL PROTECTED]>
Subject: Re: hdfs directory location

Bejoy,

copyToLocal makes sense, it worked. But I am still wondering if HDFS has a directory created on local box, somewhere it exist physically but couldn't able to locate it.

Is HDFS directory structure is a virtual structure, doesn't exist physically?

-Jignesh
On Oct 10, 2011, at 3:53 PM, [EMAIL PROTECTED] wrote:

> Jignesh
>        Sorry I didn't get your query, 'how I can link it with HDFS
> directory structure?
> '
>
> You mean putting your unix dir contents into hdfs? If so use hadoop fs -copyFromLocal src destn    
> ------Original Message------
> From: Jignesh Patel
> To: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
> Subject: Re: hdfs directory location
> Sent: Oct 11, 2011 01:18
>
> Bejoy,
>
> If I create a directory in unix box then how I can link it with HDFS directory structure?
>
> -Jignesh
> On Oct 10, 2011, at 2:59 PM, [EMAIL PROTECTED] wrote:
>
>> Jignesh
>>      You are creating a dir in hdfs by that command. The dir won't be in your local file system but it hdfs. Issue a command like
>> hadoop fs -ls /user/hadoop-user/citation/
>> You can see the dir you created in hdfs
>>
>> If you want to create a die on local unix use a simple linux command
>> mkdir /user/hadoop-user/citation/input
>>
>>
>> ------Original Message------
>> From: Jignesh Patel
>> To: [EMAIL PROTECTED]
>> ReplyTo: [EMAIL PROTECTED]
>> Subject: hdfs directory location
>> Sent: Oct 10, 2011 23:45
>>
>> I am using following command to create a file in Unix(i.e. mac) system.
>>
>> bin/hadoop fs -mkdir /user/hadoop-user/citation/input
>>
>> While it creates the directory I need, I am struggling to figure out exact location of the folder in my local box.
>>
>>
>>
>>
>>
>> Regards
>> Bejoy K S
>
>
>
> Regards
> Bejoy K S

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB