Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: HDFS Installation / Configuration


Copy link to this message
-
Re: HDFS Installation / Configuration
No prob.

Regards,
    Mohammad Tariq
On Tue, Jul 17, 2012 at 6:55 PM, Yuvrajsinh Chauhan
<[EMAIL PROTECTED]> wrote:
> Dear Tariq / Bijoy,
>
> Please Ignore my previous mail. I can now see the directories using
> following commands:
>
> [hadoop@rac1 bin]$ ./hadoop fs -ls /
> Found 5 items
> drwxr-xr-x   - hadoop hadoop              0 2012-07-16 14:23 /test
> drwxr-xr-x   - hadoop hadoop              0 2012-07-17 13:29 /test1
> drwxr-xr-x   - hadoop supergroup          0 2012-07-17 18:03 /user
> drwxr-xr-x   - hadoop supergroup          0 2012-07-17 14:11 /usr
> drwxr-xr-x   - hadoop supergroup          0 2012-07-17 17:41 /yuvi
>
> I can see this data from both the nodes.
>
> Now, I am exploring more using by reading help.
>
> Regards,
>
> Yuvrajsinh Chauhan || Sr. DBA || CRESTEL-PSG
> Elitecore Technologies Pvt. Ltd.
> 904, Silicon Tower || Off C.G.Road
> Behind Pariseema Building || Ahmedabad || INDIA
> [GSM]: +91 9727746022
>
>
> -----Original Message-----
> From: Yuvrajsinh Chauhan [mailto:[EMAIL PROTECTED]]
> Sent: 17 July 2012 18:49
> To: [EMAIL PROTECTED]
> Subject: RE: HDFS Installation / Configuration
>
> Dear Tariq,
>
> Values of both the properties are already configured in hdfs-site.xml file.
>
> <property>
> <name>dfs.name.dir</name>
> <value>/usr/local/hadoopstorage/namenode</value>        #Directories created
> with proper Hadoop user permission with R/W.
> <final>true</final>
> </property>
> <property>
> <name>dfs.data.dir</name>
> <value>/usr/local/hadoopstorage/datanode</value>
> <final>true</final>
> </property>
> ===========================================================================> Command for creating a Directory
>
> [hadoop@rac1 bin]$ ./hadoop fs -mkdir /yuvi
> [hadoop@rac1 bin]$
> [hadoop@rac1 bin]$ ./hadoop fs -ls
> ls: Cannot access .: No such file or directory.
> [hadoop@rac1 bin]$
>
> But when I go on to that path, I cannot see any directory. However, I can
> see the directories from GUI.
> Also I cannot find any error in Logs from both the nodes.
>
>
>
> Regards,
>
> Yuvrajsinh Chauhan || Sr. DBA || CRESTEL-PSG Elitecore Technologies Pvt.
> Ltd.
> 904, Silicon Tower || Off C.G.Road
> Behind Pariseema Building || Ahmedabad || INDIA
> [GSM]: +91 9727746022
>
>
> -----Original Message-----
> From: Mohammad Tariq [mailto:[EMAIL PROTECTED]]
> Sent: 17 July 2012 18:22
> To: [EMAIL PROTECTED]
> Subject: Re: HDFS Installation / Configuration
>
> Hi Yuvrajsinh,
>
>         There is absolutely nothing to be sorry for. Have you added thee
> following properties in your 'hdfs-site.xml' file ??
> - dfs.name.dir
> - dfs.data.dir
>
> By default the values of these properties is the /tmp directoy. It is
> advisable to create 2 directories on your local FS and assign the complete
> paths of these directories as the values of above specified properties. And
> these are the locations where your metadata and actual data will be stored.
> (Another important reason to set these properties is that, on each restart
> the /tmp directory is emptied and all the data and Hdfs namespace info will
> be lost). Hope this helps.
>
> Regards,
>     Mohammad Tariq
>
>
> On Tue, Jul 17, 2012 at 6:02 PM, Yuvrajsinh Chauhan
> <[EMAIL PROTECTED]> wrote:
>> Dear Tariq,
>>
>> All Web GUI are working fine. I can be able to make the directories
>> using ./hadoop fs -mkdir command. (For Ex. ./hadoop fs -mkdir /test)
>> But where this files are getting created ? also the same directory
>> created on both the Node ?
>>
>> I can see folder created on Namenode->Browse the filesystem Link. But
>> the same was not available on OS Level.
>>
>> Sorry, But I am new in HDFS. So please excuse me for silly questions.
>>
>>
>> Regards,
>> Yuvrajsinh Chauhan
>>
>> -----Original Message-----
>> From: Mohammad Tariq [mailto:[EMAIL PROTECTED]]
>> Sent: 17 July 2012 17:19
>> To: [EMAIL PROTECTED]
>> Subject: Re: HDFS Installation / Configuration
>>
>> Hello Yuvrajsinh,
>>
>>         Hadoop provides us web interfaces using which we can see the