Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: HDFS Installation / Configuration


Copy link to this message
-
Re: HDFS Installation / Configuration
No prob.

Regards,
    Mohammad Tariq
On Tue, Jul 17, 2012 at 6:55 PM, Yuvrajsinh Chauhan
<[EMAIL PROTECTED]> wrote:
> Dear Tariq / Bijoy,
>
> Please Ignore my previous mail. I can now see the directories using
> following commands:
>
> [hadoop@rac1 bin]$ ./hadoop fs -ls /
> Found 5 items
> drwxr-xr-x   - hadoop hadoop              0 2012-07-16 14:23 /test
> drwxr-xr-x   - hadoop hadoop              0 2012-07-17 13:29 /test1
> drwxr-xr-x   - hadoop supergroup          0 2012-07-17 18:03 /user
> drwxr-xr-x   - hadoop supergroup          0 2012-07-17 14:11 /usr
> drwxr-xr-x   - hadoop supergroup          0 2012-07-17 17:41 /yuvi
>
> I can see this data from both the nodes.
>
> Now, I am exploring more using by reading help.
>
> Regards,
>
> Yuvrajsinh Chauhan || Sr. DBA || CRESTEL-PSG
> Elitecore Technologies Pvt. Ltd.
> 904, Silicon Tower || Off C.G.Road
> Behind Pariseema Building || Ahmedabad || INDIA
> [GSM]: +91 9727746022
>
>
> -----Original Message-----
> From: Yuvrajsinh Chauhan [mailto:[EMAIL PROTECTED]]
> Sent: 17 July 2012 18:49
> To: [EMAIL PROTECTED]
> Subject: RE: HDFS Installation / Configuration
>
> Dear Tariq,
>
> Values of both the properties are already configured in hdfs-site.xml file.
>
> <property>
> <name>dfs.name.dir</name>
> <value>/usr/local/hadoopstorage/namenode</value>        #Directories created
> with proper Hadoop user permission with R/W.
> <final>true</final>
> </property>
> <property>
> <name>dfs.data.dir</name>
> <value>/usr/local/hadoopstorage/datanode</value>
> <final>true</final>
> </property>
> ===========================================================================> Command for creating a Directory
>
> [hadoop@rac1 bin]$ ./hadoop fs -mkdir /yuvi
> [hadoop@rac1 bin]$
> [hadoop@rac1 bin]$ ./hadoop fs -ls
> ls: Cannot access .: No such file or directory.
> [hadoop@rac1 bin]$
>
> But when I go on to that path, I cannot see any directory. However, I can
> see the directories from GUI.
> Also I cannot find any error in Logs from both the nodes.
>
>
>
> Regards,
>
> Yuvrajsinh Chauhan || Sr. DBA || CRESTEL-PSG Elitecore Technologies Pvt.
> Ltd.
> 904, Silicon Tower || Off C.G.Road
> Behind Pariseema Building || Ahmedabad || INDIA
> [GSM]: +91 9727746022
>
>
> -----Original Message-----
> From: Mohammad Tariq [mailto:[EMAIL PROTECTED]]
> Sent: 17 July 2012 18:22
> To: [EMAIL PROTECTED]
> Subject: Re: HDFS Installation / Configuration
>
> Hi Yuvrajsinh,
>
>         There is absolutely nothing to be sorry for. Have you added thee
> following properties in your 'hdfs-site.xml' file ??
> - dfs.name.dir
> - dfs.data.dir
>
> By default the values of these properties is the /tmp directoy. It is
> advisable to create 2 directories on your local FS and assign the complete
> paths of these directories as the values of above specified properties. And
> these are the locations where your metadata and actual data will be stored.
> (Another important reason to set these properties is that, on each restart
> the /tmp directory is emptied and all the data and Hdfs namespace info will
> be lost). Hope this helps.
>
> Regards,
>     Mohammad Tariq
>
>
> On Tue, Jul 17, 2012 at 6:02 PM, Yuvrajsinh Chauhan
> <[EMAIL PROTECTED]> wrote:
>> Dear Tariq,
>>
>> All Web GUI are working fine. I can be able to make the directories
>> using ./hadoop fs -mkdir command. (For Ex. ./hadoop fs -mkdir /test)
>> But where this files are getting created ? also the same directory
>> created on both the Node ?
>>
>> I can see folder created on Namenode->Browse the filesystem Link. But
>> the same was not available on OS Level.
>>
>> Sorry, But I am new in HDFS. So please excuse me for silly questions.
>>
>>
>> Regards,
>> Yuvrajsinh Chauhan
>>
>> -----Original Message-----
>> From: Mohammad Tariq [mailto:[EMAIL PROTECTED]]
>> Sent: 17 July 2012 17:19
>> To: [EMAIL PROTECTED]
>> Subject: Re: HDFS Installation / Configuration
>>
>> Hello Yuvrajsinh,
>>
>>         Hadoop provides us web interfaces using which we can see the
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB