Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: about replication


Copy link to this message
-
Re: about replication
I'm sorry for being unresponsive. Was out of touch for sometime because of
ramzan and eid. Resuming work today.

What's the current status?

Warm Regards,
Tariq
cloudfront.blogspot.com
On Mon, Aug 19, 2013 at 7:18 PM, manish dunani <[EMAIL PROTECTED]> wrote:

> First of all read the concepts ..I hope you will like it..
>
> https://www.frcrc.org/sites/default/files/HadoopTutorialPart1.pdf
>
>
>
> On Mon, Aug 19, 2013 at 9:45 AM, Irfan Sayed <[EMAIL PROTECTED]> wrote:
>
>> please suggest
>>
>> regards
>> irfan
>>
>>
>>
>> On Tue, Aug 13, 2013 at 12:56 PM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>
>>> hey Tariq,
>>> i am still stuck ..
>>> can you please suggest
>>>
>>> regards
>>> irfan
>>>
>>>
>>>
>>> On Thu, Aug 8, 2013 at 5:56 AM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>
>>>> please suggest
>>>>
>>>> regards
>>>>
>>>>
>>>>
>>>> On Wed, Aug 7, 2013 at 9:49 AM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>>
>>>>> attachment got quarantined
>>>>> resending in txt format. please rename it to conf.rar
>>>>>
>>>>> regards
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Aug 7, 2013 at 9:41 AM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>>>
>>>>>> thanks.
>>>>>>
>>>>>> if i run the jps command on namenode :
>>>>>>
>>>>>> Administrator@DFS-DC /cygdrive/c/Java/jdk1.7.0_25/bin
>>>>>> $ ./jps.exe
>>>>>> 3164 NameNode
>>>>>> 1892 Jps
>>>>>>
>>>>>> same command on datanode :
>>>>>>
>>>>>> Administrator@DFS-1 /cygdrive/c/Java/jdk1.7.0_25/bin
>>>>>> $ ./jps.exe
>>>>>> 3848 Jps
>>>>>>
>>>>>> jps does not list any process for datanode. however, on web browser i
>>>>>> can see one live data node
>>>>>> please find the attached conf rar file of namenode
>>>>>>
>>>>>> regards
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Wed, Aug 7, 2013 at 1:52 AM, Mohammad Tariq <[EMAIL PROTECTED]>wrote:
>>>>>>
>>>>>>> OK. we'll start fresh. Could you plz show me your latest config
>>>>>>> files?
>>>>>>>
>>>>>>> BTW, are your daemons running fine?Use JPS to verify that.
>>>>>>>
>>>>>>> Warm Regards,
>>>>>>> Tariq
>>>>>>> cloudfront.blogspot.com
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Aug 6, 2013 at 10:59 PM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>>>>>
>>>>>>>> i have created these dir "wksp_data" and "wksp_name" on both
>>>>>>>> datanode and namenode
>>>>>>>> made the respective changes in "hdfs-site.xml" file
>>>>>>>> formatted the namenode
>>>>>>>> started the dfs
>>>>>>>>
>>>>>>>> but still, not able to browse the file system through web browser
>>>>>>>> please refer below
>>>>>>>>
>>>>>>>> anything still missing ?
>>>>>>>> please suggest
>>>>>>>>
>>>>>>>> [image: Inline image 1]
>>>>>>>>
>>>>>>>>
>>>>>>>> On Tue, Aug 6, 2013 at 10:35 PM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>>>>>>
>>>>>>>>> these dir needs to be created on all datanodes and namenodes ?
>>>>>>>>> further,  hdfs-site.xml needs to be updated on both datanodes and
>>>>>>>>> namenodes for these new dir?
>>>>>>>>>
>>>>>>>>> regards
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Tue, Aug 6, 2013 at 5:30 PM, Mohammad Tariq <[EMAIL PROTECTED]
>>>>>>>>> > wrote:
>>>>>>>>>
>>>>>>>>>> Create 2 directories manually corresponding to the values of
>>>>>>>>>> dfs.name.dir and dfs.data.dir properties and change the permissions of
>>>>>>>>>> these directories to 755. When you start pushing data into your HDFS, data
>>>>>>>>>> will start going inside the directory specified by dfs.data.dir and the
>>>>>>>>>> associated metadata will go inside dfs.name.dir. Remember, you store data
>>>>>>>>>> in HDFS, but it eventually gets stored in your local/native FS. But you
>>>>>>>>>> cannot see this data directly on your local/native FS.
>>>>>>>>>>
>>>>>>>>>> Warm Regards,
>>>>>>>>>> Tariq
>>>>>>>>>> cloudfront.blogspot.com
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Tue, Aug 6, 2013 at 5:26 PM, Irfan Sayed <[EMAIL PROTECTED]
>>>>>>>>>> > wrote:
>>>>>>>>>>
>>>>>>>>>>> thanks.
>>>>>>>>>>> however, i need this to be working on windows environment as
>>>>>>>>>>> project requirement.
>>>>>>>>>>> i will add/work on Linux later
>>>>>>>>>>>
>>>>>>>