Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: about replication


Copy link to this message
-
Re: about replication
First of all read the concepts ..I hope you will like it..

https://www.frcrc.org/sites/default/files/HadoopTutorialPart1.pdf

On Mon, Aug 19, 2013 at 9:45 AM, Irfan Sayed <[EMAIL PROTECTED]> wrote:

> please suggest
>
> regards
> irfan
>
>
>
> On Tue, Aug 13, 2013 at 12:56 PM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>
>> hey Tariq,
>> i am still stuck ..
>> can you please suggest
>>
>> regards
>> irfan
>>
>>
>>
>> On Thu, Aug 8, 2013 at 5:56 AM, Irfan Sayed <[EMAIL PROTECTED]> wrote:
>>
>>> please suggest
>>>
>>> regards
>>>
>>>
>>>
>>> On Wed, Aug 7, 2013 at 9:49 AM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>
>>>> attachment got quarantined
>>>> resending in txt format. please rename it to conf.rar
>>>>
>>>> regards
>>>>
>>>>
>>>>
>>>> On Wed, Aug 7, 2013 at 9:41 AM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>>
>>>>> thanks.
>>>>>
>>>>> if i run the jps command on namenode :
>>>>>
>>>>> Administrator@DFS-DC /cygdrive/c/Java/jdk1.7.0_25/bin
>>>>> $ ./jps.exe
>>>>> 3164 NameNode
>>>>> 1892 Jps
>>>>>
>>>>> same command on datanode :
>>>>>
>>>>> Administrator@DFS-1 /cygdrive/c/Java/jdk1.7.0_25/bin
>>>>> $ ./jps.exe
>>>>> 3848 Jps
>>>>>
>>>>> jps does not list any process for datanode. however, on web browser i
>>>>> can see one live data node
>>>>> please find the attached conf rar file of namenode
>>>>>
>>>>> regards
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Aug 7, 2013 at 1:52 AM, Mohammad Tariq <[EMAIL PROTECTED]>wrote:
>>>>>
>>>>>> OK. we'll start fresh. Could you plz show me your latest config files?
>>>>>>
>>>>>> BTW, are your daemons running fine?Use JPS to verify that.
>>>>>>
>>>>>> Warm Regards,
>>>>>> Tariq
>>>>>> cloudfront.blogspot.com
>>>>>>
>>>>>>
>>>>>> On Tue, Aug 6, 2013 at 10:59 PM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>>>>
>>>>>>> i have created these dir "wksp_data" and "wksp_name" on both
>>>>>>> datanode and namenode
>>>>>>> made the respective changes in "hdfs-site.xml" file
>>>>>>> formatted the namenode
>>>>>>> started the dfs
>>>>>>>
>>>>>>> but still, not able to browse the file system through web browser
>>>>>>> please refer below
>>>>>>>
>>>>>>> anything still missing ?
>>>>>>> please suggest
>>>>>>>
>>>>>>> [image: Inline image 1]
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Aug 6, 2013 at 10:35 PM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>>>>>
>>>>>>>> these dir needs to be created on all datanodes and namenodes ?
>>>>>>>> further,  hdfs-site.xml needs to be updated on both datanodes and
>>>>>>>> namenodes for these new dir?
>>>>>>>>
>>>>>>>> regards
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Tue, Aug 6, 2013 at 5:30 PM, Mohammad Tariq <[EMAIL PROTECTED]>wrote:
>>>>>>>>
>>>>>>>>> Create 2 directories manually corresponding to the values of
>>>>>>>>> dfs.name.dir and dfs.data.dir properties and change the permissions of
>>>>>>>>> these directories to 755. When you start pushing data into your HDFS, data
>>>>>>>>> will start going inside the directory specified by dfs.data.dir and the
>>>>>>>>> associated metadata will go inside dfs.name.dir. Remember, you store data
>>>>>>>>> in HDFS, but it eventually gets stored in your local/native FS. But you
>>>>>>>>> cannot see this data directly on your local/native FS.
>>>>>>>>>
>>>>>>>>> Warm Regards,
>>>>>>>>> Tariq
>>>>>>>>> cloudfront.blogspot.com
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Tue, Aug 6, 2013 at 5:26 PM, Irfan Sayed <[EMAIL PROTECTED]>wrote:
>>>>>>>>>
>>>>>>>>>> thanks.
>>>>>>>>>> however, i need this to be working on windows environment as
>>>>>>>>>> project requirement.
>>>>>>>>>> i will add/work on Linux later
>>>>>>>>>>
>>>>>>>>>> so, now , at this stage , c:\\wksp is the HDFS file system OR do
>>>>>>>>>> i need to create it from command line ?
>>>>>>>>>>
>>>>>>>>>> please suggest
>>>>>>>>>>
>>>>>>>>>> regards,
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Tue, Aug 6, 2013 at 5:19 PM, Mohammad Tariq <
>>>>>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hello Irfan,
>>>>>>>>>>>
>>>>>>>>>>> Sorry for being unresponsive. Got stuck with some imp work.
Regards

*Manish Dunani*
*Contact No* : +91 9408329137
*skype id* : manish.dunani*
*