Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - cleanup of data when restarting Tasktracker of Hadoop


Copy link to this message
-
RE: cleanup of data when restarting Tasktracker of Hadoop
Devaraj k 2012-05-29, 10:45
Task tracker doesn't clean any data on restart. What is the data you are storing(job oputput or something else)? Can you check the task tracker logs or any other process removing which is running in the same machine.

Thanks
Devaraj

________________________________________
From: hadoop anis [[EMAIL PROTECTED]]
Sent: Tuesday, May 29, 2012 4:00 PM
To: [EMAIL PROTECTED]
Subject: Re: cleanup of data when restarting Tasktracker of Hadoop

Thanks for Replying,

           I am using shared directory to store the data

On 5/29/12, Devaraj k <[EMAIL PROTECTED]> wrote:
> What is the local directory you are using to store the data?
>
> Thanks
> Devaraj
>
> ________________________________________
> From: hadoop anis [[EMAIL PROTECTED]]
> Sent: Tuesday, May 29, 2012 12:29 PM
> To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
> Subject: Re: cleanup of data when restarting Tasktracker of Hadoop
>
>       Hi friends,
>
>                I am using Hadoop 0.20.2 version.
>>
>
>>                In my setup When Tasktracker exits, then data persist on
>> linux filesystem. (I am using Hadoop without HDFS)
>>      but when I restart the tasktracker on that node it cleans all data
>> on
>> it's directory.
>>
>>                Is this normal behavior? and what I have to do to persist
>> that data even after restarting of Tasktracker.?
>>                please let me know.
>>
>>
>
>
> --
> Regards,
>
> Anis
> Student MTech (Comp.Sci. & Engg)
>
--
Regards,

Anis
Student MTech (Comp.Sci. & Engg)