Hi all

How to clean   {mapred.local.dir}/taskTracker ？ It's about 32 G and  I must
restart the cluser to clean it .

Thanks & Best Regards

hong

You could just restart the specific tasktracker that has filled this
directory; there's startup parts in the TT that clean up directories
before beginning to serve out.

On Mon, Sep 10, 2012 at 8:41 AM, Zhao Hong <[EMAIL PROTECTED]> wrote:
> Hi all
>
> How to clean   {mapred.local.dir}/taskTracker ？ It's about 32 G and  I must
> restart the cluser to clean it .
>
> Thanks & Best Regards
>
> hong

--
Harsh J

Thanks for your immediately reply .  Are there some other ways that do not
interrupt the running of TaskTracker?

On Mon, Sep 10, 2012 at 11:25 AM, Harsh J <[EMAIL PROTECTED]> wrote:

> You could just restart the specific tasktracker that has filled this
> directory; there's startup parts in the TT that clean up directories
> before beginning to serve out.
>
> On Mon, Sep 10, 2012 at 8:41 AM, Zhao Hong <[EMAIL PROTECTED]> wrote:
> > Hi all
> >
> > How to clean   {mapred.local.dir}/taskTracker ？ It's about 32 G and  I
> must
> > restart the cluser to clean it .
> >
> > Thanks & Best Regards
> >
> > hong
>
>
>
> --
> Harsh J
>

Hi Zhao,

The space should ideally be cleared up by itself. Can you inspect the
directories to see which tasks seem to have left data over (they may
have specifically done so via keep.failed.task.files=true) and if any
of them are still running?

On Mon, Sep 10, 2012 at 9:00 AM, Zhao Hong <[EMAIL PROTECTED]> wrote:
> Thanks for your immediately reply .  Are there some other ways that do not
> interrupt the running of TaskTracker?
>
> On Mon, Sep 10, 2012 at 11:25 AM, Harsh J <[EMAIL PROTECTED]> wrote:
>
>> You could just restart the specific tasktracker that has filled this
>> directory; there's startup parts in the TT that clean up directories
>> before beginning to serve out.
>>
>> On Mon, Sep 10, 2012 at 8:41 AM, Zhao Hong <[EMAIL PROTECTED]> wrote:
>> > Hi all
>> >
>> > How to clean   {mapred.local.dir}/taskTracker ？ It's about 32 G and  I
>> must
>> > restart the cluser to clean it .
>> >
>> > Thanks & Best Regards
>> >
>> > hong
>>
>>
>>
>> --
>> Harsh J
>>

--
Harsh J

Hi Harsh,
I looked up the directories. I do set the keep.failed.task.files=true
but  It seems that my cluster stores all  task files whatever failed or not.

Some completed job that have no any task failed are still in the directory.

Thanks.

Hong

On Mon, Sep 10, 2012 at 12:39 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> Hi Zhao,
>
> The space should ideally be cleared up by itself. Can you inspect the
> directories to see which tasks seem to have left data over (they may
> have specifically done so via keep.failed.task.files=true) and if any
> of them are still running?
>
> On Mon, Sep 10, 2012 at 9:00 AM, Zhao Hong <[EMAIL PROTECTED]> wrote:
> > Thanks for your immediately reply .  Are there some other ways that do
> not
> > interrupt the running of TaskTracker?
> >
> > On Mon, Sep 10, 2012 at 11:25 AM, Harsh J <[EMAIL PROTECTED]> wrote:
> >
> >> You could just restart the specific tasktracker that has filled this
> >> directory; there's startup parts in the TT that clean up directories
> >> before beginning to serve out.
> >>
> >> On Mon, Sep 10, 2012 at 8:41 AM, Zhao Hong <[EMAIL PROTECTED]>
> wrote:
> >> > Hi all
> >> >
> >> > How to clean   {mapred.local.dir}/taskTracker ？ It's about 32 G and  I
> >> must
> >> > restart the cluser to clean it .
> >> >
> >> > Thanks & Best Regards
> >> >
> >> > hong
> >>
> >>
> >>
> >> --
> >> Harsh J
> >>
>
>
>
> --
> Harsh J
>