Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - full disk woes


Copy link to this message
-
Re: full disk woes
Allen Wittenauer 2010-07-21, 21:15

On Jul 21, 2010, at 2:09 PM, Alex Loddengaard wrote:
> I setup a cron job to delete files older than 5 days in mapred.local.dir.  I've also found that sometimes userlogs aren't cleaned up correctly, so setting up a cron job to delete old files in userlogs is also a good idea.

I wish the tasktracker was smarter about its cache; i.e., actually treating it like a cache.  When I've removed stuff from it, the tasks got very very cranky.  I should file a jira.   But I think I'm over my quota.