Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> full disk woes

Copy link to this message
Re: full disk woes

On Jul 21, 2010, at 2:09 PM, Alex Loddengaard wrote:
> I setup a cron job to delete files older than 5 days in mapred.local.dir.  I've also found that sometimes userlogs aren't cleaned up correctly, so setting up a cron job to delete old files in userlogs is also a good idea.

I wish the tasktracker was smarter about its cache; i.e., actually treating it like a cache.  When I've removed stuff from it, the tasks got very very cranky.  I should file a jira.   But I think I'm over my quota.