Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> full disk woes


+
Travis Crawford 2010-07-21, 19:45
+
Allen Wittenauer 2010-07-21, 21:01
+
Alex Loddengaard 2010-07-21, 21:09
Copy link to this message
-
Re: full disk woes

On Jul 21, 2010, at 2:09 PM, Alex Loddengaard wrote:
> I setup a cron job to delete files older than 5 days in mapred.local.dir.  I've also found that sometimes userlogs aren't cleaned up correctly, so setting up a cron job to delete old files in userlogs is also a good idea.

I wish the tasktracker was smarter about its cache; i.e., actually treating it like a cache.  When I've removed stuff from it, the tasks got very very cranky.  I should file a jira.   But I think I'm over my quota.
+
Travis Crawford 2010-07-21, 21:47
+
Allen Wittenauer 2010-07-21, 22:06
+
Travis Crawford 2010-07-21, 23:47