Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> full disk woes


Copy link to this message
-
Re: full disk woes

On Jul 21, 2010, at 2:09 PM, Alex Loddengaard wrote:
> I setup a cron job to delete files older than 5 days in mapred.local.dir.  I've also found that sometimes userlogs aren't cleaned up correctly, so setting up a cron job to delete old files in userlogs is also a good idea.

I wish the tasktracker was smarter about its cache; i.e., actually treating it like a cache.  When I've removed stuff from it, the tasks got very very cranky.  I should file a jira.   But I think I'm over my quota.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB