Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Auto clean DistCache?


Copy link to this message
-
Auto clean DistCache?
Jean-Marc Spaggiari 2013-03-26, 00:16
Hi,

Each time my MR job is run, a directory is created on the TaskTracker
under mapred/local/taskTracker/hadoop/distcache (based on my
configuration).

I looked at the directory today, and it's hosting thousands of
directories and more than 8GB of data there.

Is there a way to automatically delete this directory when the job is done?

Thanks,

JM