Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - scrach space grows too fast


Copy link to this message
-
RE: scrach space grows too fast
Bennie Schut 2010-08-24, 08:41
I was actually planning on filing a bug for this. I think it is supposed to remove the temp. hadoop results from this dir but it doesn't seem to do that anymore. For now I use a workaround to simply remove anything from there older then x days however that still means you have results from really large jobs laying around there for x days.
________________________________
From: shangan [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, August 24, 2010 10:36 AM
To: hive-user
Subject: scrach space grows too fast

what's the parameter "hive.exec.scratchdir" for ? save the job plan ?
the space of this directory is growing too fast and I don't know why files under this directory is not removed after the job is finished. Do they have other functions ?

2010-08-24
________________________________
shangan