Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Hadoop-2.0.1 log files deletion


+
Reyane Oukpedjo 2013-10-10, 14:57
Copy link to this message
-
Re: Hadoop-2.0.1 log files deletion
Hi Reyane,

   Did you try yarn.nodemanager.log.retain-seconds? increasing that might
help. The default value is 10800 seconds, that means 3 hours.

Thanks,
Kishore
On Thu, Oct 10, 2013 at 8:27 PM, Reyane Oukpedjo <[EMAIL PROTECTED]>wrote:

> Hi there,
>
> I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
> multiple unit tests that can take more than a day to finish running.
> However I realized the logs for the jobs are being deleted some how quickly
> than the default 24 hours setting of mapreduce.job.userlog.retain.hours
> property on mapred-site.xml. some of  the job logs were deleted after 4
> hours. Can this be a bug or if not is there any other property that
> override this ?
>
>
> Thank you.
>
> Reyane OUKPEDJO
>
>
>
>
>
>
>
+
Reyane Oukpedjo 2013-10-10, 15:27
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB