Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - log4j logging for mapreduce


Copy link to this message
-
log4j logging for mapreduce
Aji Janis 2013-06-25, 12:47
I know hadoop uses log4 for logging and I was able to view the properties
in conf/log4j.properties to figure out where the existing log files are.
However, is there a way for me to direct the logs from a (hbase) mapreduce
job to a completely new file? Idea being, I have a job scheduled to run
nightly and I like to be able to log to /var/log/myjob.log for just this
job so that I can check that file for any errors/exceptions instead of
having to go through the jotrackter UI. Is this possible? If so, how? Also,
since the job will be submitted to the cluster so please advice if the log
file needs to be on HDFS or the regular (linux) platform. If on Linux then
should it be on all nodes or just the hadoop master?

Hadoop version in use: 0.20.2-cdh3u5,
30233064aaf5f2492bc687d61d72956876102109

Thank you for any suggestions.