-log4j logging for mapreduce
Aji Janis 2013-06-25, 12:47
I know hadoop uses log4 for logging and I was able to view the properties
in conf/log4j.properties to figure out where the existing log files are.
However, is there a way for me to direct the logs from a (hbase) mapreduce
job to a completely new file? Idea being, I have a job scheduled to run
nightly and I like to be able to log to /var/log/myjob.log for just this
job so that I can check that file for any errors/exceptions instead of
having to go through the jotrackter UI. Is this possible? If so, how? Also,
since the job will be submitted to the cluster so please advice if the log
file needs to be on HDFS or the regular (linux) platform. If on Linux then
should it be on all nodes or just the hadoop master?
Hadoop version in use: 0.20.2-cdh3u5,
Thank you for any suggestions.