Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Log4j changes not working inside static mapper and reducer classes


Copy link to this message
-
Re: Log4j changes not working inside static mapper and reducer classes
I'd recommend adding -Dlog4j.debug to the JVM args for any JVM that's not
giving you what you expect.  In this case, if it's the map/reduce tasks, add
it to mapred.child.java.opts in mapred-site.xml.  It should show you what
configuration log4j is actually picking up.

Dave

On Wed, May 25, 2011 at 3:52 PM, Himanish Kushary <[EMAIL PROTECTED]>wrote:

> The log4j logging statements work when I run the Map-Reduce job from
> eclipse
> using the LocalTaskTracker. But the logging is not working when I ran the
> Map-Reduce through hadoop jar command on the cluster. Strangely only the
> logging statements in the main enclosing class(the job class with main
> method) are working (so seems to be picking up the log4j settings) whereas
> the logging statements inside the static Mapper and Reducer classes are not
> getting printed. This is a HBase Map-Reduce job.
>
> Could it be some Hadoop/HBase specific log4j settings which could help to
> get the logging messages inside the static Mapper-Reducer classes to get
> printed.
>
> On Wed, May 25, 2011 at 4:07 PM, Jean-Daniel Cryans <[EMAIL PROTECTED]
> >wrote:
>
> > I'm not sure why you are asking this question on the hbase user
> > mailing list, it seems like you have a log4j issue.
> >
> > J-D
> >
> > On Wed, May 25, 2011 at 1:03 PM, Himanish Kushary <[EMAIL PROTECTED]>
> > wrote:
> > > Could anybody please help me with this.
> > >
> > > On Tue, May 24, 2011 at 10:17 AM, Himanish Kushary <[EMAIL PROTECTED]
> > >wrote:
> > >
> > >> Hi,
> > >>
> > >> I have enabled debug for my Map-Reduce package inside the
> > log4j.properties
> > >> under the $HADOOP_HOME/conf directory (using CDH3).
> > >>
> > >> log4j.logger.com.himanish.analytics.mapreduce=DEBUG
> > >>
> > >> The logging messages are getting logged for the main enclosing
> > Map-Reduce
> > >> job class but not for the static Mapper-Reducer classes inside it. I
> am
> > >> using the same logger instance from the enclosing class inside the
> > static
> > >> classes.I tried creating seperate logger for the static mapper-reducer
> > >> classes to no effect.
> > >>
> > >> Could anybody please provide any suggestions to resolve this. Also is
> > >> modifying the log4j.properties in the conf directory a good approach
> to
> > >> enable logging or is there some other better way.
> > >>
> > >> --
> > >> Thanks & Regards
> > >> Himanish
> > >>
> > >
> > >
> > >
> > > --
> > > Thanks & Regards
> > > Himanish
> > >
> >
>
>
>
> --
> Thanks & Regards
> Himanish
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB