+
Abhijit Dhar 2012-01-17, 03:20
+
Eric Yang 2012-01-18, 02:03
-
Re: hadoop's attempt directory logsAbhijit Dhar 2012-01-20, 02:13
I added this in my $HADOOP_CONF_DIR/log4j.properties
log4j.appender.TLA=org.apache.hadoop.chukwa.inputtools.log4j.TaskLogAppender
log4j.appender.TLA.recordType=CrawlerLog
log4j.appender.TLA.taskId=${hadoop.tasklog.taskid}
log4j.appender.TLA.layout=org.apache.log4j.PatternLayout
log4j.appender.TLA.layout.ConversionPattern=%d{ISO8601} %p [%t]
[%c{5}.%M()]:: %m%n
But, it looks like when I add this to the rootlogger
(log4j.rootLogger=ERROR, stdout, TLA), it stops going through even my
stdout log appender.
Any idea, what might be going on? (chukwa jar is on my classpath, and I
don't see any ClassNotFound exception, so I think that part is good)
Thanks,
On Tue, Jan 17, 2012 at 6:03 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
> This can be setup by using TaskLogAppender that comes with Chukwa.
> In $HADOOP_CONF_DIR/log4j.properties, modify the TaskLogAppender
> configuration
> to:
>
>
> log4j.appender.TLA=org.apache.hadoop.chukwa.inputtools.log4j.TaskLogAppender
>
> Make sure chukwa-0.x.0-client.jar is in Hadoop class path, and restart
> Hadoop.
>
> This should enable Task Attempt Logs to be sent through Chukwa data
> collection system, and also log a copy locally on the task tracker
> node. Hope this is what you are looking for.
>
> regards,
> Eric
>
> On Mon, Jan 16, 2012 at 7:20 PM, Abhijit Dhar <[EMAIL PROTECTED]>
> wrote:
> > Hi,
> >
> > Could you please point me how to stream the attempt logs that hadoop
> > generates to chukwa, while at the same time saving them the way hadoop
> saves
> > by default under attempt directories/stdout ?
> >
> > Thanks a lot
> >
> > --
> > View this message in context:
> http://apache-chukwa.679492.n3.nabble.com/hadoop-s-attempt-directory-logs-tp3665088p3665088.html
> > Sent from the Chukwa - Users mailing list archive at Nabble.com.
>
--
Абижит Дар
log4j.appender.TLA=org.apache.hadoop.chukwa.inputtools.log4j.TaskLogAppender
log4j.appender.TLA.recordType=CrawlerLog
log4j.appender.TLA.taskId=${hadoop.tasklog.taskid}
log4j.appender.TLA.layout=org.apache.log4j.PatternLayout
log4j.appender.TLA.layout.ConversionPattern=%d{ISO8601} %p [%t]
[%c{5}.%M()]:: %m%n
But, it looks like when I add this to the rootlogger
(log4j.rootLogger=ERROR, stdout, TLA), it stops going through even my
stdout log appender.
Any idea, what might be going on? (chukwa jar is on my classpath, and I
don't see any ClassNotFound exception, so I think that part is good)
Thanks,
On Tue, Jan 17, 2012 at 6:03 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
> This can be setup by using TaskLogAppender that comes with Chukwa.
> In $HADOOP_CONF_DIR/log4j.properties, modify the TaskLogAppender
> configuration
> to:
>
>
> log4j.appender.TLA=org.apache.hadoop.chukwa.inputtools.log4j.TaskLogAppender
>
> Make sure chukwa-0.x.0-client.jar is in Hadoop class path, and restart
> Hadoop.
>
> This should enable Task Attempt Logs to be sent through Chukwa data
> collection system, and also log a copy locally on the task tracker
> node. Hope this is what you are looking for.
>
> regards,
> Eric
>
> On Mon, Jan 16, 2012 at 7:20 PM, Abhijit Dhar <[EMAIL PROTECTED]>
> wrote:
> > Hi,
> >
> > Could you please point me how to stream the attempt logs that hadoop
> > generates to chukwa, while at the same time saving them the way hadoop
> saves
> > by default under attempt directories/stdout ?
> >
> > Thanks a lot
> >
> > --
> > View this message in context:
> http://apache-chukwa.679492.n3.nabble.com/hadoop-s-attempt-directory-logs-tp3665088p3665088.html
> > Sent from the Chukwa - Users mailing list archive at Nabble.com.
>
--
Абижит Дар
+
Eric Yang 2012-01-20, 02:24
+
Abhijit Dhar 2012-01-20, 02:49
+
Eric Yang 2012-01-20, 04:59
+
Abhijit Dhar 2012-01-21, 04:16
+
Eric Yang 2012-01-21, 04:26
