Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Chukwa >> mail # user >> hadoop's attempt directory logs


+
Abhijit Dhar 2012-01-17, 03:20
+
Eric Yang 2012-01-18, 02:03
+
Abhijit Dhar 2012-01-20, 02:13
+
Eric Yang 2012-01-20, 02:24
+
Abhijit Dhar 2012-01-20, 02:49
+
Eric Yang 2012-01-20, 04:59
+
Abhijit Dhar 2012-01-21, 04:16
Copy link to this message
-
Re: hadoop's attempt directory logs
You can try to merge the code from ChukwaDailyRollingFileAppender with
TaskLogAppender to get a working TaskLogAppender.  In particular, the
subAppend function should be identical to
ChukwaDailyRollingFileAppender.  This should be a jira for Chukwa 0.6.
Hope this helps.

regards,
Eric

On Fri, Jan 20, 2012 at 8:16 PM, Abhijit Dhar <[EMAIL PROTECTED]> wrote:
> Can you point me how to fix this thing? Or if there is a workaround? Getting
> this to work would be really helpful.
>
>
>
>
> On Thu, Jan 19, 2012 at 8:59 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>
>> Chukwa's own TaskLogAppender code seems to be using default
>> initialization parameters for contacting Chukwa Agent.  The code may
>> need some update for it to work right.  The subAppend function between
>> ChukwaDailyRollingFileAppender and TaskLogAppender should look very
>> similar.  Unfortunately, it isn't at the current state.  I think a
>> patch is required to get Chukwa's TaskLogAppender to work.
>>
>> regards,
>> Eric
>>
>> On Jan 19, 2012, at 6:49 PM, Abhijit Dhar <[EMAIL PROTECTED]>
>> wrote:
>>
>> > I tried different loglevels too. But, I checked, and found that
>> > TaskLogAppender does not even register itself with the chuka agent as an
>> > adapter. I tried using ChukwaDailyRollingFileAppender with the below
>> > config,
>> > and it works flawlessly -
>> >
>> >
>> > log4j.appender.TLA=org.apache.hadoop.chukwa.inputtools.log4j.ChukwaDailyRollingFileAppender
>> > log4j.appender.TLA.File=logs/jcrawler.log
>> > log4j.appender.TLA.recordType=CrawlerLog
>> > log4j.appender.TLA.chukwaClientHostname=localhost
>> > log4j.appender.TLA.chukwaClientPortNum=9093
>> > log4j.appender.TLA.DatePattern=.yyyy-MM-dd
>> > log4j.appender.TLA.layout=org.apache.log4j.PatternLayout
>> > log4j.appender.TLA.layout.ConversionPattern=%d{ISO8601} %p [%t]
>> > [%c{5}.%M()]:: %m%n
>> >
>> > But, with ChukwaDailyRollingFileAppender, it does not create the task
>> > log
>> > attempt directories(which I need too)
>> >
>> > --
>> > View this message in context:
>> > http://apache-chukwa.679492.n3.nabble.com/hadoop-s-attempt-directory-logs-tp3665088p3674393.html
>> > Sent from the Chukwa - Users mailing list archive at Nabble.com.
>
>
>
>
> --
> Абижит Дар
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB