Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Chukwa >> mail # dev >> Planning for SyslogAdaptor


+
Eric Yang 2010-10-03, 00:05
Copy link to this message
-
Re: Planning for SyslogAdaptor
Yes. That sounds like a good idea.  Can you reuse any of the
UDPAdaptor code by inheritance?  (Or by refactoring, and then using
inheritance?)

--Ari

On Sat, Oct 2, 2010 at 5:05 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
> Hi,
>
> UDPAdaptor can record syslog logs but the log entry is tagged with
> Chukwa internal data type at adaptor start up time.  I am thinking to
> extend UDPAdaptor to record syslog messages with small enhancements.
> SyslogAdaptor can extract facility name field from syslog message to
> tag facility name as the data type.  This would provide the ability to
> invoke different demux parsers base on the facility name in syslog.
> HOSTNAME can also be mapped to source for Chukwa chunk meta data.
>
> My use case is to configure hadoop log4j.properties to log everything
> through org.apache.log4j.net.SyslogAppender to one SysLogAdaptor on
> the local Chukwa agent, and invokes different parsers for audit log
> and name node log.  Facility name is some what limited, but it should
> be enough type left to manage hadoop log files.  Suggestion and
> feedbacks are welcome.
>
> regards,
> Eric
>

--
Ari Rabkin [EMAIL PROTECTED]
UC Berkeley Computer Science Department
+
Eric Yang 2010-10-03, 04:23
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB