Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Chukwa >> mail # dev >> Shutting down not required FileTailingAdaptors


Copy link to this message
-
RE: Shutting down not required FileTailingAdaptors
Eric,

Thanks for the reply. Right now the adaptor class I have written extends AbstractAdaptor. But I like the idea of extending DirTailingAdaptor.

Let me modify my class and send it for your review.

Thanks,
Deepak Deshpande
-----Original Message-----
From: Eric Yang [mailto:[EMAIL PROTECTED]]
Sent: Saturday, November 13, 2010 1:02 PM
To: [EMAIL PROTECTED]
Subject: Re: Shutting down not required FileTailingAdaptors

Hi Deepak,

Shutdown unused FileTailingAdaptor is a welcome addition, and
DirTailingAdaptor can be extended to another adaptor to meet this
requirement.  The expiration period can be a global config parameter
in Chukwa Agent config.  I think the design is on the right track.

regards,
Eric

On Thu, Nov 11, 2010 at 3:12 PM, Deshpande, Deepak
<[EMAIL PROTECTED]> wrote:
> I am using DirTailingAdaptor to monitor a directory and to start
> FileTailingAdaptor(s) for any new files getting created in that
> directory. In our environment a log file is created everyday and every
> file will have date in the file name. So, new log messages are written
> to current day files and previous day files are NOT updated.  The
> FileTailingAdaptor that's monitoring previous day file can be shut down
> without any concern. To satisfy this requirement I have written an
> adaptor that gets adaptors of type FileTailingAdaptor and gets the file
> name from it. If the file has NOT been modified for some time (a time
> that is passed as an argument when this adaptor is started) it shuts
> down the FileTailingAdaptor.
>
>
>
> I wanted to find out if this is a correct approach OR is there any other
> way to satisfy this requirement.
>
>
>
> Thanks,
> Deepak Deshpande.
>
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB