Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Chukwa >> mail # dev >> Shutting down not required FileTailingAdaptors

Copy link to this message
RE: Shutting down not required FileTailingAdaptors

Thanks for the reply. Right now the adaptor class I have written extends AbstractAdaptor. But I like the idea of extending DirTailingAdaptor.

Let me modify my class and send it for your review.

Deepak Deshpande
-----Original Message-----
From: Eric Yang [mailto:[EMAIL PROTECTED]]
Sent: Saturday, November 13, 2010 1:02 PM
Subject: Re: Shutting down not required FileTailingAdaptors

Hi Deepak,

Shutdown unused FileTailingAdaptor is a welcome addition, and
DirTailingAdaptor can be extended to another adaptor to meet this
requirement.  The expiration period can be a global config parameter
in Chukwa Agent config.  I think the design is on the right track.


On Thu, Nov 11, 2010 at 3:12 PM, Deshpande, Deepak
> I am using DirTailingAdaptor to monitor a directory and to start
> FileTailingAdaptor(s) for any new files getting created in that
> directory. In our environment a log file is created everyday and every
> file will have date in the file name. So, new log messages are written
> to current day files and previous day files are NOT updated.  The
> FileTailingAdaptor that's monitoring previous day file can be shut down
> without any concern. To satisfy this requirement I have written an
> adaptor that gets adaptors of type FileTailingAdaptor and gets the file
> name from it. If the file has NOT been modified for some time (a time
> that is passed as an argument when this adaptor is started) it shuts
> down the FileTailingAdaptor.
> I wanted to find out if this is a correct approach OR is there any other
> way to satisfy this requirement.
> Thanks,
> Deepak Deshpande.