Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Chukwa, mail # dev - Shutting down not required FileTailingAdaptors


Copy link to this message
-
RE: Shutting down not required FileTailingAdaptors
Deshpande, Deepak 2010-11-15, 15:24
Eric,

Thanks for the reply. Right now the adaptor class I have written extends AbstractAdaptor. But I like the idea of extending DirTailingAdaptor.

Let me modify my class and send it for your review.

Thanks,
Deepak Deshpande
-----Original Message-----
From: Eric Yang [mailto:[EMAIL PROTECTED]]
Sent: Saturday, November 13, 2010 1:02 PM
To: [EMAIL PROTECTED]
Subject: Re: Shutting down not required FileTailingAdaptors

Hi Deepak,

Shutdown unused FileTailingAdaptor is a welcome addition, and
DirTailingAdaptor can be extended to another adaptor to meet this
requirement.  The expiration period can be a global config parameter
in Chukwa Agent config.  I think the design is on the right track.

regards,
Eric

On Thu, Nov 11, 2010 at 3:12 PM, Deshpande, Deepak
<[EMAIL PROTECTED]> wrote:
> I am using DirTailingAdaptor to monitor a directory and to start
> FileTailingAdaptor(s) for any new files getting created in that
> directory. In our environment a log file is created everyday and every
> file will have date in the file name. So, new log messages are written
> to current day files and previous day files are NOT updated.  The
> FileTailingAdaptor that's monitoring previous day file can be shut down
> without any concern. To satisfy this requirement I have written an
> adaptor that gets adaptors of type FileTailingAdaptor and gets the file
> name from it. If the file has NOT been modified for some time (a time
> that is passed as an argument when this adaptor is started) it shuts
> down the FileTailingAdaptor.
>
>
>
> I wanted to find out if this is a correct approach OR is there any other
> way to satisfy this requirement.
>
>
>
> Thanks,
> Deepak Deshpande.
>
>
>
>