Hi,

We are using a flume agent (0.9.3)  on Window for tailing a log file.

The log file name is rotated every day to create back up files.

For instance, the file name is application.log and every day the name is changed with sequential number. application.1.log

The current log file name is the same; application.log

tailDir source support a file name rotation on Linux OS, but in Window version, flume agent locks the file.

Have you experienced the same issue?

Thanks in advance.

Not Flume's agent is locking the file, the fileLock() API from Microsoft is done that. Store() and load() aren't closing the open file, as they do on Linux.

Please note, Flume pre 1.x (also called FlumeNG) won't be developed anymore actively. You can use Flume on a Windows System, build natively or over cygwin. Here a Thread about:
http://mail-archives.apache.org/mod_mbox/flume-user/201207.mbox/%[EMAIL PROTECTED]%3E

To build Flume natively on windows you can follow this post:
http://mapredit.blogspot.de/2012/07/run-flume-13x-on-windows.html

- Alex
> Hi,
>
> We are using a flume agent (0.9.3)  on Window for tailing a log file.
>
> The log file name is rotated every day to create back up files.
>
> For instance, the file name is application.log and every day the name is changed with sequential number. application.1.log
>
> The current log file name is the same; application.log
>
> tailDir source support a file name rotation on Linux OS, but in Window version, flume agent locks the file.
>
> Have you experienced the same issue?
>
> Thanks in advance.
>

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF

Hi Brock,

We are using a flume agent (0.9.3)  on Window for tailing a log file.The log file name is rotated every day to create back up files. For instance, the file name is application.log and every day the name is changed with sequential number. application.1.log. The current log file name is the same; application.log. tailDir source support a file name rotation on Linux OS, but in Window version, flume agent locks the file.

Could you please guide how could I make it rotate? Are we taking care of it in Flume NG?

Regards,

Deepak

http://mail-archives.apache.org/mod_mbox/flume-user/201209.mbox/%[EMAIL PROTECTED]%3E

The same post again?
On Sep 24, 2012, at 11:04 AM, "Kumar, Deepak8" <[EMAIL PROTECTED]> wrote:

> Hi Brock,
>
>
>
> We are using a flume agent (0.9.3)  on Window for tailing a log file.The log file name is rotated every day to create back up files. For instance, the file name is application.log and every day the name is changed with sequential number. application.1.log. The current log file name is the same; application.log. tailDir source support a file name rotation on Linux OS, but in Window version, flume agent locks the file.
>
>
>
> Could you please guide how could I make it rotate? Are we taking care of it in Flume NG?
>
>
>
> Regards,
>
> Deepak

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF

Hi,
My concern is, is there any other option than cygwin in flume NG?

Regards,
Deepak

-----Original Message-----
From: Alexander Lorenz [mailto:[EMAIL PROTECTED]]
Sent: Monday, September 24, 2012 5:11 AM
To: [EMAIL PROTECTED]
Subject: Re: Locked tail files by flume agent on Window

http://mail-archives.apache.org/mod_mbox/flume-user/201209.mbox/%[EMAIL PROTECTED]%3E

The same post again?
On Sep 24, 2012, at 11:04 AM, "Kumar, Deepak8" <[EMAIL PROTECTED]> wrote:

> Hi Brock,
>
>
>
> We are using a flume agent (0.9.3)  on Window for tailing a log file.The log file name is rotated every day to create back up files. For instance, the file name is application.log and every day the name is changed with sequential number. application.1.log. The current log file name is the same; application.log. tailDir source support a file name rotation on Linux OS, but in Window version, flume agent locks the file.
>
>
>
> Could you please guide how could I make it rotate? Are we taking care of it in Flume NG?
>
>
>
> Regards,
>
> Deepak

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF

Yes:
https://issues.apache.org/jira/browse/FLUME-1335

As I wrote, build FlumeNG on windows and try out which channels are working. I didn't got HDFS running so far.

- Alex

On Sep 24, 2012, at 11:13 AM, "Kumar, Deepak8" <[EMAIL PROTECTED]> wrote:

> Hi,
> My concern is, is there any other option than cygwin in flume NG?
>
> Regards,
> Deepak
>
> -----Original Message-----
> From: Alexander Lorenz [mailto:[EMAIL PROTECTED]]
> Sent: Monday, September 24, 2012 5:11 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Locked tail files by flume agent on Window
>
> http://mail-archives.apache.org/mod_mbox/flume-user/201209.mbox/%[EMAIL PROTECTED]%3E
>
> The same post again?
>
>
> On Sep 24, 2012, at 11:04 AM, "Kumar, Deepak8" <[EMAIL PROTECTED]> wrote:
>
>> Hi Brock,
>>
>>
>>
>> We are using a flume agent (0.9.3)  on Window for tailing a log file.The log file name is rotated every day to create back up files. For instance, the file name is application.log and every day the name is changed with sequential number. application.1.log. The current log file name is the same; application.log. tailDir source support a file name rotation on Linux OS, but in Window version, flume agent locks the file.
>>
>>
>>
>> Could you please guide how could I make it rotate? Are we taking care of it in Flume NG?
>>
>>
>>
>> Regards,
>>
>> Deepak
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF