Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - how to read file which gets continuously updated


+
Prajakta Bavikar 2012-09-13, 14:30
Copy link to this message
-
Re: how to read file which gets continuously updated
Arvind Prabhakar 2012-09-13, 16:50
Hi Prajakta,

You could possibly use the Exec source with the "tail -F /path/to/file"
command. One limitation of this approach is that it does not maintain any
state so you won't be able to resume/restart from a location within the
file. To address those cases, it may be necessary for you to write your own
scripts etc.

Regards,
Arvind

On Thu, Sep 13, 2012 at 7:30 AM, Prajakta Bavikar <
[EMAIL PROTECTED]> wrote:

>  Is it possible in flume to read file which gets continuously updated ?***
> *
>
> Can it be done using in built sources****
>
> Or I will have to write custom source?****
>
> -Prajakta****
>
> DISCLAIMER ========== This e-mail may contain privileged and confidential
> information which is the property of Persistent Systems Ltd. It is intended
> only for the use of the individual or entity to which it is addressed. If
> you are not the intended recipient, you are not authorized to read, retain,
> copy, print, distribute or use this message. If you have received this
> communication in error, please notify the sender and delete all copies of
> this message. Persistent Systems Ltd. does not accept any liability for
> virus infected mails.
>