Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> how to read file which gets continuously updated


+
Prajakta Bavikar 2012-09-13, 14:30
Copy link to this message
-
Re: how to read file which gets continuously updated
Hi Prajakta,

You could possibly use the Exec source with the "tail -F /path/to/file"
command. One limitation of this approach is that it does not maintain any
state so you won't be able to resume/restart from a location within the
file. To address those cases, it may be necessary for you to write your own
scripts etc.

Regards,
Arvind

On Thu, Sep 13, 2012 at 7:30 AM, Prajakta Bavikar <
[EMAIL PROTECTED]> wrote:

>  Is it possible in flume to read file which gets continuously updated ?***
> *
>
> Can it be done using in built sources****
>
> Or I will have to write custom source?****
>
> -Prajakta****
>
> DISCLAIMER ========== This e-mail may contain privileged and confidential
> information which is the property of Persistent Systems Ltd. It is intended
> only for the use of the individual or entity to which it is addressed. If
> you are not the intended recipient, you are not authorized to read, retain,
> copy, print, distribute or use this message. If you have received this
> communication in error, please notify the sender and delete all copies of
> this message. Persistent Systems Ltd. does not accept any liability for
> virus infected mails.
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB