Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Flume log event per file


Copy link to this message
-
Re: Flume log event per file
It looks like you have not configured any properties for "rolling"
files on hdfs.
The default rollCount is 10 (events).

http://flume.apache.org/FlumeUserGuide.html#hdfs-sink

The flume hdfs sink can be configured to roll based on size, # of
events, or time.

hdfs.rollInterval30Number of seconds to wait before rolling current
file (0 = never roll based on time interval)
hdfs.rollSize1024File size to trigger roll, in bytes (0: never roll
based on file size)
hdfs.rollCount10Number of events written to file before it rolled (0 =
never roll based on number of events)

On Thu, Feb 27, 2014 at 7:49 AM, orahad bigdata <[EMAIL PROTECTED]> wrote:

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB