Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Flume log event per file


Copy link to this message
-
Re: Flume log event per file
It looks like you have not configured any properties for "rolling"
files on hdfs.
The default rollCount is 10 (events).

http://flume.apache.org/FlumeUserGuide.html#hdfs-sink

The flume hdfs sink can be configured to roll based on size, # of
events, or time.

hdfs.rollInterval30Number of seconds to wait before rolling current
file (0 = never roll based on time interval)
hdfs.rollSize1024File size to trigger roll, in bytes (0: never roll
based on file size)
hdfs.rollCount10Number of events written to file before it rolled (0 =
never roll based on number of events)

On Thu, Feb 27, 2014 at 7:49 AM, orahad bigdata <[EMAIL PROTECTED]> wrote: