Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Max Event Size


+
Lichen 2012-11-23, 09:29
Kevin,

This depends on your memory configuration. When you start flume with DEBUG did you got some errors / warning?

Cheers,
 Alex

P.S. http://flume.apache.org/FlumeUserGuide.html#exec-source
On Nov 23, 2012, at 10:29 AM, Lichen <[EMAIL PROTECTED]> wrote:

> Hi all,
>
> I tried to use exec source to tail a file of which each line is few MB. The File-Roll/HDFS sinks received nothing in this case, while work fine with other short lines. Is it because of the maximum size of a single event? What parameter to set if it's configurable.
>
> Thanks
>
> Kevin

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
+
Lichen 2012-11-24, 09:33
+
Alexander Alten-Lorenz 2012-11-26, 07:41