Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Max Event Size


+
Lichen 2012-11-23, 09:29
Kevin,

This depends on your memory configuration. When you start flume with DEBUG did you got some errors / warning?

Cheers,
 Alex

P.S. http://flume.apache.org/FlumeUserGuide.html#exec-source
On Nov 23, 2012, at 10:29 AM, Lichen <[EMAIL PROTECTED]> wrote:

> Hi all,
>
> I tried to use exec source to tail a file of which each line is few MB. The File-Roll/HDFS sinks received nothing in this case, while work fine with other short lines. Is it because of the maximum size of a single event? What parameter to set if it's configurable.
>
> Thanks
>
> Kevin

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
+
Lichen 2012-11-24, 09:33
+
Alexander Alten-Lorenz 2012-11-26, 07:41
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB