Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # dev >> files in the “spooling” directory only can transfer to sink one by one.


Copy link to this message
-
Re: files in the “spooling” directory only can transfer to sink one by one.
Is this for performance ? I dont think reading multiple files in parallel
which actually help performance. it will most likely hurt it.
-roshan
On Wed, Apr 10, 2013 at 7:39 PM, 周庆发 <[EMAIL PROTECTED]> wrote:

> Dear flumeNG development group
>
> why only can the files in the “spooling” directory transfer to sink one by
> one? In case there files are very big and growthing real-time,then other
> files can not transfer to sink.why thread pool only has one thread instead
> of multiple?Could you consider "Executors.**newScheduledThreadPool()"
> instead of "Executors.**newSingleThreadScheduledExecut**or()"? I believe
> there could be a good a reason why it was originally designed this way.
>
>
> Look forward to your reply
>
>
>
> Sincerely  yours
>
> qingfa zhou
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB