Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> It's quite inefficient taking event from memory channel one by one


Copy link to this message
-
It's quite inefficient taking event from memory channel one by one
I record the overall time in different stages in HDFSEventSink#process() ,
take events from channel always cost the most time dealing with a batch of
events. And I found it take one event from channel each time, so I wonder
whether it will be much faster if we take a batch of events from channel
each time ?

have a good day!
chenshang'an

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB