Flume, mail # user - It's quite inefficient taking event from memory channel one by one - 2014-04-24, 06:37
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
It's quite inefficient taking event from memory channel one by one
I record the overall time in different stages in HDFSEventSink#process() ,
take events from channel always cost the most time dealing with a batch of
events. And I found it take one event from channel each time, so I wonder
whether it will be much faster if we take a batch of events from channel
each time ?

have a good day!
chenshang'an

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB