Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> file channel read performance impacted by write rate


Copy link to this message
-
Re: file channel read performance impacted by write rate
On 11/18/2013 11:28 AM, Jan Van Besien wrote:
> - thread dumps while the ingest was running and the null sink was enabled

After looking at the thread dumps myself, I did some profiling (yourkit
"monitor profiling"). It seems to suggest that about 40% of the time, it
is blocking on a monitor defined by the "synchronized" keyword in the
LogFile$Writer.put(ByteBuffer) method. That seems significant?

Jan

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB