Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Re: file channel read performance impacted by write rate


+
Jan Van Besien 2013-11-14, 08:50
+
Brock Noland 2013-11-14, 16:07
+
Jan Van Besien 2013-11-13, 09:32
+
Brock Noland 2013-11-13, 14:03
+
Jan Van Besien 2013-11-18, 10:28
+
Brock Noland 2013-12-17, 17:51
Copy link to this message
-
Re: file channel read performance impacted by write rate
On 11/18/2013 11:28 AM, Jan Van Besien wrote:
> - thread dumps while the ingest was running and the null sink was enabled

After looking at the thread dumps myself, I did some profiling (yourkit
"monitor profiling"). It seems to suggest that about 40% of the time, it
is blocking on a monitor defined by the "synchronized" keyword in the
LogFile$Writer.put(ByteBuffer) method. That seems significant?

Jan

+
Jan Van Besien 2013-11-25, 08:46
+
Shangan Chen 2013-12-17, 12:27
+
Brock Noland 2013-12-17, 12:54
+
Shangan Chen 2013-12-17, 15:32
+
Brock Noland 2013-12-17, 16:13
+
Hari Shreedharan 2013-12-17, 17:11
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB