Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Re: file channel read performance impacted by write rate


+
Jan Van Besien 2013-11-14, 08:50
+
Brock Noland 2013-11-14, 16:07
+
Jan Van Besien 2013-11-13, 09:32
+
Brock Noland 2013-11-13, 14:03
+
Jan Van Besien 2013-11-18, 10:28
+
Brock Noland 2013-12-17, 17:51
Copy link to this message
-
Re: file channel read performance impacted by write rate
On 11/18/2013 11:28 AM, Jan Van Besien wrote:
> - thread dumps while the ingest was running and the null sink was enabled

After looking at the thread dumps myself, I did some profiling (yourkit
"monitor profiling"). It seems to suggest that about 40% of the time, it
is blocking on a monitor defined by the "synchronized" keyword in the
LogFile$Writer.put(ByteBuffer) method. That seems significant?

Jan

+
Jan Van Besien 2013-11-25, 08:46
+
Shangan Chen 2013-12-17, 12:27
+
Brock Noland 2013-12-17, 12:54
+
Shangan Chen 2013-12-17, 15:32
+
Brock Noland 2013-12-17, 16:13
+
Hari Shreedharan 2013-12-17, 17:11