Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # dev - HDFS-895 hflush speedup


Copy link to this message
-
RE: HDFS-895 hflush speedup
Kannan Muthukkaruppan 2010-04-15, 17:51
Todd: Good stuff! Have you tried this out on a HBase test too?

> I think with it on, we can practically turn off group commit and get quite a bit speedup.

Will batching now happen underneath the DFSClient automatically now that syncs/appends are not serialized.

regards,
Kannan
-----Original Message-----
From: Todd Lipcon [mailto:[EMAIL PROTECTED]]
Sent: Thursday, April 15, 2010 1:59 AM
To: [EMAIL PROTECTED]
Subject: HDFS-895 hflush speedup

Any of you out there who are running the 0.20+200+etc hadoop with 0.20
branch hbase want to try this patch? I think with it on, we can practically
turn off group commit and get quite a bit speedup.

--
Todd Lipcon
Software Engineer, Cloudera