Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # dev >> HDFS-895 hflush speedup


Copy link to this message
-
RE: HDFS-895 hflush speedup
Todd: Good stuff! Have you tried this out on a HBase test too?

> I think with it on, we can practically turn off group commit and get quite a bit speedup.

Will batching now happen underneath the DFSClient automatically now that syncs/appends are not serialized.

regards,
Kannan
-----Original Message-----
From: Todd Lipcon [mailto:[EMAIL PROTECTED]]
Sent: Thursday, April 15, 2010 1:59 AM
To: [EMAIL PROTECTED]
Subject: HDFS-895 hflush speedup

Any of you out there who are running the 0.20+200+etc hadoop with 0.20
branch hbase want to try this patch? I think with it on, we can practically
turn off group commit and get quite a bit speedup.

--
Todd Lipcon
Software Engineer, Cloudera
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB