Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Short-circuit reads


Copy link to this message
-
Short-circuit reads
Hello,

I read about "short circuit reads" in the HBase documentation's performance
section[1] and was wondering what people's experiences were using this in a
production setting.

Also,

1. Since only one dedicated user can take advantage of the feature do you
launch all jobs as this user?
2. Can dfs.client.read.shortcircuit be set to false for jobs wich are not
launched by the short-circuit user in order to avoid exceptions? In other
words - can this setting be overriden by the client configuration's
hbase-site.xml?
3. In the same context, it is suggested to enable HBase internal
checksums[2]. Is this a feature which can be enabled in HBase 0.92.1 which
is part of the Cloudera 4.1.x release?

Thank you,

/David

[1] http://hbase.apache.org/book/perf.hdfs.html#ftn.d2145e7370
[2] https://issues.apache.org/jira/browse/HBASE-5074
+
Jean-Daniel Cryans 2013-01-27, 22:45
+
Ted 2013-01-27, 22:34
+
Jean-Marc Spaggiari 2013-01-27, 22:38
+
Jean-Daniel Cryans 2013-01-27, 22:50
+
Jean-Marc Spaggiari 2013-01-27, 22:55
+
David Koch 2013-01-27, 23:16
+
Jean-Daniel Cryans 2013-01-28, 02:56
+
Jean-Marc Spaggiari 2013-01-28, 12:45
+
Ted Yu 2013-01-27, 22:45
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB