Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - read short circuit


+
n keywal 2012-09-13, 14:58
+
Jean-Daniel Cryans 2012-09-13, 16:30
+
n keywal 2012-09-13, 16:42
+
Andrew Purtell 2012-09-13, 17:44
+
Jesse Yates 2012-09-13, 17:57
+
Andrew Purtell 2012-09-13, 18:31
+
n keywal 2012-09-13, 19:17
+
Andrew Purtell 2012-09-13, 20:20
+
n keywal 2012-09-13, 20:34
+
Andrew Purtell 2012-09-13, 21:07
+
n keywal 2012-09-14, 12:48
Copy link to this message
-
Re: read short circuit
Jean-Daniel Cryans 2012-09-13, 16:51
On Thu, Sep 13, 2012 at 9:42 AM, n keywal <[EMAIL PROTECTED]> wrote:
> It's all in the "pretty much" :-)
> Should we make it the default (i.e. recommending it in the doc, emitting a
> warning if it's not set) for all installation ?

I'd recommend it in the doc as an important config to consider.

One issue with the current implementation is that you can only have 1
user that short circuit reads, all the others who have the config
enabled will get a fat Exception. At SU we don't have special config
files for every MR job so unless you disable it job by job then you'll
get those exceptions everywhere. We live with it but it did take
people by surprise when we rolled it out :)

> Or would it make sense to separate the store and wal cases, meaning that we
> need a change in hdfs to make this possible?

Don't we only have one FS instance per region server? If so, that's a
moot point.

J-D
+
Andrew Purtell 2012-09-13, 17:46
+
Stack 2012-09-13, 17:28
+
Jean-Daniel Cryans 2012-09-13, 18:01