|
|
-
KeyValue size too large
Bai Shen 2012-08-02, 14:26
I'm running Nutch 2 which uses HBase for storage. It is attempting to store files bigger than 10MB into HBase. This causes the KeyValue size too large exception.
However, I've set the hbase.client.keyvalue.maxsize to 0, -1, and 100MB. None of those have had an effect. AFAIK, it's finding my hbase-site file because it's correctly reading the hbase.rootdir property.
I've checked the spelling of both the name and the xml, and they're all correct. What else should I look at?
Thanks.
-
Re: KeyValue size too large
Jean-Daniel Cryans 2012-08-02, 18:42
It sounds like you are overlooking something, are you sure the client is really picking the hbase-site.xml you think it is?
Also I don't get your reference to the hbase.rootdir, the client doesn't use it and hbase.client.keyvalue.maxsize is client-side only.
J-D
On Thu, Aug 2, 2012 at 7:26 AM, Bai Shen <[EMAIL PROTECTED]> wrote: > I'm running Nutch 2 which uses HBase for storage. It is attempting to > store files bigger than 10MB into HBase. This causes the KeyValue size too > large exception. > > However, I've set the hbase.client.keyvalue.maxsize to 0, -1, and 100MB. > None of those have had an effect. AFAIK, it's finding my hbase-site file > because it's correctly reading the hbase.rootdir property. > > I've checked the spelling of both the name and the xml, and they're all > correct. What else should I look at? > > Thanks.
-
Re: KeyValue size too large
Bai Shen 2012-08-02, 19:56
That was what I was missing. I moved it and that fixed it.
Thanks.
On Thu, Aug 2, 2012 at 2:42 PM, Jean-Daniel Cryans <[EMAIL PROTECTED]>wrote:
> It sounds like you are overlooking something, are you sure the client > is really picking the hbase-site.xml you think it is? > > Also I don't get your reference to the hbase.rootdir, the client > doesn't use it and hbase.client.keyvalue.maxsize is client-side only. > > J-D > > On Thu, Aug 2, 2012 at 7:26 AM, Bai Shen <[EMAIL PROTECTED]> wrote: > > I'm running Nutch 2 which uses HBase for storage. It is attempting to > > store files bigger than 10MB into HBase. This causes the KeyValue size > too > > large exception. > > > > However, I've set the hbase.client.keyvalue.maxsize to 0, -1, and 100MB. > > None of those have had an effect. AFAIK, it's finding my hbase-site file > > because it's correctly reading the hbase.rootdir property. > > > > I've checked the spelling of both the name and the xml, and they're all > > correct. What else should I look at? > > > > Thanks. >
|
|