Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - 'hbase.client.scanner.caching' default value for HBase 0.90.6?


Copy link to this message
-
Re: 'hbase.client.scanner.caching' default value for HBase 0.90.6?
lars hofhansl 2013-10-21, 03:31
1/2 - 2/3 of your available RAM should be a good place to start.

________________________________
 From: A Laxmi <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Sunday, October 20, 2013 8:01 PM
Subject: Re: 'hbase.client.scanner.caching' default value for HBase 0.90.6?
 

Thanks Vladimar! I am using 6GB RAM so I have set 1GB for HBase. Please
suggest an appropriate heap size for HBase for a 6GB RAM.

The reason I am using older version of HBase is because the web crawler I
am using Apache Nutch supports only 0.90.x version of HBase as a backend to
store crawled data.

On Sun, Oct 20, 2013 at 10:37 PM, Vladimir Rodionov <[EMAIL PROTECTED]
> wrote:

> HBase bible (book) have answers on *almost* all questions (1GB default
> heap is too low for many applications - that is why you see OOME).
> HBase book:
> http://hbase.apache.org/book.html
>
> +1 on version upgrade.
>
> Is there any particular reason for so old version of HBase? The current is
> 0.94.12.
>
> Best regards,
> Vladimir Rodionov
> Principal Platform Engineer
> Carrier IQ, www.carrieriq.com
> e-mail: [EMAIL PROTECTED]
>
> ________________________________________
> From: A Laxmi [[EMAIL PROTECTED]]
> Sent: Sunday, October 20, 2013 6:01 PM
> To: [EMAIL PROTECTED]
> Subject: Re: 'hbase.client.scanner.caching' default value for HBase 0.90.6?
>
> Thanks Jean! But the problem is I am using a crawler "Apache Nutch" that
> supports a HBase version 0.90.6 so I have no option than to restrict to
> 0.90.6 version. :(
>
> I am also getting an out of memory error: heap space while using HBase. I
> am using default 1GB heap setting in hbase-en.sh. I have 6GB RAM. Please
> advise.
>
>  I have set  -
>
> *hbase.client.scanner.caching* to 1. *
> hbase.client.scanner.timeout.period *to* 120000
> hbase.regionserver.handler.count* to 10. *
> hbase.rpc.timeout *to 900000
> *hbase.regionserver.lease.period* to 900000
> *hbase.client.write.buffer* to 2097152
>
> Please advise what can be done to avoid out of memory error: heap space.
>
>
>
> On Sun, Oct 20, 2013 at 8:49 PM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
> > Also, Laxmi, if possible, I will highly recommend you to migrate to a
> more
> > recent version. 0.90 is VERY old...
> >
> >
> > 2013/10/20 lars hofhansl <[EMAIL PROTECTED]>
> >
> > > In any version < 0.96 it is 1. So in 0.90.6 it would be 1.
> > >
> > > -- Lars
> > >
> > >
> > >
> > > ----- Original Message -----
> > > From: A Laxmi <[EMAIL PROTECTED]>
> > > To: [EMAIL PROTECTED]
> > > Cc:
> > > Sent: Sunday, October 20, 2013 11:17 AM
> > > Subject: 'hbase.client.scanner.caching' default value for HBase 0.90.6?
> > >
> > > Hi,
> > >
> > > What is the default value of '*hbase.client.scanner.caching*' for
> *HBase
> > > 0.90.6* version in particular? Is it 1 or 100?
> > >
> > > Thanks
> > >
> > >
> >
>
> Confidentiality Notice:  The information contained in this message,
> including any attachments hereto, may be confidential and is intended to be
> read only by the individual or entity to whom this message is addressed. If
> the reader of this message is not the intended recipient or an agent or
> designee of the intended recipient, please note that any review, use,
> disclosure or distribution of this message or its attachments, in any form,
> is strictly prohibited.  If you have received this message in error, please
> immediately notify the sender and/or [EMAIL PROTECTED] and
> delete or destroy any copy of this message and its attachments.
>