Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Setting zookeeper timeout to higher value


Copy link to this message
-
Re: Setting zookeeper timeout to higher value
Jean-Marc Spaggiari 2013-08-21, 12:37
Hadoop (and HBase) us the replication to protect your data. Which mean, the
same data will be written on different servers to protect it. Also, since
data will be spread over different servers, you an run process on them in
parallele, which will make it faster.

With a stand alone instance, you don't have the replication, you don't have
multiple servers, etc.

If you have any failure, it's your data your are going to loose.

As long as you are aware of that, go for it.

JM

2013/8/21 Vimal Jain <[EMAIL PROTECTED]>

> yeah .. its mentioned so in official guide but currently i am using it in
> production and would later convert it to 3-node cluster.
>
>
> On Wed, Aug 21, 2013 at 5:54 PM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
> > Hi Vimal,
> >
> > I'm talking about your HBase installationg. I guessed that a pseudo
> > distributed distributed HBase installation is for testing purposes, and
> not
> > to sustain a production load.
> >
> > JM
> >
> > 2013/8/21 Vimal Jain <[EMAIL PROTECTED]>
> >
> > > Hi Jean,
> > > Sorry , but i did not get you completely.
> > > When you say its for testing , what exactly it means ?
> > >
> > >
> > > On Wed, Aug 21, 2013 at 5:28 PM, Jean-Marc Spaggiari <
> > > [EMAIL PROTECTED]> wrote:
> > >
> > > > Hi Vimal,
> > > >
> > > > It's for testing only, so you can put what ever value you want ;)
> > > >
> > > > It might just take longer because HBase see that RS is down. But as I
> > > said,
> > > > it's for testing. So it's not really critical.
> > > >
> > > > You might also want to play with GC options to make it faster.
> > > >
> > > > JM
> > > >
> > > > 2013/8/21 Vimal Jain <[EMAIL PROTECTED]>
> > > >
> > > > > Can someone please give advice on this ?
> > > > >
> > > > >
> > > > > On Tue, Aug 20, 2013 at 12:41 PM, Vimal Jain <[EMAIL PROTECTED]>
> > wrote:
> > > > >
> > > > > > Hi,
> > > > > > I am running Hbase in pseudo distributed mode on top HDFS.
> > > > > > Recently , i was facing problems related to long GC pauses.
> > > > > > When i read in official documentation , its suggested to increase
> > > > > > zookeeper timeout.
> > > > > >
> > > > > > I am planning to make it 10 minutes .I understand the risk of
> > > > increasing
> > > > > > timeout means it takes a while for master to assign new
> > regionserver
> > > in
> > > > > > case of a RS failure.
> > > > > > But as i am running Pseudo distributed mode , there is only one
> RS
> > > and
> > > > > > even if it goes down my entire system is down , so increasing
> > timeout
> > > > > does
> > > > > > not seems to be an issue in my case.But still , i would like
> > expert's
> > > > > > advice on this.
> > > > > >
> > > > > >
> > > > > > Here is my hbase-site.xml :-
> > > > > >
> > > > > > <configuration>
> > > > > > *        <property>
> > > > > >                 <name>zookeeper.session.timeout</name>
> > > > > >                 <value>600000</value>
> > > > > >          </property>
> > > > > >         <property>
> > > > > >                 <name>hbase.zookeeper.property.tickTime</name>
> > > > > >                 <value>30000</value>
> > > > > >         </property>*
> > > > > >         <property>
> > > > > >                 <name>hbase.rootdir</name>
> > > > > >                 <value>hdfs://192.168.20.30:9000/hbase</value>
> > > > > >         </property>
> > > > > >         <property>
> > > > > >                 <name>hbase.cluster.distributed</name>
> > > > > >                 <value>true</value>
> > > > > >          </property>
> > > > > >          <property>
> > > > > >               <name>hbase.zookeeper.quorum</name>
> > > > > >               <value>192.168.20.30</value>
> > > > > >         </property>
> > > > > >         <property>
> > > > > >               <name>dfs.replication</name>
> > > > > >               <value>1</value>
> > > > > >         </property>
> > > > > >          <property>
> > > > > >                  <name>hbase.zookeeper.property.clientPort</name>
> > > > > >                  <value>2181</value>
>