Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Small cluster setup


Copy link to this message
-
Re: Small cluster setup
I was trying to keep costs down as much as possible. Adding an 11th node just for Zookeeper seems a bit expensive.

On Jun 19, 2012, at 1:45 PM, Mikael Sitruk wrote:

> you should not put ZK server on the RS or data nodes, since you don't want
> their work to interfere ZK responsiveness.
> You can put ZK on any lightweigth server like HMaster, NN.
> I use almost same configuration as yours: 10 Region Server + DataNode+ Task
> Tracker, 1HMaster + ZK, 1NameNone + JobTracker + ZK, 1 ZK alone.
>
> Mikael.S
>
> On Tue, Jun 19, 2012 at 11:27 PM, Bryan Keller <[EMAIL PROTECTED]> wrote:
>
>> I have a small cluster with 10 nodes. 8 nodes are datanodes/regionservers,
>> and 2 nodes are running HA namenodes and HMaster. The question I have is,
>> what would be the best way to configure Zookeeper in my cluster? Currently
>> I have it running on one of the HMaster nodes. Running an instance on the
>> other HMaster node seems somewhat pointless as I need at least 3 nodes for
>> failover. Should I run Zookeeper on the other HMaster node and a 3rd
>> Zookeeper on one of the regionservers? What are the performance
>> implications of running Zookeeper on a regionserver?
>>
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB