Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: issue about hadoop hardware choose


Copy link to this message
-
Re: issue about hadoop hardware choose
if you want HA, then do you want to deploy journal node on the DN?
On Aug 8, 2013 5:09 PM, "ch huang" <[EMAIL PROTECTED]> wrote:

> hi,all:
>             My company need build a 10 node hadoop cluster (2 namenode and
> 8 datanode & node manager ,for both data storage and data analysis ) ,we
> have hbase ,hive on the hadoop cluster, 10G data increment per day.
>             we use CDH4.3 ( for dual - namenode HA),my plan is
>
>            name node  & resource manager
>            dual Quad Core
>          24G RAM
>          2 * 500GB SATA DISK (JBOD)
>
>          datanode & node manager
>          dual Quad Core
>          24G RAM
>          2 * 1TGB SATA DISK (JBOD)
>
>
> my question is
> 1, if resource manager need a dedicated server? ( i plan to put RM with
> one of NN)
> 2, if the RAM is enough for RM + NN machine?
> 3,RAID is need for NN machine?
> 4,is it ok if i place JN on other node(DN or NN)
> 5, how much zookeeper server node i need?
> 6,i want to place yarn proxy server and mapreduce history server with
> another NN,is it ok?
>
>
>
>
>