Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> EC2 cloudera cc1.4xlarge


Copy link to this message
-
Re: EC2 cloudera cc1.4xlarge
Try cloudera specific lisls with your questions.
--
  Take care,
Konstantin (Cos) Boudnik
2CAC 8312 4870 D885 8616  6115 220F 6980 1F27 E622

Disclaimer: Opinions expressed in this email are those of the author,
and do not necessarily represent the views of any company the author
might be affiliated with at the moment of writing.

On Tue, May 24, 2011 at 16:23, Aleksandr Elbakyan <[EMAIL PROTECTED]> wrote:
> Hello,
>
> I am want to use cc1.4xlarge cluster for some data processing, to spin clusters I am using cloudera scripts. hadoop-ec2-init-remote.sh has default configuration until c1.xlarge but not configuration for cc1.4xlarge, can someone give formula how does this values calculated based on hardware?
>
> C1.XLARGE
>     MAX_MAP_TASKS=8 -  mapred.tasktracker.map.tasks.maximum
>     MAX_REDUCE_TASKS=4 - mapred.tasktracker.reduce.tasks.maximum
>     CHILD_OPTS=-Xmx680m - mapred.child.java.opts
>     CHILD_ULIMIT=1392640 - mapred.child.ulimit
>
> I am guessing but I think
>
> CHILD_OPTS = (total ram on the box - 1gb) /(MAX_MAP_TASKS, MAX_REDUCE_TASKS)
>
> But not sure how to calculate rest
>
> Regards,
> Aleksandr
>
>
>