Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> multiple hadoop instances on same cluster

Copy link to this message
Re: multiple hadoop instances on same cluster
Make sure the instances' ports aren't conflicting and all directories
(NN, JT, etc.) are unique. That should do it.
  Take care,
Konstantin (Cos) Boudnik

On Mon, Feb 21, 2011 at 20:09, Gang Luo <[EMAIL PROTECTED]> wrote:
> Hello folks,
> I am trying to run multiple hadoop instances on the same cluster. I find it hard
> to share. First I try two  instances, each of them run with the same master and
> slaves. Only one of them could work. I try to divide the cluster such that
> hadoop 1 use machine 0-9 and hadoop 2 uses machine 10-19. Still, only one of
> them could work. The HDFS of the second hadoop is working well, but
> start-mapred.sh will result in such exception "java.io.IOException: Connection
> reset by peer" in the log.
> Any ideas on this or suggestion on how to run multiple hadoop instance on one
> cluster? I can total divide up the cluster such that different instances run on
> different set of machines.
> Thanks.
> -Gang