Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - HELP - Problem in setting up Hadoop - Multi-Node Cluster
Guruprasad B
2012-02-08, 12:06
Robin Mueller-Bady
2012-02-08, 19:36
hadoop hive
2012-02-09, 10:11
alo alt
2012-02-09, 10:40
15club.cn
2012-02-09, 13:51
Anil Gupta
2012-02-09, 19:42
Guruprasad B
2012-02-10, 09:43
anil gupta
2012-02-11, 01:31
Copy link to this message
-
Re: HELP - Problem in setting up Hadoop - Multi-Node Cluster
anil gupta 2012-02-09, 19:45
This post might be helpful for u:
https://groups.google.com/a/cloudera.org/group/cdh-user/browse_thread/thread/4165f39d8b0bbc56

On Thu, Feb 9, 2012 at 11:42 AM, Anil Gupta <[EMAIL PROTECTED]> wrote:

> Hi,
> I have dealt with this kind of this problem earlier.
> Check the logs of datanode as well as namenode.
>
> In order to test the connectivity:
> ssh into slave from master and ssh into master from the same slave. Leave
> the ssh session open for as long as u can.
>
> In my case when I did the above experiment the ssh session was dropping so
> I got to know that it's a network related problem. It has got nothing to do
> with Hadoop.
>
> Best Regards,
> Anil
>
> On Feb 9, 2012, at 5:51 AM, "15club.cn" <[EMAIL PROTECTED]> wrote:
>
> > Maybe, check your iptables first. For hadoop on multi-machines, do shut
> > down iptables. And it will block the connections between all the nodes.
> > #/etc/init.d/iptables stop
> >
> > 2012/2/9 alo alt <[EMAIL PROTECTED]>
> >
> >> Please use jdk 6 latest.
> >>
> >> best,
> >> Alex
> >>
> >> --
> >> Alexander Lorenz
> >> http://mapredit.blogspot.com
> >>
> >> On Feb 9, 2012, at 11:11 AM, hadoop hive wrote:
> >>
> >>> did you make check the ssh between localhost means its should be ssh
> >> password less between localhost
> >>>
> >>> public-key =authorized_key
> >>>
> >>> On Thu, Feb 9, 2012 at 1:06 AM, Robin Mueller-Bady <
> >> [EMAIL PROTECTED]> wrote:
> >>> Dear Guruprasad,
> >>>
> >>> it would be very helpful to provide details from your configuration
> >> files as well as more details on your setup.
> >>> It seems to be that the connection from slave to master cannot be
> >> established ("Connection reset by peer").
> >>> Do you use a virtual environment, physical master/slaves or all on one
> >> machine ?
> >>> Please paste also the output of "kingul2" namenode logs.
> >>>
> >>> Regards,
> >>>
> >>> Robin
> >>>
> >>>
> >>> On 02/08/12 13:06, Guruprasad B wrote:
> >>>> Hi,
> >>>>
> >>>> I am Guruprasad from Bangalore (India). I need help in setting up
> hadoop
> >>>> platform. I am very much new to Hadoop Platform.
> >>>>
> >>>> I am following the below given articles and I was able to set up
> >>>> "Single-Node Cluster
> >>>> "
> >>>>
> >>
> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/#what-we-want-to-do
> >>>>
> >>>> Now I am trying to set up "
> >>>> Multi-Node Cluster" by following the below given
> >>>> article.
> >>>>
> >>>>
> >>
> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/
> >>>>
> >>>>
> >>>> Below given is my setup:
> >>>> Hadoop : hadoop_0.20.2
> >>>> Linux: Ubuntu Linux 10.10
> >>>> Java: java-7-oracle
> >>>>
> >>>>
> >>>> I have successfully reached till the topic "Starting the multi-node
> >>>> cluster" in the above given article.
> >>>> When I start the HDFS/MapReduce daemons it is getting started and
> going
> >>>> down immediately both in master & slave as well,
> >>>> please have a look at the below logs,
> >>>>
> >>>> hduser@kinigul2:/usr/local/hadoop$ bin/start-dfs.sh
> >>>> starting namenode, logging to
> >>>> /usr/local/hadoop/bin/../logs/hadoop-hduser-namenode-kinigul2.out
> >>>> master: starting datanode, logging to
> >>>> /usr/local/hadoop/bin/../logs/hadoop-hduser-datanode-kinigul2.out
> >>>> slave: starting datanode, logging to
> >>>> /usr/local/hadoop/bin/../logs/hadoop-hduser-datanode-guruL.out
> >>>> master: starting secondarynamenode, logging to
> >>>>
> >>
> /usr/local/hadoop/bin/../logs/hadoop-hduser-secondarynamenode-kinigul2.out
> >>>>
> >>>> hduser@kinigul2:/usr/local/hadoop$ jps
> >>>> 6098 DataNode
> >>>> 6328 Jps
> >>>> 5914 NameNode
> >>>> 6276 SecondaryNameNode
> >>>>
> >>>> hduser@kinigul2:/usr/local/hadoop$ jps
> >>>> 6350 Jps
> >>>>
> >>>>
> >>>> I am getting below given error in slave logs:
> >>>>
> >>>> 2012-02-08 21:04:01,641 ERROR
> >>>> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> >> Call
> >>>> to master/

Thanks & Regards,
Anil Gupta