Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> HELP - Problem in setting up Hadoop - Multi-Node Cluster


Copy link to this message
-
Re: HELP - Problem in setting up Hadoop - Multi-Node Cluster
This post might be helpful for u:
https://groups.google.com/a/cloudera.org/group/cdh-user/browse_thread/thread/4165f39d8b0bbc56

On Thu, Feb 9, 2012 at 11:42 AM, Anil Gupta <[EMAIL PROTECTED]> wrote:

> Hi,
> I have dealt with this kind of this problem earlier.
> Check the logs of datanode as well as namenode.
>
> In order to test the connectivity:
> ssh into slave from master and ssh into master from the same slave. Leave
> the ssh session open for as long as u can.
>
> In my case when I did the above experiment the ssh session was dropping so
> I got to know that it's a network related problem. It has got nothing to do
> with Hadoop.
>
> Best Regards,
> Anil
>
> On Feb 9, 2012, at 5:51 AM, "15club.cn" <[EMAIL PROTECTED]> wrote:
>
> > Maybe, check your iptables first. For hadoop on multi-machines, do shut
> > down iptables. And it will block the connections between all the nodes.
> > #/etc/init.d/iptables stop
> >
> > 2012/2/9 alo alt <[EMAIL PROTECTED]>
> >
> >> Please use jdk 6 latest.
> >>
> >> best,
> >> Alex
> >>
> >> --
> >> Alexander Lorenz
> >> http://mapredit.blogspot.com
> >>
> >> On Feb 9, 2012, at 11:11 AM, hadoop hive wrote:
> >>
> >>> did you make check the ssh between localhost means its should be ssh
> >> password less between localhost
> >>>
> >>> public-key =authorized_key
> >>>
> >>> On Thu, Feb 9, 2012 at 1:06 AM, Robin Mueller-Bady <
> >> [EMAIL PROTECTED]> wrote:
> >>> Dear Guruprasad,
> >>>
> >>> it would be very helpful to provide details from your configuration
> >> files as well as more details on your setup.
> >>> It seems to be that the connection from slave to master cannot be
> >> established ("Connection reset by peer").
> >>> Do you use a virtual environment, physical master/slaves or all on one
> >> machine ?
> >>> Please paste also the output of "kingul2" namenode logs.
> >>>
> >>> Regards,
> >>>
> >>> Robin
> >>>
> >>>
> >>> On 02/08/12 13:06, Guruprasad B wrote:
> >>>> Hi,
> >>>>
> >>>> I am Guruprasad from Bangalore (India). I need help in setting up
> hadoop
> >>>> platform. I am very much new to Hadoop Platform.
> >>>>
> >>>> I am following the below given articles and I was able to set up
> >>>> "Single-Node Cluster
> >>>> "
> >>>>
> >>
> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/#what-we-want-to-do
> >>>>
> >>>> Now I am trying to set up "
> >>>> Multi-Node Cluster" by following the below given
> >>>> article.
> >>>>
> >>>>
> >>
> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/
> >>>>
> >>>>
> >>>> Below given is my setup:
> >>>> Hadoop : hadoop_0.20.2
> >>>> Linux: Ubuntu Linux 10.10
> >>>> Java: java-7-oracle
> >>>>
> >>>>
> >>>> I have successfully reached till the topic "Starting the multi-node
> >>>> cluster" in the above given article.
> >>>> When I start the HDFS/MapReduce daemons it is getting started and
> going
> >>>> down immediately both in master & slave as well,
> >>>> please have a look at the below logs,
> >>>>
> >>>> hduser@kinigul2:/usr/local/hadoop$ bin/start-dfs.sh
> >>>> starting namenode, logging to
> >>>> /usr/local/hadoop/bin/../logs/hadoop-hduser-namenode-kinigul2.out
> >>>> master: starting datanode, logging to
> >>>> /usr/local/hadoop/bin/../logs/hadoop-hduser-datanode-kinigul2.out
> >>>> slave: starting datanode, logging to
> >>>> /usr/local/hadoop/bin/../logs/hadoop-hduser-datanode-guruL.out
> >>>> master: starting secondarynamenode, logging to
> >>>>
> >>
> /usr/local/hadoop/bin/../logs/hadoop-hduser-secondarynamenode-kinigul2.out
> >>>>
> >>>> hduser@kinigul2:/usr/local/hadoop$ jps
> >>>> 6098 DataNode
> >>>> 6328 Jps
> >>>> 5914 NameNode
> >>>> 6276 SecondaryNameNode
> >>>>
> >>>> hduser@kinigul2:/usr/local/hadoop$ jps
> >>>> 6350 Jps
> >>>>
> >>>>
> >>>> I am getting below given error in slave logs:
> >>>>
> >>>> 2012-02-08 21:04:01,641 ERROR
> >>>> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> >> Call
> >>>> to master/

Thanks & Regards,
Anil Gupta
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB