Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Exception while running a Hadoop example on a standalone install on Windows 7


+
Udayini Pendyala 2012-09-04, 12:46
+
Visioner Sadak 2012-09-05, 06:51
Copy link to this message
-
Re: Exception while running a Hadoop example on a standalone install on Windows 7
Though I agree with others that it would probably be easier to get Hadoop
up and running on Unix based systems, couldn't help notice that this path:

 \tmp \hadoop-upendyal\mapred\staging\upendyal-1075683580\.staging

seems to have a space in the first component i.e '\tmp ' and not '\tmp'. Is
that a copy paste issue, or is it really the case. Again, not sure if it
could cause the specific error you're seeing, but could try removing the
space if it does exist. Also assuming that you've set up Cygwin etc. if you
still want to try out on Windows.

Thanks
hemanth

On Wed, Sep 5, 2012 at 12:12 AM, Marcos Ortiz <[EMAIL PROTECTED]> wrote:

>
> On 09/04/2012 02:35 PM, Udayini Pendyala wrote:
>
>   Hi Bejoy,
>
> Thanks for your response. I first started to install on Ubuntu Linux and
> ran into a bunch of problems. So, I wanted to back off a bit and try
> something simple first. Hence, my attempt to install on my Windows 7 Laptop.
>
> Well, if you tell to us the problems that you have in Ubuntu, we can give
> you a hand.
> Michael Noll have great tutorials for this:
>
> Running Hadoop on Ubuntu Linux (Single node cluster)
>
> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
>
> Running Hadoop on Ubuntu Linux (Multi node cluster)
>
> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/
>
>
> I am doing the "standalone" mode - as per the documentation (link in my
> original email), I don't need ssh unless I am doing the distributed mode.
> Is that not correct?
>
> Yes, but I give you the same recommendation that Bejoy said to you: Use a
> Unix-based platform for Hadoop, it's more tested and have better
> performance than Windows.
>
> Best wishes
>
>
> Thanks again for responding
> Udayini
>
>
> --- On *Tue, 9/4/12, Bejoy Ks <[EMAIL PROTECTED]><[EMAIL PROTECTED]>
> * wrote:
>
>
> From: Bejoy Ks <[EMAIL PROTECTED]> <[EMAIL PROTECTED]>
> Subject: Re: Exception while running a Hadoop example on a standalone
> install on Windows 7
> To: [EMAIL PROTECTED]
> Date: Tuesday, September 4, 2012, 11:11 AM
>
> Hi Udayani
>
>  By default hadoop works well for linux and linux based OS. Since you are
> on Windows you need to install and configure ssh using cygwin before you
> start hadoop daemons.
>
>  On Tue, Sep 4, 2012 at 6:16 PM, Udayini Pendyala <
> [EMAIL PROTECTED]<http://mc/compose?[EMAIL PROTECTED]>
> > wrote:
>
>   Hi,
>
>
>  Following is a description of what I am trying to do and the steps I
> followed.
>
>
>  GOAL:
>
> a). Install Hadoop 1.0.3
>
> b). Hadoop in a standalone (or local) mode
>
> c). OS: Windows 7
>
>
>  STEPS FOLLOWED:
>
> 1.    1.   I followed instructions from:
> http://www.oreillynet.com/pub/a/other-programming/excerpts/hadoop-tdg/installing-apache-hadoop.html.
> Listing the steps I did -
>
> a.       I went to: http://hadoop.apache.org/core/releases.html.
>
> b.      I installed hadoop-1.0.3 by downloading “hadoop-1.0.3.tar.gz” and
> unzipping/untarring the file.
>
> c.       I installed JDK 1.6 and set up JAVA_HOME to point to it.
>
> d.      I set up HADOOP_INSTALL to point to my Hadoop install location. I
> updated my PATH variable to have $HADOOP_INSTALL/bin
>
> e.      After the above steps, I ran the command: “hadoop version” and
> got the following information:
>
> $ hadoop version
>
> Hadoop 1.0.3
>
> Subversion
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
> 1335192
>
> Compiled by hortonfo on Tue May 8 20:31:25 UTC 2012
>
> From source with checksum e6b0c1e23dcf76907c5fecb4b832f3be
>
>
>
> 2.      2.  The standalone was very easy to install as described above.
> Then, I tried to run a sample command as given in:
>
> http://hadoop.apache.org/common/docs/r0.17.2/quickstart.html#Local
>
> Specifically, the steps followed were:
>
> a.       cd $HADOOP_INSTALL
>
> b.      mkdir input
>
> c.       cp conf/*.xml input
>
> d.      bin/hadoop jar hadoop-examples-1.0.3.jar grep input output
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB