Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: Exception while running a Hadoop example on a standalone install on Windows 7


Copy link to this message
-
Re: Exception while running a Hadoop example on a standalone install on Windows 7

On 09/04/2012 02:35 PM, Udayini Pendyala wrote:
> Hi Bejoy,
>
> Thanks for your response. I first started to install on Ubuntu Linux
> and ran into a bunch of problems. So, I wanted to back off a bit and
> try something simple first. Hence, my attempt to install on my Windows
> 7 Laptop.
>
Well, if you tell to us the problems that you have in Ubuntu, we can
give you a hand.
Michael Noll have great tutorials for this:

Running Hadoop on Ubuntu Linux (Single node cluster)
http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/

Running Hadoop on Ubuntu Linux (Multi node cluster)
http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/
>
> I am doing the "standalone" mode - as per the documentation (link in
> my original email), I don't need ssh unless I am doing the distributed
> mode. Is that not correct?
>
Yes, but I give you the same recommendation that Bejoy said to you: Use
a Unix-based platform for Hadoop, it's more tested and have better
performance than Windows.

Best wishes
>
> Thanks again for responding
> Udayini
>
>
> --- On *Tue, 9/4/12, Bejoy Ks /<[EMAIL PROTECTED]>/* wrote:
>
>
>     From: Bejoy Ks <[EMAIL PROTECTED]>
>     Subject: Re: Exception while running a Hadoop example on a
>     standalone install on Windows 7
>     To: [EMAIL PROTECTED]
>     Date: Tuesday, September 4, 2012, 11:11 AM
>
>     Hi Udayani
>
>     By default hadoop works well for linux and linux based OS. Since
>     you are on Windows you need to install and configure ssh using
>     cygwin before you start hadoop daemons.
>
>     On Tue, Sep 4, 2012 at 6:16 PM, Udayini Pendyala
>     <[EMAIL PROTECTED]
>     </mc/compose?[EMAIL PROTECTED]>> wrote:
>
>         Hi,
>
>
>         Following is a description of what I am trying to do and the
>         steps I followed.
>
>
>         GOAL:
>
>         a). Install Hadoop 1.0.3
>
>         b). Hadoop in a standalone (or local) mode
>
>         c). OS: Windows 7
>
>
>         STEPS FOLLOWED:
>
>         1.    1. I followed instructions from:
>         http://www.oreillynet.com/pub/a/other-programming/excerpts/hadoop-tdg/installing-apache-hadoop.html.
>         Listing the steps I did -
>
>         a.I went to: http://hadoop.apache.org/core/releases.html.
>
>         b.I installed hadoop-1.0.3 by downloading
>         “hadoop-1.0.3.tar.gz” and unzipping/untarring the file.
>
>         c.I installed JDK 1.6 and set up JAVA_HOME to point to it.
>
>         d.I set up HADOOP_INSTALL to point to my Hadoop install
>         location. I updated my PATH variable to have $HADOOP_INSTALL/bin
>
>         e.After the above steps, I ran the command: “hadoop version”
>         and got the following information:
>
>         $ hadoop version
>
>         Hadoop 1.0.3
>
>         Subversion
>         https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>         -r 1335192
>
>         Compiled by hortonfo on Tue May 8 20:31:25 UTC 2012
>
>         From source with checksum e6b0c1e23dcf76907c5fecb4b832f3be
>
>         2.      2. The standalone was very easy to install as
>         described above. Then, I tried to run a sample command as
>         given in:
>
>         http://hadoop.apache.org/common/docs/r0.17.2/quickstart.html#Local
>
>         Specifically, the steps followed were:
>
>         a.cd $HADOOP_INSTALL
>
>         b.mkdir input
>
>         c.cp conf/*.xml input
>
>         d.bin/hadoop jar hadoop-examples-1.0.3.jar grep input output
>         ‘dfs[a-z.]+’
>
>         and got the following error:
>
>         $ bin/hadoop jar hadoop-examples-1.0.3.jar grep input output
>         'dfs[a-z.]+'
>
>         12/09/03 15:41:57 WARN util.NativeCodeLoader: Unable to load
>         native-hadoop libra ry for your platform... using builtin-java
>         classes where applicable
>
>         12/09/03 15:41:57 ERROR security.UserGroupInformation:
>         PriviledgedActionExceptio n as:upendyal
Marcos Luis Ortíz Valmaseda
*Data Engineer && Sr. System Administrator at UCI*
about.me/marcosortiz <http://about.me/marcosortiz>
My Blog <http://marcosluis2186.posterous.com>
@marcosluis2186 <http://twitter.com/marcosluis2186>

10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION

http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci