Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> running local hadoop job in windows


Copy link to this message
-
Re: running local hadoop job in windows
Now I AM running under cygwin, and I get the same error, as you can see from
the attached screenshot.

Thank you,
Mark

On Sat, Mar 19, 2011 at 9:16 PM, Simon <[EMAIL PROTECTED]> wrote:

> As far as I know, currently hadoop can only run under *nix like systems.
> Correct me if I am wrong.
> And if you want to run it under windows, you can try cygwin as the
> environment.
>
> Thanks
> Simon
>
> On Fri, Mar 18, 2011 at 7:11 PM, Mark Kerzner <[EMAIL PROTECTED]>
> wrote:
>
> > No, I hoped that it is not absolutely necessary for that kind of use. I
> am
> > not even issuing the "hadoop -jar" command, but it is pure "java -jar".
> It
> > is true though that my Ubuntu has a Hadoop set up, so maybe it is doing a
> > lot of magic behind my back.
> >
> > I did not want to have my inexperienced Windows users to have to install
> > cygwin for just trying the package.
> >
> > Thank you,
> > Mark
> >
> > On Fri, Mar 18, 2011 at 6:06 PM, Stephen Boesch <[EMAIL PROTECTED]>
> wrote:
> >
> > > presumably you ran this under cygwin?
> > >
> > > 2011/3/18 Mark Kerzner <[EMAIL PROTECTED]>
> > >
> > > > Hi, guys,
> > > >
> > > > I want to give my users a sense of what my hadoop application can do,
> > and
> > > I
> > > > am trying to make it run in Windows, with this command
> > > >
> > > > java -jar dist\FreeEed.jar
> > > >
> > > > This command runs my hadoop job locally, and it works in Linux.
> > However,
> > > in
> > > > Windows I get the error listed below. Since I am running completely
> > > > locally,
> > > > I don't see why it is trying to do what it does. Is there a
> workaround?
> > > >
> > > > Thank you,
> > > > Mark
> > > >
> > > > Error:
> > > >
> > > > 11/03/18 17:57:43 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> > > > processName
> > > > =JobTracker, sessionId> > > > java.io.IOException: Failed to set permissions of path:
> > > > file:/tmp/hadoop-Mark/ma
> > > > pred/staging/Mark-1397630897/.staging to 0700
> > > >        at
> > > > org.apache.hadoop.fs.RawLocalFileSystem.checkReturnValue(RawLocalFile
> > > > System.java:526)
> > > >        at
> > > > org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSys
> > > > tem.java:500)
> > > >        at
> > > > org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.jav
> > > > a:310)
> > > >        at
> > > > org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:18
> > > > 9)
> > > >        at
> > > > org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmi
> > > > ssionFiles.java:116)
> > > >        at
> org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:799)
> > > >        at
> org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:793)
> > > >        at java.security.AccessController.doPrivileged(Native Method)
> > > >        at javax.security.auth.Subject.doAs(Unknown Source)
> > > >        at
> > > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma
> > > > tion.java:1063)
> > > >        at
> > > > org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:7
> > > > 93)
> > > >        at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
> > > >        at
> > org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)
> > > >        at org.freeeed.main.FreeEedProcess.run(FreeEedProcess.java:66)
> > > >        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> > > >        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> > > >        at
> org.freeeed.main.FreeEedProcess.main(FreeEedProcess.java:71)
> > > >        at
> > org.freeeed.main.FreeEedMain.runProcessing(FreeEedMain.java:88)
> > > >        at
> > > org.freeeed.main.FreeEedMain.processOptions(FreeEedMain.java:65)
> > > >        at org.freeeed.main.FreeEedMain.main(FreeEedMain.java:31)
> > > >
> > >
> >
>
>
>
> --
> Regards,
> Simon
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB