Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> running local hadoop job in windows


Copy link to this message
-
running local hadoop job in windows
Hi, guys,

I want to give my users a sense of what my hadoop application can do, and I
am trying to make it run in Windows, with this command

java -jar dist\FreeEed.jar

This command runs my hadoop job locally, and it works in Linux. However, in
Windows I get the error listed below. Since I am running completely locally,
I don't see why it is trying to do what it does. Is there a workaround?

Thank you,
Mark

Error:

11/03/18 17:57:43 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName
=JobTracker, sessionIdjava.io.IOException: Failed to set permissions of path:
file:/tmp/hadoop-Mark/ma
pred/staging/Mark-1397630897/.staging to 0700
        at
org.apache.hadoop.fs.RawLocalFileSystem.checkReturnValue(RawLocalFile
System.java:526)
        at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSys
tem.java:500)
        at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.jav
a:310)
        at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:18
9)
        at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmi
ssionFiles.java:116)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:799)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:793)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Unknown Source)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma
tion.java:1063)
        at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:7
93)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)
        at org.freeeed.main.FreeEedProcess.run(FreeEedProcess.java:66)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.freeeed.main.FreeEedProcess.main(FreeEedProcess.java:71)
        at org.freeeed.main.FreeEedMain.runProcessing(FreeEedMain.java:88)
        at org.freeeed.main.FreeEedMain.processOptions(FreeEedMain.java:65)
        at org.freeeed.main.FreeEedMain.main(FreeEedMain.java:31)