Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> running local hadoop job in windows


Copy link to this message
-
running local hadoop job in windows
Hi, guys,

I want to give my users a sense of what my hadoop application can do, and I
am trying to make it run in Windows, with this command

java -jar dist\FreeEed.jar

This command runs my hadoop job locally, and it works in Linux. However, in
Windows I get the error listed below. Since I am running completely locally,
I don't see why it is trying to do what it does. Is there a workaround?

Thank you,
Mark

Error:

11/03/18 17:57:43 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName
=JobTracker, sessionIdjava.io.IOException: Failed to set permissions of path:
file:/tmp/hadoop-Mark/ma
pred/staging/Mark-1397630897/.staging to 0700
        at
org.apache.hadoop.fs.RawLocalFileSystem.checkReturnValue(RawLocalFile
System.java:526)
        at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSys
tem.java:500)
        at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.jav
a:310)
        at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:18
9)
        at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmi
ssionFiles.java:116)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:799)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:793)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Unknown Source)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma
tion.java:1063)
        at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:7
93)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)
        at org.freeeed.main.FreeEedProcess.run(FreeEedProcess.java:66)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.freeeed.main.FreeEedProcess.main(FreeEedProcess.java:71)
        at org.freeeed.main.FreeEedMain.runProcessing(FreeEedMain.java:88)
        at org.freeeed.main.FreeEedMain.processOptions(FreeEedMain.java:65)
        at org.freeeed.main.FreeEedMain.main(FreeEedMain.java:31)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB