Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Submitting mapreduce and nothing happens


Copy link to this message
-
Submitting mapreduce and nothing happens
Amit Sela 2013-04-15, 10:06
Hi all,

I'm trying to submit a mapreduce job remotely using job.submit()

I get the following:

[WARN ] org.apache.hadoop.mapred.JobClient       » Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
[INFO ] org.apache.hadoop.mapred.JobClient       » Cleaning up the staging
area hdfs://{namenode
address}:{port}{hadoop.tmp.dir}/mapred/staging/myusername/.staging/job_201304150711_0022

and nothing happens...

I set the the mapred.job.tracker and changed permissions
for hadoop.tmp.dir. I also set "hadoop.job.ugi" as "hadoop,supergroup" but
some how I think that it's not making any difference.
The system submitting the job is running with another user, call it:
myusername and not hadoop.

I believe it is related to the user permissions but I can't seem to get it
right.

Thanks for the help,

Amit.