Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Submitting mapreduce and nothing happens


Copy link to this message
-
Re: Submitting mapreduce and nothing happens
Input path includes data in it. I also tried job.waitFromComplete(true) but
it acts exactly the same.
For what it's worth, in the staging dir in hdfs I do see empty (or cleaned
up) folders created with the correct JT ID and with an incremented count:
job_201304150711_01, job_201304150711_02....job_201304150711_37 while the
webapp shows 11 submissions that were actually executed (not remotely...)
On Wed, Apr 17, 2013 at 6:40 AM, Zizon Qiu <[EMAIL PROTECTED]> wrote:

> try use job.waitFromComplete(true) instead of job.submit().
> it should show more details.
>
>
> On Mon, Apr 15, 2013 at 6:06 PM, Amit Sela <[EMAIL PROTECTED]> wrote:
>
>> Hi all,
>>
>> I'm trying to submit a mapreduce job remotely using job.submit()
>>
>> I get the following:
>>
>> [WARN ] org.apache.hadoop.mapred.JobClient       » Use
>> GenericOptionsParser for parsing the arguments. Applications should
>> implement Tool for the same.
>> [INFO ] org.apache.hadoop.mapred.JobClient       » Cleaning up the
>> staging area hdfs://{namenode
>> address}:{port}{hadoop.tmp.dir}/mapred/staging/myusername/.staging/job_201304150711_0022
>>
>> and nothing happens...
>>
>> I set the the mapred.job.tracker and changed permissions
>> for hadoop.tmp.dir. I also set "hadoop.job.ugi" as "hadoop,supergroup" but
>> some how I think that it's not making any difference.
>> The system submitting the job is running with another user, call it:
>> myusername and not hadoop.
>>
>> I believe it is related to the user permissions but I can't seem to get
>> it right.
>>
>> Thanks for the help,
>>
>> Amit.
>>
>>
>