Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: Calling the JobTracker from Reducer throws InvalidCredentials GSSException


Copy link to this message
-
Re: Calling the JobTracker from Reducer throws InvalidCredentials GSSException
You'll need to reuse the security tokens of the current job to
communicate without requiring a re-auth from the task. See the
specific code snippet (of what Oozie does for similar goals) at
https://github.com/apache/oozie/blob/release-4.0.0/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/MapReduceMain.java#L90
and also see MAPREDUCE-4324.

On Sat, Sep 28, 2013 at 2:43 AM, Manish Verma
<[EMAIL PROTECTED]> wrote:
> I am trying to get the job tracker counters in my reducer. It works on
> single node demo hadoop but fails on a real cluster where kerberos is used
> for authentication.
>
> ********************************************
> RunningJob parentJob >                     client.getJob(JobID.forName(
> context.getConfiguration().get("mapred.job.id") ));
>
> Counters counters = parentJob.getCounters();
> ********************************************
>
> The call to getCounter() API throws GSSException (No valid credentials
> provided - Failed to find any kerberos tgt).
>
> I launched this job using hadoop jar command.
>
> Any help would be much appreciated.
>
> Thanks
> Manish
>

--
Harsh J