Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Oozie workflow error - renewing token issue


Copy link to this message
-
Re: Oozie workflow error - renewing token issue
Cobert,

[Moving thread to user@oozie.a.o, BCCing common-user@hadoop.a.o]

* What version of Oozie are you using?
* Is the cluster a secure setup (Kerberos enabled)?
* Would you mind posting the complete launcher logs?

Thx

On Wed, Jan 30, 2013 at 6:14 AM, Corbett Martin <[EMAIL PROTECTED]> wrote:

> Thanks for the tip.
>
> The sqoop command listed in the stdout log file is:
>                     sqoop
>                     import
>                     --driver
>                     org.apache.derby.jdbc.ClientDriver
>                     --connect
>                     jdbc:derby://test-server:1527/mondb
>                     --username
>                     monuser
>                     --password
>                     xxxxxxxxx
>                     --table
>                     MONITOR
>                     --split-by
>                     request_id
>                     --target-dir
>                     /mon/import
>                     --append
>                     --incremental
>                     append
>                     --check-column
>                     request_id
>                     --last-value
>                     2000000
>
> The following information is from the sterr and stdout log files.
>
> /var/log/hadoop-0.20-mapreduce/userlogs/job_201301231648_0029/attempt_201301231648_0029_m_000000_0
> # more stderr
> No such sqoop tool: sqoop. See 'sqoop help'.
> Intercepting System.exit(1)
> Failing Oozie Launcher, Main class
> [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
>
>
> /var/log/hadoop-0.20-mapreduce/userlogs/job_201301231648_0029/attempt_201301231648_0029_m_000000_0
> # more stdout
> ...
> ...
> ...
> >>> Invoking Sqoop command line now >>>
>
> 1598 [main] WARN  org.apache.sqoop.tool.SqoopTool  - $SQOOP_CONF_DIR has
> not been set in the environment. Cannot check for additional configuration.
> Intercepting System.exit(1)
>
> <<< Invocation of Main class completed <<<
>
> Failing Oozie Launcher, Main class
> [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
>
> Oozie Launcher failed, finishing Hadoop job gracefully
>
> Oozie Launcher ends
>
>
> ~Corbett Martin
> Software Architect
> AbsoluteAR Accounts Receivable Services - An NHIN Solution
>
> -----Original Message-----
> From: Harsh J [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, January 29, 2013 10:11 PM
> To: <[EMAIL PROTECTED]>
> Subject: Re: Oozie workflow error - renewing token issue
>
> The job that Oozie launches for your action, which you are observing is
> failing, does its own logs (task logs) show any errors?
>
> On Wed, Jan 30, 2013 at 4:59 AM, Corbett Martin <[EMAIL PROTECTED]> wrote:
> > Oozie question
> >
> >
> >
> > I'm trying to run an Oozie workflow (sqoop action) from the Hue
> > console and it fails every time.  No exception in the oozie log but I
> > see this in the Job Tracker log file.
> >
> >
> >
> > Two primary issues seem to be
> >
> > 1.   Client mapred tries to renew a token with renewer specified as mr
> token
> >
> >
> >
> > And
> >
> >
> >
> > 2.   Cannot find class for token kind MAPREDUCE_DELEGATION_TOKEN
> >
> >
> >
> > Any ideas how to get past this?
> >
> >
> >
> > Full Stacktrace:
> >
> >
> >
> > 2013-01-29 17:11:28,860 INFO
> >
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
> > Creating password for identifier: owner=hdfs, renewer=mr token,
> > realUser=oozie, issueDate=1359501088860, maxDate=1360105888860,
> > sequenceNumber=75, masterKeyId=8
> >
> > 2013-01-29 17:11:28,871 INFO
> >
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
> > Creating password for identifier: owner=hdfs, renewer=mr token,
> > realUser=oozie, issueDate=1359501088871, maxDate=1360105888871,
> > sequenceNumber=76, masterKeyId=8
> >
> > 2013-01-29 17:11:29,202 INFO
> > org.apache.hadoop.mapreduce.security.token.DelegationTokenRenewal:
> > registering token for renewal for service =10.204.12.62:8021 and jobID
> > > > job_201301231648_0029

Alejandro