Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> RE: Oozie workflow error - renewing token issue


Copy link to this message
-
Re: Oozie workflow error - renewing token issue
Hey Daryn and Oozie folks as well,

I've reported this issue as
https://issues.apache.org/jira/browse/HADOOP-9461, posting as I
figured you may be interested in it (Oozie gets affected on the
outcome).

On Thu, Jan 31, 2013 at 2:36 AM, Daryn Sharp <[EMAIL PROTECTED]> wrote:
> The token renewer needs to be the job tracker principal.  I think oozie had
> "mr token" hardcoded at one point, but later changed it to use a conf
> setting.
>
> The rest of the log looks very odd - ie. it looks like security is off, but
> it can't be.  It's trying to renew hdfs tokens issued for the "hdfs"
> superuser.  Are you running your job as hdfs?  With security enabled, the
> container executor won't run jobs for hdfs…  It's also trying to renew as
> "mapred (auth:SIMPLE)".  SIMPLE means that security is disabled, which
> doesn't make sense since tokens require kerberos.
>
> The cannot find renewer class for MAPREDUCE_DELEGATION_TOKEN is also odd
> because it did subsequently try to renew the token.
>
> Daryn
>
>
>
> On Jan 30, 2013, at 2:14 PM, Alejandro Abdelnur wrote:
>
> Cobert,
>
> [Moving thread to user@oozie.a.o, BCCing common-user@hadoop.a.o]
>
> * What version of Oozie are you using?
> * Is the cluster a secure setup (Kerberos enabled)?
> * Would you mind posting the complete launcher logs?
>
> Thx
>
>
>
> On Wed, Jan 30, 2013 at 6:14 AM, Corbett Martin <[EMAIL PROTECTED]> wrote:
>>
>> Thanks for the tip.
>>
>> The sqoop command listed in the stdout log file is:
>>                     sqoop
>>                     import
>>                     --driver
>>                     org.apache.derby.jdbc.ClientDriver
>>                     --connect
>>                     jdbc:derby://test-server:1527/mondb
>>                     --username
>>                     monuser
>>                     --password
>>                     xxxxxxxxx
>>                     --table
>>                     MONITOR
>>                     --split-by
>>                     request_id
>>                     --target-dir
>>                     /mon/import
>>                     --append
>>                     --incremental
>>                     append
>>                     --check-column
>>                     request_id
>>                     --last-value
>>                     2000000
>>
>> The following information is from the sterr and stdout log files.
>>
>>
>> /var/log/hadoop-0.20-mapreduce/userlogs/job_201301231648_0029/attempt_201301231648_0029_m_000000_0
>> # more stderr
>> No such sqoop tool: sqoop. See 'sqoop help'.
>> Intercepting System.exit(1)
>> Failing Oozie Launcher, Main class
>> [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
>>
>>
>>
>> /var/log/hadoop-0.20-mapreduce/userlogs/job_201301231648_0029/attempt_201301231648_0029_m_000000_0
>> # more stdout
>> ...
>> ...
>> ...
>> >>> Invoking Sqoop command line now >>>
>>
>> 1598 [main] WARN  org.apache.sqoop.tool.SqoopTool  - $SQOOP_CONF_DIR has
>> not been set in the environment. Cannot check for additional configuration.
>> Intercepting System.exit(1)
>>
>> <<< Invocation of Main class completed <<<
>>
>> Failing Oozie Launcher, Main class
>> [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
>>
>> Oozie Launcher failed, finishing Hadoop job gracefully
>>
>> Oozie Launcher ends
>>
>>
>> ~Corbett Martin
>> Software Architect
>> AbsoluteAR Accounts Receivable Services - An NHIN Solution
>>
>> -----Original Message-----
>> From: Harsh J [mailto:[EMAIL PROTECTED]]
>> Sent: Tuesday, January 29, 2013 10:11 PM
>> To: <[EMAIL PROTECTED]>
>> Subject: Re: Oozie workflow error - renewing token issue
>>
>> The job that Oozie launches for your action, which you are observing is
>> failing, does its own logs (task logs) show any errors?
>>
>> On Wed, Jan 30, 2013 at 4:59 AM, Corbett Martin <[EMAIL PROTECTED]> wrote:
>> > Oozie question
>> >
>> >
>> >
>> > I'm trying to run an Oozie workflow (sqoop action) from the Hue
>> > console and it fails every time.  No exception in the oozie log but I

Harsh J