Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # dev - regression in 2.4? YARN severs on secure cluster startup


Copy link to this message
-
Re: regression in 2.4? YARN severs on secure cluster startup
Jason Lowe 2014-01-29, 17:15
The RM issue should be fixed by YARN-1600 which I just committed this
morning.

Jason

On 01/29/2014 10:33 AM, Steve Loughran wrote:
> I'm just switching over to use the 2.4-SNAPSHOT in a secured pseudo-dist
> cluster, and now the services are failing to come up because the web
> principals haven't been defined. Example
>
>
> 2014-01-29 15:42:58,558 INFO org.apache.hadoop.http.HttpServer2: Added
> filter static_user_filter (class=org.apache.hadoop.ht
> tp.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
> 2014-01-29 15:42:58,559 INFO org.apache.hadoop.http.HttpServer2: Added
> filter static_user_filter (class=org.apache.hadoop.ht
> tp.lib.StaticUserWebFilter$StaticUserFilter) to context static
> 2014-01-29 15:42:58,559 INFO org.apache.hadoop.http.HttpServer2: Added
> filter static_user_filter (class=org.apache.hadoop.ht
> tp.lib.StaticUserWebFilter$StaticUserFilter) to context logs
> 2014-01-29 15:42:58,630 ERROR org.apache.hadoop.http.HttpServer2: *WebHDFS
> and security are enabled, but configuration proper*
> *ty 'dfs.web.authentication.kerberos.principal' is not set.*
> 2014-01-29 15:42:58,630 INFO org.apache.hadoop.http.HttpServer2: Added
> filter 'SPNEGO' (class=org.apache.hadoop.hdfs.web.Aut
> hFilter)
> 2014-01-29 15:42:58,631 INFO org.apache.hadoop.http.HttpServer2:
> addJerseyResourcePackage: packageName=org.apache.hadoop.hdf
> s.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources,
> pathSpec=/webhdfs/v1/*
> 2014-01-29 15:42:58,658 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to getDelegationToken
> 2014-01-29 15:42:58,662 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to renewDelegationToken
> 2014-01-29 15:42:58,663 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to cancelDelegationToken
> 2014-01-29 15:42:58,663 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to fsck
> 2014-01-29 15:42:58,671 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to getimage
> 2014-01-29 15:42:58,748 INFO org.apache.hadoop.http.HttpServer2: Jetty
> bound to port 50070
> 2014-01-29 15:42:58,748 INFO org.mortbay.log: jetty-6.1.26
> 2014-01-29 15:42:58,941 INFO
> org.apache.hadoop.security.authentication.server.KerberosAuthenticationHandler:
> Login using key
> tab /home/stevel/conf/hdfs.keytab, for principal HTTP/ubuntu@COTHAM
> 2014-01-29 15:42:58,981 INFO
> org.apache.hadoop.security.authentication.server.KerberosAuthenticationHandler:
> Initialized, pr
> incipal [HTTP/ubuntu@COTHAM] from keytab [/home/stevel/conf/hdfs.keytab]
> 2014-01-29 15:42:58,981 WARN
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> 'signature.secret' confi
> guration not set, using a random value as secret
> 2014-01-29 15:42:58,982 WARN org.mortbay.log: failed SPNEGO:
> javax.servlet.ServletException: javax.servlet.ServletException:
>   Principal not defined in configuration
> 2014-01-29 15:42:58,982 WARN org.mortbay.log: Failed startup of context
> org.mortbay.jetty.webapp.WebAppContext@167a465{/,fil
> e:/home/stevel/hadoop/share/hadoop/hdfs/webapps/hdfs}
> javax.servlet.ServletException: javax.servlet.ServletException: Principal
> not defined in configuration
>          at
> org.apache.hadoop.security.authentication.server.KerberosAuthenticationHandler.init(KerberosAuthenticationHandler
> .java:203)
> :
>
> YARN is the same but without the text telling me what config option I have
> to set (i.e no equivalent of https://issues.apache.org/jira/browse/HDFS-3813)
>
> -29 16:04:33,908 INFO
> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: AMLivelinessMonitor
> thread interrupted
> 2014-01-29 16:04:33,908 INFO
> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor:
> org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer
> thread interrupted
> 2014-01-29 16:04:33,908 ERROR
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: