Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> regression in 2.4? YARN severs on secure cluster startup


Copy link to this message
-
Re: regression in 2.4? YARN severs on secure cluster startup
The RM issue should be fixed by YARN-1600 which I just committed this
morning.

Jason

On 01/29/2014 10:33 AM, Steve Loughran wrote:
> I'm just switching over to use the 2.4-SNAPSHOT in a secured pseudo-dist
> cluster, and now the services are failing to come up because the web
> principals haven't been defined. Example
>
>
> 2014-01-29 15:42:58,558 INFO org.apache.hadoop.http.HttpServer2: Added
> filter static_user_filter (class=org.apache.hadoop.ht
> tp.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
> 2014-01-29 15:42:58,559 INFO org.apache.hadoop.http.HttpServer2: Added
> filter static_user_filter (class=org.apache.hadoop.ht
> tp.lib.StaticUserWebFilter$StaticUserFilter) to context static
> 2014-01-29 15:42:58,559 INFO org.apache.hadoop.http.HttpServer2: Added
> filter static_user_filter (class=org.apache.hadoop.ht
> tp.lib.StaticUserWebFilter$StaticUserFilter) to context logs
> 2014-01-29 15:42:58,630 ERROR org.apache.hadoop.http.HttpServer2: *WebHDFS
> and security are enabled, but configuration proper*
> *ty 'dfs.web.authentication.kerberos.principal' is not set.*
> 2014-01-29 15:42:58,630 INFO org.apache.hadoop.http.HttpServer2: Added
> filter 'SPNEGO' (class=org.apache.hadoop.hdfs.web.Aut
> hFilter)
> 2014-01-29 15:42:58,631 INFO org.apache.hadoop.http.HttpServer2:
> addJerseyResourcePackage: packageName=org.apache.hadoop.hdf
> s.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources,
> pathSpec=/webhdfs/v1/*
> 2014-01-29 15:42:58,658 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to getDelegationToken
> 2014-01-29 15:42:58,662 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to renewDelegationToken
> 2014-01-29 15:42:58,663 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to cancelDelegationToken
> 2014-01-29 15:42:58,663 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to fsck
> 2014-01-29 15:42:58,671 INFO org.apache.hadoop.http.HttpServer2: Adding
> Kerberos (SPNEGO) filter to getimage
> 2014-01-29 15:42:58,748 INFO org.apache.hadoop.http.HttpServer2: Jetty
> bound to port 50070
> 2014-01-29 15:42:58,748 INFO org.mortbay.log: jetty-6.1.26
> 2014-01-29 15:42:58,941 INFO
> org.apache.hadoop.security.authentication.server.KerberosAuthenticationHandler:
> Login using key
> tab /home/stevel/conf/hdfs.keytab, for principal HTTP/ubuntu@COTHAM
> 2014-01-29 15:42:58,981 INFO
> org.apache.hadoop.security.authentication.server.KerberosAuthenticationHandler:
> Initialized, pr
> incipal [HTTP/ubuntu@COTHAM] from keytab [/home/stevel/conf/hdfs.keytab]
> 2014-01-29 15:42:58,981 WARN
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> 'signature.secret' confi
> guration not set, using a random value as secret
> 2014-01-29 15:42:58,982 WARN org.mortbay.log: failed SPNEGO:
> javax.servlet.ServletException: javax.servlet.ServletException:
>   Principal not defined in configuration
> 2014-01-29 15:42:58,982 WARN org.mortbay.log: Failed startup of context
> org.mortbay.jetty.webapp.WebAppContext@167a465{/,fil
> e:/home/stevel/hadoop/share/hadoop/hdfs/webapps/hdfs}
> javax.servlet.ServletException: javax.servlet.ServletException: Principal
> not defined in configuration
>          at
> org.apache.hadoop.security.authentication.server.KerberosAuthenticationHandler.init(KerberosAuthenticationHandler
> .java:203)
> :
>
> YARN is the same but without the text telling me what config option I have
> to set (i.e no equivalent of https://issues.apache.org/jira/browse/HDFS-3813)
>
> -29 16:04:33,908 INFO
> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: AMLivelinessMonitor
> thread interrupted
> 2014-01-29 16:04:33,908 INFO
> org.apache.hadoop.yarn.util.AbstractLivelinessMonitor:
> org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer
> thread interrupted
> 2014-01-29 16:04:33,908 ERROR
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB