I am trying to register ApplicationMaster to a remote YARN cluster and I get
Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): SIMPLE authentication is not enabled. Available:[TOKEN]
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke( ProtobufRpcEngine.java:206)
at com.sun.proxy.$Proxy7.registerApplicationMaster(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationMasterProtocolPBClientImpl.registerApplicationMaster( ApplicationMasterProtocolPBClientImpl.java:106) My security is explicitly set to SIMPLE and I can see it in my logs:
org.apache.hadoop.ipc.Server: Server accepts auth methods:[TOKEN, SIMPLE]
What is unclear is why [TOKEN] get's there and when I say unclear, its actually very clear from the ipc Server code. The real question is why TOKEN is hard coded there in the first place for the cases when Secret Manager is present. Which also raises another question; How to disable Secret Manager.
There was a bug around this message that was fixed. I found another bug I forgot to report. If your system is using ipv6 yarn get get confused over the source/destination ips and throw this message at you. You can go in your configuration files and specific a specfic address to bind. You can also go into your hostfile and ensure localhost does not refer to an ipv6 address. Java also has a -D switch like preferIPV4 or something like that. On Sat, Mar 15, 2014 at 4:18 PM, Oleg Zhurakousky < [EMAIL PROTECTED]> wrote:
I meet the same issue when I start an unmanaged AM in client side in thread way. The issue is in the code of hadoop-common-yarn. You could try to use the code of hadoop-common-yarn of 2.3 instead of 2.2 This resolve my problem at least. On Sun, Mar 16, 2014 at 5:56 AM, Oleg Zhurakousky < [EMAIL PROTECTED]> wrote:
Oleg On Sun, Mar 16, 2014 at 10:29 AM, Oleg Zhurakousky < [EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext