Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> pig and hadoop ACL queues


Copy link to this message
-
pig and hadoop ACL queues
Hi all,

If I try to run a pig script, I get:

Failed Jobs:
JobId   Alias   Feature Message Outputs
N/A     a       MAP_ONLY        Message:
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
User pamartinez cannot perform operation SUBMIT_JOB on queue default.
 Please run "hadoop queue -showacls" command to find the queues you have
access to .
        at
org.apache.hadoop.mapred.ACLsManager.checkAccess(ACLsManager.java:179)
        at
org.apache.hadoop.mapred.ACLsManager.checkAccess(ACLsManager.java:136)
        at
org.apache.hadoop.mapred.ACLsManager.checkAccess(ACLsManager.java:113)
        at
org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3529)
        at
org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3475)
        at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1751)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1747)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1745)

So as suggested I run hadoop queue -showacls, which returns:

$ hadoop queue -showacls
DEPRECATED: Use of this script to execute mapred command is deprecated.
Instead use the mapred command for it.

User pamartinez does not have access to any queue.

I tried to specify an existing queue doing this:
pig -Dmapred.job.queue.name=finetl

And then, trying to run my script I got:
Failed Jobs:
JobId   Alias   Feature Message Outputs
N/A     a       MAP_ONLY        Message:
org.apache.hadoop.ipc.RemoteException(java.io.IOException):
java.lang.NullPointerException
        at
org.apache.hadoop.mapred.QueueManager.getQueueACL(QueueManager.java:382)
        at
org.apache.hadoop.mapred.JobTracker.getQueueAdmins(JobTracker.java:4181)
        at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1751)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1747)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1745)
Any idea how to solve it ?
Thanks a lot in advance,
              pablo

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB