Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> pig and hadoop ACL queues


Copy link to this message
-
pig and hadoop ACL queues
Hi all,

If I try to run a pig script, I get:

Failed Jobs:
JobId   Alias   Feature Message Outputs
N/A     a       MAP_ONLY        Message:
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
User pamartinez cannot perform operation SUBMIT_JOB on queue default.
 Please run "hadoop queue -showacls" command to find the queues you have
access to .
        at
org.apache.hadoop.mapred.ACLsManager.checkAccess(ACLsManager.java:179)
        at
org.apache.hadoop.mapred.ACLsManager.checkAccess(ACLsManager.java:136)
        at
org.apache.hadoop.mapred.ACLsManager.checkAccess(ACLsManager.java:113)
        at
org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3529)
        at
org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3475)
        at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1751)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1747)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1745)

So as suggested I run hadoop queue -showacls, which returns:

$ hadoop queue -showacls
DEPRECATED: Use of this script to execute mapred command is deprecated.
Instead use the mapred command for it.

User pamartinez does not have access to any queue.

I tried to specify an existing queue doing this:
pig -Dmapred.job.queue.name=finetl

And then, trying to run my script I got:
Failed Jobs:
JobId   Alias   Feature Message Outputs
N/A     a       MAP_ONLY        Message:
org.apache.hadoop.ipc.RemoteException(java.io.IOException):
java.lang.NullPointerException
        at
org.apache.hadoop.mapred.QueueManager.getQueueACL(QueueManager.java:382)
        at
org.apache.hadoop.mapred.JobTracker.getQueueAdmins(JobTracker.java:4181)
        at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1751)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1747)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1745)
Any idea how to solve it ?
Thanks a lot in advance,
              pablo