Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> RE: Permission problem

Kevin Burton 2013-04-30, 14:55
Arpit Gupta 2013-04-30, 15:01
Kevin Burton 2013-04-30, 15:22
Arpit Gupta 2013-04-30, 15:47
Mohammad Tariq 2013-04-30, 17:06
Copy link to this message
RE: Permission problem
To further complicate the issue the log file in
(/var/log/hadoop-0.20-mapreduce/hadoop-hadoop-jobtracker-devUbuntu05.log) is
owned by mapred:mapred and the name of the file seems to indicate some other
lineage (hadoop,hadoop). I am out of my league in understanding the
permission structure for hadoop hdfs and mr. Ideas?


From: Kevin Burton [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 30, 2013 8:31 AM
Cc: 'Mohammad Tariq'
Subject: RE: Permission problem


That is what I perceive as the problem. The hdfs file system was created
with the user 'hdfs' owning the root ('/') but for some reason with a M/R
job the user 'mapred' needs to have write permission to the root. I don't
know how to satisfy both conditions. That is one reason that I relaxed the
permission to 775 so that the group would also have write permission but
that didn't seem to help.


From: Mohammad Tariq [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 30, 2013 8:20 AM
To: Kevin Burton
Subject: Re: Permission problem


user?"ls" shows "hdfs" and the log says "mapred"..
Warm Regards,





On Tue, Apr 30, 2013 at 6:22 PM, Kevin Burton <[EMAIL PROTECTED]>

I have relaxed it even further so now it is 775


kevin@devUbuntu05:/var/log/hadoop-0.20-mapreduce$ hadoop fs -ls -d /

Found 1 items

drwxrwxr-x   - hdfs supergroup          0 2013-04-29 15:43 /


But I still get this error:


2013-04-30 07:43:02,520 FATAL org.apache.hadoop.mapred.JobTracker:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=mapred, access=WRITE, inode="/":hdfs:supergroup:drwxrwxr-x



From: Mohammad Tariq [mailto:[EMAIL PROTECTED]]
Sent: Monday, April 29, 2013 5:10 PM
Subject: Re: Incompartible cluserIDS


make it 755.
Warm Regards,







Arpit Gupta 2013-04-30, 14:25
Kevin Burton 2013-04-30, 14:39