Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - Hive directory permissions


Copy link to this message
-
RE: Hive directory permissions
Connell, Chuck 2012-08-16, 13:57
I have no doubt that works, but surely a Hive user should not need sudo privileges!  I am also looking for best practices, since we have run into the same.
From: Himanish Kushary [mailto:[EMAIL PROTECTED]]
Sent: Thursday, August 16, 2012 9:51 AM
To: [EMAIL PROTECTED]
Subject: Re: Hive directory permissions

We usually start the shell thru sudo,otherwise we get a "Permission denied" while creating Hive tables.

But this is a good point, any suggestions/best practices from the user community ?

Thanks
On Thu, Aug 16, 2012 at 9:37 AM, Connell, Chuck <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
I have run into similar problems. Thanks for the suggestions. One concern... Isn't hdfs a highly privileged user within the Hadoop cluster? So do we really want it to be standard practice for all Hive users to su to hdfs?

Chuck Connell
Nuance R&D Data Team
Burlington, MA

From: Himanish Kushary [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Thursday, August 16, 2012 9:30 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: Hive directory permissions

Hi Sean,

>From the Hive language manual - "Moreover, we strongly advise users to create the HDFS directories /tmp and /user/hive/warehouse
(aka hive.metastore.warehouse.dir) and set them chmod g+w before tables are created in Hive"

My warehouse directory has the following permissions:

Name

Type

Size

Replication

Block Size

Modification Time

Permission

Owner

Group

warehouse<http://h-node02:50075/browseDirectory.jsp?dir=%2Fuser%2Fhive%2Fwarehouse&namenodeInfoPort=50070&nnaddr=hdfs01:8020>

dir

2012-08-15 15:51

rwxrwxr-x

hdfs

supergroup
Also I make sure that I run the hive CLI as 'hdfs' user.

Hope this helps

Thanks
Himanish
On Thu, Aug 16, 2012 at 1:50 AM, Sean Bigdatafun <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
I ran the following command trying to setup my hive directory, but got the following error.

root@cdh-client:/# hadoop fs -mkdir       /user/hive/warehouse
mkdir: org.apache.hadoop.security.AccessControlException: Permission denied: user=root, access=WRITE, inode="/user":hdfs:hadoop:drwxr-xr-x

Can someone tell me what is the "correct" ownership for hive directories? My "/user" directory is with the following ownership:
user<http://cdh-slave2-16g.hwhadoop.com:50075/browseDirectory.jsp?dir=%2Fuser&namenodeInfoPort=50070>

dir

2012-08-14 16:51

rwxr-xr-x

hdfs

hadoop
Should I create a sub-directory under user with the following permission?
h<http://cdh-slave2-16g.hwhadoop.com:50075/browseDirectory.jsp?dir=%2Fuser&namenodeInfoPort=50070>ive

dir

2012-08-14 16:51

rwxr-xr-x

hive

hadoop
Thanks,
Sean
--
Thanks & Regards
Himanish

--
Thanks & Regards
Himanish