Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Hive directory permissions


Copy link to this message
-
RE: Hive directory permissions
I have no doubt that works, but surely a Hive user should not need sudo privileges!  I am also looking for best practices, since we have run into the same.
From: Himanish Kushary [mailto:[EMAIL PROTECTED]]
Sent: Thursday, August 16, 2012 9:51 AM
To: [EMAIL PROTECTED]
Subject: Re: Hive directory permissions

We usually start the shell thru sudo,otherwise we get a "Permission denied" while creating Hive tables.

But this is a good point, any suggestions/best practices from the user community ?

Thanks
On Thu, Aug 16, 2012 at 9:37 AM, Connell, Chuck <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
I have run into similar problems. Thanks for the suggestions. One concern... Isn't hdfs a highly privileged user within the Hadoop cluster? So do we really want it to be standard practice for all Hive users to su to hdfs?

Chuck Connell
Nuance R&D Data Team
Burlington, MA

From: Himanish Kushary [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Thursday, August 16, 2012 9:30 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: Hive directory permissions

Hi Sean,

>From the Hive language manual - "Moreover, we strongly advise users to create the HDFS directories /tmp and /user/hive/warehouse
(aka hive.metastore.warehouse.dir) and set them chmod g+w before tables are created in Hive"

My warehouse directory has the following permissions:

Name

Type

Size

Replication

Block Size

Modification Time

Permission

Owner

Group

warehouse<http://h-node02:50075/browseDirectory.jsp?dir=%2Fuser%2Fhive%2Fwarehouse&namenodeInfoPort=50070&nnaddr=hdfs01:8020>

dir

2012-08-15 15:51

rwxrwxr-x

hdfs

supergroup
Also I make sure that I run the hive CLI as 'hdfs' user.

Hope this helps

Thanks
Himanish
On Thu, Aug 16, 2012 at 1:50 AM, Sean Bigdatafun <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
I ran the following command trying to setup my hive directory, but got the following error.

root@cdh-client:/# hadoop fs -mkdir       /user/hive/warehouse
mkdir: org.apache.hadoop.security.AccessControlException: Permission denied: user=root, access=WRITE, inode="/user":hdfs:hadoop:drwxr-xr-x

Can someone tell me what is the "correct" ownership for hive directories? My "/user" directory is with the following ownership:
user<http://cdh-slave2-16g.hwhadoop.com:50075/browseDirectory.jsp?dir=%2Fuser&namenodeInfoPort=50070>

dir

2012-08-14 16:51

rwxr-xr-x

hdfs

hadoop
Should I create a sub-directory under user with the following permission?
h<http://cdh-slave2-16g.hwhadoop.com:50075/browseDirectory.jsp?dir=%2Fuser&namenodeInfoPort=50070>ive

dir

2012-08-14 16:51

rwxr-xr-x

hive

hadoop
Thanks,
Sean
--
Thanks & Regards
Himanish

--
Thanks & Regards
Himanish
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB