|
|
-
Re: Multiuser setup on Hive
Austin Chungath 2012-11-22, 09:48
Thanks Alex, But unfortunately I don't have kerberos implementation right now to try it out. I was wondering if we can create multiple metastore dbs in mysql and then for each user group make separate hive-site.xml which has the username and jdbc connection details. Do I make any sense? is something in these lines possible? Regards, Austin On Thu, Nov 22, 2012 at 2:11 PM, Alexander Alten-Lorenz <[EMAIL PROTECTED] > wrote: > You could use SASL / kerberos implementation within HiveServer2. Depends > on a kerberosized cluster, too. Hive's metastore server provides the same > mechanism, but isn't fully multi connect ready. > Here's a link: > http://ben-tech.blogspot.de/2012/10/hive-server-2-in-cdh41.html> > - Alex > > On Nov 22, 2012, at 7:46 AM, Austin Chungath <[EMAIL PROTECTED]> wrote: > > > Hi, > > > > I had been trying to set up a multi user environment for hive. > > I have set up the hive metastore db in MySQL and hive works. > > > > Consider this scenario: > > > > user1 has created a database data1 > > user2 has created a database data2 > > > > Now user2 logs into hive and he is able to see and delete database data2 > > > > How do I prevent this? > > > > Regards, > > Austin > > -- > Alexander Alten-Lorenz > http://mapredit.blogspot.com> German Hadoop LinkedIn Group: http://goo.gl/N8pCF> >
+
Austin Chungath 2012-11-22, 09:48
-
Re: Multiuser setup on Hive
Alexander Alten-Lorenz 2012-11-22, 09:54
That means a separate metastore per User / different port. Please have in mind, anyone should maintain this. On top, the user has to choose the right JDBC connection. I have my doubt on such a installation ;) cheers, Alex On Nov 22, 2012, at 10:48 AM, Austin Chungath <[EMAIL PROTECTED]> wrote: > Thanks Alex, > But unfortunately I don't have kerberos implementation right now to try it > out. > I was wondering if we can create multiple metastore dbs in mysql and then > for each user group make separate hive-site.xml which has the username and > jdbc connection details. Do I make any sense? is something in these lines > possible? > > Regards, > Austin > > > On Thu, Nov 22, 2012 at 2:11 PM, Alexander Alten-Lorenz <[EMAIL PROTECTED] >> wrote: > >> You could use SASL / kerberos implementation within HiveServer2. Depends >> on a kerberosized cluster, too. Hive's metastore server provides the same >> mechanism, but isn't fully multi connect ready. >> Here's a link: >> http://ben-tech.blogspot.de/2012/10/hive-server-2-in-cdh41.html>> >> - Alex >> >> On Nov 22, 2012, at 7:46 AM, Austin Chungath <[EMAIL PROTECTED]> wrote: >> >>> Hi, >>> >>> I had been trying to set up a multi user environment for hive. >>> I have set up the hive metastore db in MySQL and hive works. >>> >>> Consider this scenario: >>> >>> user1 has created a database data1 >>> user2 has created a database data2 >>> >>> Now user2 logs into hive and he is able to see and delete database data2 >>> >>> How do I prevent this? >>> >>> Regards, >>> Austin >> >> -- >> Alexander Alten-Lorenz >> http://mapredit.blogspot.com>> German Hadoop LinkedIn Group: http://goo.gl/N8pCF>> >> -- Alexander Alten-Lorenz http://mapredit.blogspot.comGerman Hadoop LinkedIn Group: http://goo.gl/N8pCF
+
Alexander Alten-Lorenz 2012-11-22, 09:54
-
Multiuser setup on Hive
Austin Chungath 2012-11-22, 06:46
Hi,
I had been trying to set up a multi user environment for hive. I have set up the hive metastore db in MySQL and hive works.
Consider this scenario:
user1 has created a database data1 user2 has created a database data2
Now user2 logs into hive and he is able to see and delete database data2
How do I prevent this?
Regards, Austin
+
Austin Chungath 2012-11-22, 06:46
-
Re: Multiuser setup on Hive
Bejoy KS 2012-11-22, 06:50
Hi Austin
In hive currently you can have permissions only on the hdfs layer not on the metastore. The current hive metastore don't have multiuser permission support. Any user will be able to drop the metadata information now.
Regards Bejoy KS
Sent from handheld, please excuse typos.
-----Original Message----- From: Austin Chungath <[EMAIL PROTECTED]> Date: Thu, 22 Nov 2012 12:16:24 To: <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> Reply-To: [EMAIL PROTECTED] Subject: Multiuser setup on Hive
Hi,
I had been trying to set up a multi user environment for hive. I have set up the hive metastore db in MySQL and hive works.
Consider this scenario:
user1 has created a database data1 user2 has created a database data2
Now user2 logs into hive and he is able to see and delete database data2
How do I prevent this?
Regards, Austin
+
Bejoy KS 2012-11-22, 06:50
-
Re: Multiuser setup on Hive
Austin Chungath 2012-11-22, 07:12
Hi Bejoy, Thanks for the quick reply. I had been reading through hive authorization https://cwiki.apache.org/Hive/languagemanual-auth.htmlIs it any good. Can anyone explain what happens if I enable this? Will I be able to prevent users from deleting other user's tables? Regards, Austin On Thu, Nov 22, 2012 at 12:20 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: > ** > Hi Austin > > In hive currently you can have permissions only on the hdfs layer not on > the metastore. The current hive metastore don't have multiuser permission > support. Any user will be able to drop the metadata information now. > Regards > Bejoy KS > > Sent from handheld, please excuse typos. > ------------------------------ > *From: * Austin Chungath <[EMAIL PROTECTED]> > *Date: *Thu, 22 Nov 2012 12:16:24 +0530 > *To: *<[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> > *ReplyTo: * [EMAIL PROTECTED] > *Subject: *Multiuser setup on Hive > > Hi, > > I had been trying to set up a multi user environment for hive. > I have set up the hive metastore db in MySQL and hive works. > > Consider this scenario: > > user1 has created a database data1 > user2 has created a database data2 > > Now user2 logs into hive and he is able to see and delete database data2 > > How do I prevent this? > > Regards, > Austin > > >
+
Austin Chungath 2012-11-22, 07:12
-
Re: Multiuser setup on Hive
Shreepadma Venugopalan 2012-11-22, 07:40
Hi Austin, Hive authorization in its current form has a number of bugs and it is not recommended that you use it. We are planning to work on supporting authorization in a subsequent version of Hive. Thanks. Shreepadma On Wed, Nov 21, 2012 at 11:12 PM, Austin Chungath <[EMAIL PROTECTED]>wrote: > Hi Bejoy, > > Thanks for the quick reply. > I had been reading through hive authorization > https://cwiki.apache.org/Hive/languagemanual-auth.html> > Is it any good. Can anyone explain what happens if I enable this? > Will I be able to prevent users from deleting other user's tables? > > > Regards, > Austin > > > > On Thu, Nov 22, 2012 at 12:20 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: > >> ** >> Hi Austin >> >> In hive currently you can have permissions only on the hdfs layer not on >> the metastore. The current hive metastore don't have multiuser permission >> support. Any user will be able to drop the metadata information now. >> Regards >> Bejoy KS >> >> Sent from handheld, please excuse typos. >> ------------------------------ >> *From: * Austin Chungath <[EMAIL PROTECTED]> >> *Date: *Thu, 22 Nov 2012 12:16:24 +0530 >> *To: *<[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> >> *ReplyTo: * [EMAIL PROTECTED] >> *Subject: *Multiuser setup on Hive >> >> Hi, >> >> I had been trying to set up a multi user environment for hive. >> I have set up the hive metastore db in MySQL and hive works. >> >> Consider this scenario: >> >> user1 has created a database data1 >> user2 has created a database data2 >> >> Now user2 logs into hive and he is able to see and delete database data2 >> >> How do I prevent this? >> >> Regards, >> Austin >> >> >> > >
+
Shreepadma Venugopalan 2012-11-22, 07:40
-
Re: Multiuser setup on Hive
Austin Chungath 2012-11-22, 08:26
Shreepadam, So what do you recommend for this? What are the current best practices for deploying hive in a multi-user environment? Thanks, Austin On Thu, Nov 22, 2012 at 1:10 PM, Shreepadma Venugopalan < [EMAIL PROTECTED]> wrote: > Hi Austin, > > Hive authorization in its current form has a number of bugs and it is not > recommended that you use it. We are planning to work on supporting > authorization in a subsequent version of Hive. > > Thanks. > Shreepadma > > > On Wed, Nov 21, 2012 at 11:12 PM, Austin Chungath <[EMAIL PROTECTED]>wrote: > >> Hi Bejoy, >> >> Thanks for the quick reply. >> I had been reading through hive authorization >> https://cwiki.apache.org/Hive/languagemanual-auth.html>> >> Is it any good. Can anyone explain what happens if I enable this? >> Will I be able to prevent users from deleting other user's tables? >> >> >> Regards, >> Austin >> >> >> >> On Thu, Nov 22, 2012 at 12:20 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: >> >>> ** >>> Hi Austin >>> >>> In hive currently you can have permissions only on the hdfs layer not on >>> the metastore. The current hive metastore don't have multiuser permission >>> support. Any user will be able to drop the metadata information now. >>> Regards >>> Bejoy KS >>> >>> Sent from handheld, please excuse typos. >>> ------------------------------ >>> *From: * Austin Chungath <[EMAIL PROTECTED]> >>> *Date: *Thu, 22 Nov 2012 12:16:24 +0530 >>> *To: *<[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> >>> *ReplyTo: * [EMAIL PROTECTED] >>> *Subject: *Multiuser setup on Hive >>> >>> Hi, >>> >>> I had been trying to set up a multi user environment for hive. >>> I have set up the hive metastore db in MySQL and hive works. >>> >>> Consider this scenario: >>> >>> user1 has created a database data1 >>> user2 has created a database data2 >>> >>> Now user2 logs into hive and he is able to see and delete database data2 >>> >>> How do I prevent this? >>> >>> Regards, >>> Austin >>> >>> >>> >> >> >
+
Austin Chungath 2012-11-22, 08:26
-
Re: Multiuser setup on Hive
Dean Wampler 2012-11-22, 14:14
If you go the route of locking down permissions at the HDFS level, then it will help if everyone works in his or her own database, since all the tables will be rooted at a directory for each db. dean On Thu, Nov 22, 2012 at 2:26 AM, Austin Chungath <[EMAIL PROTECTED]> wrote: > Shreepadam, > So what do you recommend for this? What are the current best practices for > deploying hive in a multi-user environment? > > Thanks, > Austin > > On Thu, Nov 22, 2012 at 1:10 PM, Shreepadma Venugopalan < > [EMAIL PROTECTED]> wrote: > >> Hi Austin, >> >> Hive authorization in its current form has a number of bugs and it is not >> recommended that you use it. We are planning to work on supporting >> authorization in a subsequent version of Hive. >> >> Thanks. >> Shreepadma >> >> >> On Wed, Nov 21, 2012 at 11:12 PM, Austin Chungath <[EMAIL PROTECTED]>wrote: >> >>> Hi Bejoy, >>> >>> Thanks for the quick reply. >>> I had been reading through hive authorization >>> https://cwiki.apache.org/Hive/languagemanual-auth.html>>> >>> Is it any good. Can anyone explain what happens if I enable this? >>> Will I be able to prevent users from deleting other user's tables? >>> >>> >>> Regards, >>> Austin >>> >>> >>> >>> On Thu, Nov 22, 2012 at 12:20 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: >>> >>>> ** >>>> Hi Austin >>>> >>>> In hive currently you can have permissions only on the hdfs layer not >>>> on the metastore. The current hive metastore don't have multiuser >>>> permission support. Any user will be able to drop the metadata information >>>> now. >>>> Regards >>>> Bejoy KS >>>> >>>> Sent from handheld, please excuse typos. >>>> ------------------------------ >>>> *From: * Austin Chungath <[EMAIL PROTECTED]> >>>> *Date: *Thu, 22 Nov 2012 12:16:24 +0530 >>>> *To: *<[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> >>>> *ReplyTo: * [EMAIL PROTECTED] >>>> *Subject: *Multiuser setup on Hive >>>> >>>> Hi, >>>> >>>> I had been trying to set up a multi user environment for hive. >>>> I have set up the hive metastore db in MySQL and hive works. >>>> >>>> Consider this scenario: >>>> >>>> user1 has created a database data1 >>>> user2 has created a database data2 >>>> >>>> Now user2 logs into hive and he is able to see and delete database data2 >>>> >>>> How do I prevent this? >>>> >>>> Regards, >>>> Austin >>>> >>>> >>>> >>> >>> >> > -- *Dean Wampler, Ph.D.* thinkbiganalytics.com +1-312-339-1330
+
Dean Wampler 2012-11-22, 14:14
-
Re: Multiuser setup on Hive
Austin Chungath 2012-11-23, 06:07
Thanks dean. On Thu, Nov 22, 2012 at 7:44 PM, Dean Wampler < [EMAIL PROTECTED]> wrote: > If you go the route of locking down permissions at the HDFS level, then it > will help if everyone works in his or her own database, since all the > tables will be rooted at a directory for each db. > > dean > > > On Thu, Nov 22, 2012 at 2:26 AM, Austin Chungath <[EMAIL PROTECTED]>wrote: > >> Shreepadam, >> So what do you recommend for this? What are the current best practices >> for deploying hive in a multi-user environment? >> >> Thanks, >> Austin >> >> On Thu, Nov 22, 2012 at 1:10 PM, Shreepadma Venugopalan < >> [EMAIL PROTECTED]> wrote: >> >>> Hi Austin, >>> >>> Hive authorization in its current form has a number of bugs and it is >>> not recommended that you use it. We are planning to work on supporting >>> authorization in a subsequent version of Hive. >>> >>> Thanks. >>> Shreepadma >>> >>> >>> On Wed, Nov 21, 2012 at 11:12 PM, Austin Chungath <[EMAIL PROTECTED]>wrote: >>> >>>> Hi Bejoy, >>>> >>>> Thanks for the quick reply. >>>> I had been reading through hive authorization >>>> https://cwiki.apache.org/Hive/languagemanual-auth.html>>>> >>>> Is it any good. Can anyone explain what happens if I enable this? >>>> Will I be able to prevent users from deleting other user's tables? >>>> >>>> >>>> Regards, >>>> Austin >>>> >>>> >>>> >>>> On Thu, Nov 22, 2012 at 12:20 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: >>>> >>>>> ** >>>>> Hi Austin >>>>> >>>>> In hive currently you can have permissions only on the hdfs layer not >>>>> on the metastore. The current hive metastore don't have multiuser >>>>> permission support. Any user will be able to drop the metadata information >>>>> now. >>>>> Regards >>>>> Bejoy KS >>>>> >>>>> Sent from handheld, please excuse typos. >>>>> ------------------------------ >>>>> *From: * Austin Chungath <[EMAIL PROTECTED]> >>>>> *Date: *Thu, 22 Nov 2012 12:16:24 +0530 >>>>> *To: *<[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> >>>>> *ReplyTo: * [EMAIL PROTECTED] >>>>> *Subject: *Multiuser setup on Hive >>>>> >>>>> Hi, >>>>> >>>>> I had been trying to set up a multi user environment for hive. >>>>> I have set up the hive metastore db in MySQL and hive works. >>>>> >>>>> Consider this scenario: >>>>> >>>>> user1 has created a database data1 >>>>> user2 has created a database data2 >>>>> >>>>> Now user2 logs into hive and he is able to see and delete database >>>>> data2 >>>>> >>>>> How do I prevent this? >>>>> >>>>> Regards, >>>>> Austin >>>>> >>>>> >>>>> >>>> >>>> >>> >> > > > -- > *Dean Wampler, Ph.D.* > thinkbiganalytics.com > +1-312-339-1330 > > >
+
Austin Chungath 2012-11-23, 06:07
-
Re: Multiuser setup on Hive
Austin Chungath 2012-11-22, 12:48
Typo, I meant "user2 logs into hive and he is able to see and delete database data1"
On Thu, Nov 22, 2012 at 12:16 PM, Austin Chungath <[EMAIL PROTECTED]>wrote:
> Hi, > > I had been trying to set up a multi user environment for hive. > I have set up the hive metastore db in MySQL and hive works. > > Consider this scenario: > > user1 has created a database data1 > user2 has created a database data2 > > Now user2 logs into hive and he is able to see and delete database data2 > > How do I prevent this? > > Regards, > Austin > > >
+
Austin Chungath 2012-11-22, 12:48
|
|