Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Hive server concurrency question


Copy link to this message
-
RE: Hive server concurrency question
There are jiras on Hive Server concurrency-related issues, some open and some closed, including:

https://issues.apache.org/jira/browse/HIVE-80
https://issues.apache.org/jira/browse/HIVE-1019
https://issues.apache.org/jira/browse/HIVE-1884
https://issues.apache.org/jira/browse/HIVE-2022
https://issues.apache.org/jira/browse/HIVE-2503
From: sumadhur [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, March 28, 2012 11:39 AM
To: [EMAIL PROTECTED]; Philip Tromans
Subject: Re: Hive server concurrency question

Hi phil,

It works ok, but it is a little flakey.
Could you please let me know the kind of problems you faced? A few examples would help.

I would want the ability to connect to the server from multiple clients and execute queries parallely. So, wanted to be aware of the pitfalls.

Thanks,
Suma
From: Philip Tromans <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Sent: Wednesday, March 28, 2012 11:26 AM
Subject: Re: Hive server concurrency question

I've used Hive in a multiple connections per server instance setup. It
works ok, but it is a little flakey. I have some snapshot of trunk >
0.8.0 deployed. When I have some time, I'd like to help increase the
test coverage for multithreaded clients.

Phil.

On 28 March 2012 19:19, Abhishek Pratap Singh <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
> AFAIK hive does not support concurrency however Multiple connection can be
> made to HiveServer.
> Hive or i should say Hadoop is write once and read multiple architecture.
> Hive does not have a build in support for DELETE OR UPDATE.
> The inherent architecture of these kind of solution works best when you
> don't need Concurrency, Transaction or ACID properties. I have seen usecases
> where wrapper to handle transaction is implemented but at the significant
> cost of Performance.
>
> Regards,
> Abhishek
>
>
> On Wed, Mar 28, 2012 at 11:03 AM, sumadhur <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
>>
>> Resending due to lack of response.
>> From: sumadhur <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
>> To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
>> Sent: Tuesday, March 27, 2012 2:14 AM
>> Subject: Hive server concurrency question
>>
>> Hi,
>> Does Hive server support multiple concurrent client connections?
>> The following page says it does not support them.
>> https://cwiki.apache.org/Hive/hiveodbc.html
>> Hive Server is currently not thread safe
>> The following page says that it was designed to support multiple
>> connections. But there's no test coverage.
>> https://cwiki.apache.org/Hive/hiveserver.html
>> HiveServer is multithreaded and was designed to support multiple
>> concurrent client connections. However, there is currently no test coverage
>> for this scenario. If you want to play it safe we recommend running one
>> HiveServer process per client connection.
>> The following JIRA seems to imply that the hive server does support
>> multiple concurrent connections.
>> https://issues.apache.org/jira/browse/HIVE-77
>> What's the official stance on this? supported or not supported?
>> Are there any known issues with hive server's handling of multiple
>> concurrent client connections?
>> Thanks,
>> Sumadhur
>>
>>
>