Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Hive server concurrency question


Copy link to this message
-
RE: Hive server concurrency question
There are jiras on Hive Server concurrency-related issues, some open and some closed, including:

https://issues.apache.org/jira/browse/HIVE-80
https://issues.apache.org/jira/browse/HIVE-1019
https://issues.apache.org/jira/browse/HIVE-1884
https://issues.apache.org/jira/browse/HIVE-2022
https://issues.apache.org/jira/browse/HIVE-2503
From: sumadhur [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, March 28, 2012 11:39 AM
To: [EMAIL PROTECTED]; Philip Tromans
Subject: Re: Hive server concurrency question

Hi phil,

It works ok, but it is a little flakey.
Could you please let me know the kind of problems you faced? A few examples would help.

I would want the ability to connect to the server from multiple clients and execute queries parallely. So, wanted to be aware of the pitfalls.

Thanks,
Suma
From: Philip Tromans <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Sent: Wednesday, March 28, 2012 11:26 AM
Subject: Re: Hive server concurrency question

I've used Hive in a multiple connections per server instance setup. It
works ok, but it is a little flakey. I have some snapshot of trunk >
0.8.0 deployed. When I have some time, I'd like to help increase the
test coverage for multithreaded clients.

Phil.

On 28 March 2012 19:19, Abhishek Pratap Singh <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
> AFAIK hive does not support concurrency however Multiple connection can be
> made to HiveServer.
> Hive or i should say Hadoop is write once and read multiple architecture.
> Hive does not have a build in support for DELETE OR UPDATE.
> The inherent architecture of these kind of solution works best when you
> don't need Concurrency, Transaction or ACID properties. I have seen usecases
> where wrapper to handle transaction is implemented but at the significant
> cost of Performance.
>
> Regards,
> Abhishek
>
>
> On Wed, Mar 28, 2012 at 11:03 AM, sumadhur <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
>>
>> Resending due to lack of response.
>> From: sumadhur <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
>> To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
>> Sent: Tuesday, March 27, 2012 2:14 AM
>> Subject: Hive server concurrency question
>>
>> Hi,
>> Does Hive server support multiple concurrent client connections?
>> The following page says it does not support them.
>> https://cwiki.apache.org/Hive/hiveodbc.html
>> Hive Server is currently not thread safe
>> The following page says that it was designed to support multiple
>> connections. But there's no test coverage.
>> https://cwiki.apache.org/Hive/hiveserver.html
>> HiveServer is multithreaded and was designed to support multiple
>> concurrent client connections. However, there is currently no test coverage
>> for this scenario. If you want to play it safe we recommend running one
>> HiveServer process per client connection.
>> The following JIRA seems to imply that the hive server does support
>> multiple concurrent connections.
>> https://issues.apache.org/jira/browse/HIVE-77
>> What's the official stance on this? supported or not supported?
>> Are there any known issues with hive server's handling of multiple
>> concurrent client connections?
>> Thanks,
>> Sumadhur
>>
>>
>

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB