Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - Re: Hive HWI ... request for your experience to be used Production


+
Qiang Wang 2013-01-05, 05:34
+
Edward Capriolo 2013-01-06, 00:33
+
Russell Jurney 2013-01-06, 01:45
+
Russell Jurney 2013-01-06, 01:44
+
Manish Malhotra 2013-01-05, 20:41
+
Qiang Wang 2013-01-06, 01:52
+
Edward Capriolo 2013-01-06, 17:10
+
Manish Malhotra 2013-01-06, 18:45
+
Manish Malhotra 2013-01-06, 18:58
+
Edward Capriolo 2013-01-07, 02:23
Copy link to this message
-
Re: Hive HWI ... request for your experience to be used Production
Qiang Wang 2013-01-07, 02:39
Before running queries, a compile method will be called in class
org.apache.hadoop.hive.ql.Driver. I think we can take some useful code out
of this method.

Qiang
2013/1/7 Edward Capriolo <[EMAIL PROTECTED]>

> I think a simple way would be to try tacking an explain in front of it.
> Explains do not map reduce so they should be synchronous.
>
> Sent from my iPad
>
> On Jan 6, 2013, at 1:58 PM, Manish Malhotra <[EMAIL PROTECTED]>
> wrote:
>
> https://github.com/anjuke/hwi/issues/2
>
> Added an issue for "Integrating HWI with Oozie" ..
> its not an issue but a feature request. Please review and see if it make
> sense atleast in long term.
>
> Plus i want to check 1 more usecase:
>
> 1. Query compilation: When user writes query on the UI, does it give
> compilation problem in synchronous way instead of scheduling a query that
> is not correct?
>
> Regards,
> Manish
>
>
> On Sun, Jan 6, 2013 at 10:45 AM, Manish Malhotra <
> [EMAIL PROTECTED]> wrote:
>
>> Thanks Edward for explaining ....
>> Im also very much interested in building a robust tool for bringing HIVE
>> more into Enterprise world where any Data Analyst / ETL developer can use
>> it.
>>
>> Regards,
>> Manish
>>
>>
>> On Sun, Jan 6, 2013 at 9:10 AM, Edward Capriolo <[EMAIL PROTECTED]>wrote:
>>
>>> The hive code is apache licensed. If you want to add you work to hive
>>> simple open a jira on http://issues.apache.org/jira/hive and produce a
>>> patch that will apply to hive trunk. That will start the process.
>>>
>>>
>>>
>>>
>>> On Saturday, January 5, 2013, Qiang Wang <[EMAIL PROTECTED]> wrote:
>>> > Hi Manish:
>>> > Glad to talk with you.
>>> > 1. We are willing and trying to make it an open source project
>>> although we're not familiar with how to do so. We will study the licences
>>> and chose a proper one.
>>> > 2. If Apache Hive agree to add this to the codebase, we
>>> will definitely do this. I think this HWI is not good enough yet.
>>> > 3. ThreadPool is used to run queries. So synchronous mode can be
>>> achieved by setting its size to 1.
>>> > Regards,
>>> > Qiang
>>> >
>>> > 2013/1/6 Manish Malhotra <[EMAIL PROTECTED]>
>>> >>
>>> >> Thanks Quiang,
>>> >>
>>> >> And glad that somebody already doing the improvement. Sure let me try
>>> it out.
>>> >> Quick questions:
>>> >>
>>> >> 1. What is the license of this HWI version?  Can somebody else
>>> contribute to this as a true open source software and use it and make it
>>> available for community as well?
>>> >> 2. Any plans to merge this or add to Apache Hive codebase.
>>> >> 3. Does it has synchronous mode of running queries or only scheduling
>>>  / async way?
>>> >> Thanks for your reply and time,
>>> >> Regards,
>>> >> Manish
>>> >>
>>> >> On Fri, Jan 4, 2013 at 9:34 PM, Qiang Wang <[EMAIL PROTECTED]> wrote:
>>> >>>
>>> >>> Hi Manish:
>>> >>>
>>> >>> Glad to receive your email because we are making efforts on HWI.
>>> >>> We have improved the orignal and added some features and putted it
>>> on github:
>>> >>> https://github.com/anjuke/hwi
>>> >>>
>>> >>> It's far from mature and standard, but it's improving and has
>>> already deployed for our company to use.
>>> >>> After all, have a try and give some advice if you're interested in
>>> it.
>>> >>> Thanks
>>> >>> Qiang
>>> >>>
>>> >>> 2013/1/5 Manish Malhotra <[EMAIL PROTECTED]>
>>> >>>>
>>> >>>> Hi All,
>>> >>>>
>>> >>>> We are exploring HWI to be used in PROD environment for adhoc
>>> queries etc.
>>> >>>> Want to check out in the hive community that can somebody share
>>> there experience while using the HWI in prod or any environment in terms of
>>> its stability and performance.
>>> >>>> Also evaluating to enhance to make it more useful with different
>>> features.
>>> >>>> Thanks for your time and help !!
>>> >>>> Regards,
>>> >>>> Manish
>>> >>>>
>>> >>>>
>>> >>>
>>> >>
>>> >
>>> >
>>>
>>
>>
>
+
Qiang Wang 2013-01-07, 01:53