Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Adding jar files when running hive in hwi mode or hiveserver mode

Copy link to this message
Re: Adding jar files when running hive in hwi mode or hiveserver mode
Having played around with hive cli/hiveserver/hwi for a few weeks I think I
understand the various pieces better now. Can people provide some real world
scenarios where they use the different "modes?"

As far as UI and more importantly making hive accessible to users that are
not super familiar with SQL goes, it seems to me like hive JDBC might be the
best option since that way hive can be relatively seamlessly integrated with
many sophisticated reporting tools. I haven't explored that option much yet.

Hive cli was good enough for me to play around with the framework and I can
keep using it for real work. However, having a simple GUI like hwi is better
for many reasons but I don't think it can ever be a replacement for all the
available reporting tools.

So, I guess I'm kind of conflicted at this point :) My ultimate goal is to
put the power of hadoop and hive into the hands of non-technical (business)
users. At first I thought I could probably build a simple UI (which is a
bunch of php files really) using the php thrift API but that API did not
seem suited for short lived web applications without some sort of
sophisticated session management.

Any thoughts/ideas are greatly appreciated.

On Wed, Aug 26, 2009 at 2:50 PM, Bill Graham <[EMAIL PROTECTED]> wrote:

> +1 for the HWI -> HiveServer approach.
> Building out rich APIs in the HiveServer (thrift currently, and possible
> REST at some point), would allow the HiveServer to focus on the functional
> API. The HWI (and others) could then focus on rich UI functionality. The two
> would have a clean decoupling, which would reduce complexity of the
> codebases and help abid by the KISS principle.
> On Wed, Aug 26, 2009 at 2:42 PM, Edward Capriolo <[EMAIL PROTECTED]>wrote:
>> On Wed, Aug 26, 2009 at 3:25 PM, Raghu Murthy<[EMAIL PROTECTED]>
>> wrote:
>> > Even if we decided to have multiple HiveServers, wouldn't it be possible
>> for
>> > HWI to randomly pick a HiveServer to connect to per query/client?
>> >
>> > On 8/26/09 12:16 PM, "Ashish Thusoo" <[EMAIL PROTECTED]> wrote:
>> >
>> >> +1 for ajaxing this baby.
>> >>
>> >> On the broader question of whether we should combine HWI and HiveServer
>> - I
>> >> think there are definite deployment and code reuse advantages in doing
>> so,
>> >> however keeping them separate also has the advantage that we can
>> cluster
>> >> HiveServers independently from HWI. Since the HiveServer sits in the
>> data
>> >> path, the independent scaling may have advantages. I am not sure how
>> strong of
>> >> an argument that is to not put them together. Simplicity obviously
>> indicates
>> >> that we should have them together.
>> >>
>> >> Thoughts?
>> >>
>> >> Ashish
>> >>
>> >> -----Original Message-----
>> >> From: Edward Capriolo [mailto:[EMAIL PROTECTED]]
>> >> Sent: Wednesday, August 26, 2009 9:45 AM
>> >> Subject: Re: Adding jar files when running hive in hwi mode or
>> hiveserver mode
>> >>
>> >> On Tue, Aug 25, 2009 at 8:13 PM, Vijay<[EMAIL PROTECTED]> wrote:
>> >>> Yep, I got it and now it works perfectly! I like hwi btw! It
>> >>> definitely makes things easier for a wider audience to try out hive.
>> >>> Your new session result bucket idea is very nice as well. I will keep
>> >>> trying more things and see if anything else comes up but so far it
>> looks
>> >>> great!
>> >>> Thanks Edward!
>> >>>
>> >>> On Tue, Aug 25, 2009 at 7:25 AM, Edward Capriolo
>> >>> wrote:
>> >>>>
>> >>>> On Tue, Aug 25, 2009 at 10:18 AM, Edward
>> >>>> Capriolo<[EMAIL PROTECTED]>
>> >>>> wrote:
>> >>>>> On Mon, Aug 24, 2009 at 10:13 PM, Vijay<[EMAIL PROTECTED]> wrote:
>> >>>>>> Probably spoke too soon :) I added this comment to the JIRA ticket
>> >>>>>> above.
>> >>>>>>
>> >>>>>> Hi, I tried the latest patch on trunk and there seems to be a
>> problem.
>> >>>>>>
>> >>>>>> I was interested in using the "add jar " command to add jar files
>> >>>>>> to the path. However, by the time the command flows through the