-Re: custom Hive artifacts for Shark project
Edward Capriolo 2013-08-26, 03:54
I think we plan on doing an 11.1 or just a 12.0. How does shark use hive?
Do you just include hive components from maven or does the project somehow
encorportate our build infrastructure.
On Sun, Aug 25, 2013 at 7:42 PM, Konstantin Boudnik <[EMAIL PROTECTED]> wrote:
> considering the absence of the input, I take it that it really doesn't
> which way the custom artifact will be published. Is it a correct
> My first choice would be
> If this meets the objections from the community here, then I'd like to
> Any of the artifacts are better be published at Maven central to make it
> readily available for development community.
> On Sat, Aug 10, 2013 at 10:08PM, Konstantin Boudnik wrote:
> > Guys,
> > I am trying to help Spark/Shark community (spark-project.org and now
> > http://incubator.apache.org/projects/spark) with a predicament. Shark -
> > also known as Hive on Spark - is using some parts of Hive, ie HQL parser,
> > query optimizer, serdes, and codecs.
> > In order to improve some known issues with performance and/or concurrency
> > Shark developers need to apply a couple of patches on top of the stock
> > https://issues.apache.org/jira/browse/HIVE-2891
> > https://issues.apache.org/jira/browse/HIVE-3772 (just committed to
> > (as per https://github.com/amplab/shark/wiki/Hive-Patches)
> > The issue here is that latest Shark is working on top if Hive 0.9 (Hive
> > work is underway) and having developers to apply the patches and build
> > their own version of the Hive is an extra step that can be avoided.
> > One way to address it is to publish Shark specific versions of Hive
> > that would have all needed patches applied to stock release. This way
> > downstream projects can simply reference the version org.apache.hive with
> > version 0.9.0-shark-0.7 instead of building Hive locally every time.
> > Perhaps this approach is a little overkill, so perhaps if Hive community
> > willing to consider a maintenance release of Hive 0.9.1 and perhaps
> > to include fixes needed by Shark project?
> > I am willing to step up and produce Hive release bits if any of the
> > here can help with publishing.
> > --
> > Thanks in advance,
> > Cos