Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # dev - [Discuss] project chop up


Copy link to this message
-
Re: [Discuss] project chop up
amareshwari sriramdasu 2013-08-21, 06:35
Sounds great! Looking forward !
On Tue, Aug 20, 2013 at 7:58 PM, Edward Capriolo <[EMAIL PROTECTED]>wrote:

> Just an update. This is going very well:
>
> NFO] Nothing to compile - all classes are up to date
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Hive ....................................... SUCCESS [0.002s]
> [INFO] hive-shims-x ...................................... SUCCESS [1.210s]
> [INFO] hive-shims-20 ..................................... SUCCESS [0.125s]
> [INFO] hive-common ....................................... SUCCESS [0.082s]
> [INFO] hive-serde ........................................ SUCCESS [2.521s]
> [INFO] hive-metastore .................................... SUCCESS
> [10.818s]
> [INFO] hive-exec ......................................... SUCCESS [4.521s]
> [INFO] hive-avro ......................................... SUCCESS [1.582s]
> [INFO] hive-zookeeper .................................... SUCCESS [0.519s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 21.613s
> [INFO] Finished at: Tue Aug 20 10:23:34 EDT 2013
> [INFO] Final Memory: 39M/408M
>
>
> Though I did some short cuts and disabled some tests. We can build hive
> very fast, including incremental builds. Also we are using maven plugins to
> compile antlr, thrift, protobuf, datanucleas and building those every time.
>
>
> On Fri, Aug 16, 2013 at 11:16 PM, Xuefu Zhang <[EMAIL PROTECTED]> wrote:
>
> > Thanks, Edward.
> >
> > I'm big +1 to mavenize Hive. Hive has long reached a point where it's
> hard
> > to manage its build using ant. I'd like to help on this too.
> >
> > Thanks,
> > Xuefu
> >
> >
> > On Fri, Aug 16, 2013 at 7:31 PM, Edward Capriolo <[EMAIL PROTECTED]
> > >wrote:
> >
> > > For those interested in pitching in.
> > > https://github.com/edwardcapriolo/hive
> > >
> > >
> > >
> > > On Fri, Aug 16, 2013 at 11:58 AM, Edward Capriolo <
> [EMAIL PROTECTED]
> > > >wrote:
> > >
> > > > Summary from hive-irc channel. Minor edits for spell check/grammar.
> > > >
> > > > The last 10 lines are a summary of the key points.
> > > >
> > > > [10:59:17] <ecapriolo> noland: et all. Do you want to talk about hive
> > in
> > > > maven?
> > > > [11:01:06] smonchi [~
> > > > [EMAIL PROTECTED]] has quit
> > IRC:
> > > > Quit: ... 'cause there is no patch for human stupidity ...
> > > > [11:10:04] <noland> ecapriolo: yeah that sounds good to me!
> > > > [11:10:22] <noland> I saw you created the jira but haven't had time
> to
> > > look
> > > > [11:10:32] <ecapriolo> So I found a few things
> > > > [11:10:49] <ecapriolo> In common there is one or two testats that
> > > actually
> > > > fork a process :)
> > > > [11:10:56] <ecapriolo> and use build.test.resources
> > > > [11:11:12] <ecapriolo> Some serde, uses some methods from ql in
> testing
> > > > [11:11:27] <ecapriolo> and shims really needs a separate hadoop test
> > shim
> > > > [11:11:32] <ecapriolo> But that is all simple stuff
> > > > [11:11:47] <ecapriolo> The biggest problem is I do not know how to
> > solve
> > > > shims with maven
> > > > [11:11:50] <ecapriolo> do you have any ideas
> > > > [11:11:52] <ecapriolo> ?
> > > > [11:13:00] <noland> That one is going to be a challenge. It might be
> > that
> > > > in that section we have to drop down to ant
> > > > [11:14:44] <noland> Is it a requirement that we build both the .20
> and
> > > .23
> > > > shims for a "package" as we do today?
> > > > [11:16:46] <ecapriolo> I was thinking we can do it like a JDBC driver
> > > > [11:16:59] <ecapriolo> Se separate out the interface of shims
> > > > [11:17:22] <ecapriolo> And then at runtime we drop in a driver
> > > implementing
> > > > [11:17:34] Wertax [~[EMAIL PROTECTED]] has quit IRC: Remote
> > host