Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # dev - [Discuss] project chop up


Copy link to this message
-
Re: [Discuss] project chop up
Thiruvel Thirumoolan 2013-08-21, 23:13
+1 Thanks Edward.

On 8/20/13 11:35 PM, "amareshwari sriramdasu" <[EMAIL PROTECTED]>
wrote:

>Sounds great! Looking forward !
>
>
>On Tue, Aug 20, 2013 at 7:58 PM, Edward Capriolo
><[EMAIL PROTECTED]>wrote:
>
>> Just an update. This is going very well:
>>
>> NFO] Nothing to compile - all classes are up to date
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Apache Hive ....................................... SUCCESS
>>[0.002s]
>> [INFO] hive-shims-x ...................................... SUCCESS
>>[1.210s]
>> [INFO] hive-shims-20 ..................................... SUCCESS
>>[0.125s]
>> [INFO] hive-common ....................................... SUCCESS
>>[0.082s]
>> [INFO] hive-serde ........................................ SUCCESS
>>[2.521s]
>> [INFO] hive-metastore .................................... SUCCESS
>> [10.818s]
>> [INFO] hive-exec ......................................... SUCCESS
>>[4.521s]
>> [INFO] hive-avro ......................................... SUCCESS
>>[1.582s]
>> [INFO] hive-zookeeper .................................... SUCCESS
>>[0.519s]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 21.613s
>> [INFO] Finished at: Tue Aug 20 10:23:34 EDT 2013
>> [INFO] Final Memory: 39M/408M
>>
>>
>> Though I did some short cuts and disabled some tests. We can build hive
>> very fast, including incremental builds. Also we are using maven
>>plugins to
>> compile antlr, thrift, protobuf, datanucleas and building those every
>>time.
>>
>>
>> On Fri, Aug 16, 2013 at 11:16 PM, Xuefu Zhang <[EMAIL PROTECTED]>
>>wrote:
>>
>> > Thanks, Edward.
>> >
>> > I'm big +1 to mavenize Hive. Hive has long reached a point where it's
>> hard
>> > to manage its build using ant. I'd like to help on this too.
>> >
>> > Thanks,
>> > Xuefu
>> >
>> >
>> > On Fri, Aug 16, 2013 at 7:31 PM, Edward Capriolo
>><[EMAIL PROTECTED]
>> > >wrote:
>> >
>> > > For those interested in pitching in.
>> > > https://github.com/edwardcapriolo/hive
>> > >
>> > >
>> > >
>> > > On Fri, Aug 16, 2013 at 11:58 AM, Edward Capriolo <
>> [EMAIL PROTECTED]
>> > > >wrote:
>> > >
>> > > > Summary from hive-irc channel. Minor edits for spell
>>check/grammar.
>> > > >
>> > > > The last 10 lines are a summary of the key points.
>> > > >
>> > > > [10:59:17] <ecapriolo> noland: et all. Do you want to talk about
>>hive
>> > in
>> > > > maven?
>> > > > [11:01:06] smonchi [~
>> > > > [EMAIL PROTECTED]] has quit
>> > IRC:
>> > > > Quit: ... 'cause there is no patch for human stupidity ...
>> > > > [11:10:04] <noland> ecapriolo: yeah that sounds good to me!
>> > > > [11:10:22] <noland> I saw you created the jira but haven't had
>>time
>> to
>> > > look
>> > > > [11:10:32] <ecapriolo> So I found a few things
>> > > > [11:10:49] <ecapriolo> In common there is one or two testats that
>> > > actually
>> > > > fork a process :)
>> > > > [11:10:56] <ecapriolo> and use build.test.resources
>> > > > [11:11:12] <ecapriolo> Some serde, uses some methods from ql in
>> testing
>> > > > [11:11:27] <ecapriolo> and shims really needs a separate hadoop
>>test
>> > shim
>> > > > [11:11:32] <ecapriolo> But that is all simple stuff
>> > > > [11:11:47] <ecapriolo> The biggest problem is I do not know how to
>> > solve
>> > > > shims with maven
>> > > > [11:11:50] <ecapriolo> do you have any ideas
>> > > > [11:11:52] <ecapriolo> ?
>> > > > [11:13:00] <noland> That one is going to be a challenge. It might
>>be
>> > that
>> > > > in that section we have to drop down to ant
>> > > > [11:14:44] <noland> Is it a requirement that we build both the .20
>> and
>> > > .23
>> > > > shims for a "package" as we do today?
>> > > > [11:16:46] <ecapriolo> I was thinking we can do it like a JDBC
>>driver
>> > > > [11:16:59] <ecapriolo> Se separate out the interface of shims