Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # dev >> [Discuss] project chop up


Copy link to this message
-
Re: [Discuss] project chop up
This is awesome!

Thanks,
+Vinod

On Aug 20, 2013, at 7:28 AM, Edward Capriolo wrote:

> Just an update. This is going very well:
>
> NFO] Nothing to compile - all classes are up to date
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Hive ....................................... SUCCESS [0.002s]
> [INFO] hive-shims-x ...................................... SUCCESS [1.210s]
> [INFO] hive-shims-20 ..................................... SUCCESS [0.125s]
> [INFO] hive-common ....................................... SUCCESS [0.082s]
> [INFO] hive-serde ........................................ SUCCESS [2.521s]
> [INFO] hive-metastore .................................... SUCCESS [10.818s]
> [INFO] hive-exec ......................................... SUCCESS [4.521s]
> [INFO] hive-avro ......................................... SUCCESS [1.582s]
> [INFO] hive-zookeeper .................................... SUCCESS [0.519s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 21.613s
> [INFO] Finished at: Tue Aug 20 10:23:34 EDT 2013
> [INFO] Final Memory: 39M/408M
>
>
> Though I did some short cuts and disabled some tests. We can build hive
> very fast, including incremental builds. Also we are using maven plugins to
> compile antlr, thrift, protobuf, datanucleas and building those every time.
>
>
> On Fri, Aug 16, 2013 at 11:16 PM, Xuefu Zhang <[EMAIL PROTECTED]> wrote:
>
>> Thanks, Edward.
>>
>> I'm big +1 to mavenize Hive. Hive has long reached a point where it's hard
>> to manage its build using ant. I'd like to help on this too.
>>
>> Thanks,
>> Xuefu
>>
>>
>> On Fri, Aug 16, 2013 at 7:31 PM, Edward Capriolo <[EMAIL PROTECTED]
>>> wrote:
>>
>>> For those interested in pitching in.
>>> https://github.com/edwardcapriolo/hive
>>>
>>>
>>>
>>> On Fri, Aug 16, 2013 at 11:58 AM, Edward Capriolo <[EMAIL PROTECTED]
>>>> wrote:
>>>
>>>> Summary from hive-irc channel. Minor edits for spell check/grammar.
>>>>
>>>> The last 10 lines are a summary of the key points.
>>>>
>>>> [10:59:17] <ecapriolo> noland: et all. Do you want to talk about hive
>> in
>>>> maven?
>>>> [11:01:06] smonchi [~
>>>> [EMAIL PROTECTED]] has quit
>> IRC:
>>>> Quit: ... 'cause there is no patch for human stupidity ...
>>>> [11:10:04] <noland> ecapriolo: yeah that sounds good to me!
>>>> [11:10:22] <noland> I saw you created the jira but haven't had time to
>>> look
>>>> [11:10:32] <ecapriolo> So I found a few things
>>>> [11:10:49] <ecapriolo> In common there is one or two testats that
>>> actually
>>>> fork a process :)
>>>> [11:10:56] <ecapriolo> and use build.test.resources
>>>> [11:11:12] <ecapriolo> Some serde, uses some methods from ql in testing
>>>> [11:11:27] <ecapriolo> and shims really needs a separate hadoop test
>> shim
>>>> [11:11:32] <ecapriolo> But that is all simple stuff
>>>> [11:11:47] <ecapriolo> The biggest problem is I do not know how to
>> solve
>>>> shims with maven
>>>> [11:11:50] <ecapriolo> do you have any ideas
>>>> [11:11:52] <ecapriolo> ?
>>>> [11:13:00] <noland> That one is going to be a challenge. It might be
>> that
>>>> in that section we have to drop down to ant
>>>> [11:14:44] <noland> Is it a requirement that we build both the .20 and
>>> .23
>>>> shims for a "package" as we do today?
>>>> [11:16:46] <ecapriolo> I was thinking we can do it like a JDBC driver
>>>> [11:16:59] <ecapriolo> Se separate out the interface of shims
>>>> [11:17:22] <ecapriolo> And then at runtime we drop in a driver
>>> implementing
>>>> [11:17:34] Wertax [~[EMAIL PROTECTED]] has quit IRC: Remote
>> host
>>>> closed the connection
>>>> [11:17:36] <ecapriolo> That or we could use maven's profile system
>>>> [11:18:09] <ecapriolo> It seems that everything else can actually link
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.