Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # dev - Re: Mavenizing the HDFS build


Copy link to this message
-
Re: Mavenizing the HDFS build
Alejandro Abdelnur 2011-08-19, 18:26
Hey Cos,

Given the size of the Mavenization work we broke into several pieces and we
are working them incrementally.

Because of that some disruption is happening to some parts of the build and
components.

There is a JIRA open for the AOP stuff (
https://issues.apache.org/jira/browse/HADOOP-7481).

There you've indicated you'd take a stab at it. Given that you are familiar
with AOP and how it is used in Hadoop, I guess you are the best person to
take care of this part of the puzzle.

Thanks.

Alejandro

On Fri, Aug 19, 2011 at 11:09 AM, Konstantin Boudnik <[EMAIL PROTECTED]> wrote:

> I see that the whole AOP stuff has been taken out along with Herriot work.
> I don't see any discussion about this on the JIRA. Neither I don't see any
> tickets created to track the effort (but a subtask for FI tests in
> HADOOP-7412).
>
> Any reason we are missing a big chunk of validation infrastructure in the
> mavenized build?
>
> Cos
>
> On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> > HDFS-2096 is now committed to trunk. The instructions for building
> > HDFS can be found in the top-level BUILDING.txt file.
> >
> > I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> > to help with migrating HDFS patches to the new layout.
> >
> > There are a few follow-up patches that need doing soon (e.g.
> > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > folks from doing development as usual.
> >
> > Thanks to everyone who helped with this!
> >
> > Cheers,
> > Tom
> >
> > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <[EMAIL PROTECTED]> wrote:
> > > Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> > > mavenization changes tomorrow (Friday) at 9am PDT.
> > >
> > > Cheers,
> > > Tom
> > >
> > > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <[EMAIL PROTECTED]>
> wrote:
> > >> Thanks Tom.
> > >>
> > >> I'm running the final set of tests with the 'MR-279 rebased on trunk'
> and should be done by tmrw.
> > >>
> > >> Also, can you guys please ensure that secure HDFS works after
> mvn'ization?
> > >>
> > >> thanks,
> > >> Arun
> > >>
> > >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> > >>
> > >>> Hi Arun,
> > >>>
> > >>> I'm fine with that. When do you expect to start the vote?
> > >>>
> > >>> Cheers,
> > >>> Tom
> > >>>
> > >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <[EMAIL PROTECTED]>
> wrote:
> > >>>> Hi Tom,
> > >>>>
> > >>>> ═Can I request you to wait on this commit until we merge MR-279? As
> Vinod pointed out in his mail to mapreduce-dev@ we are very close to
> getting the merge done. We should call a vote asap. By holding off it the
> mvn patch it will save us a bit of time - we spent at more than a couple of
> days on resolving after the common mvn'ization.
> > >>>>
> > >>>> ═Thanks for understanding.
> > >>>>
> > >>>> Arun
> > >>>>
> > >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> > >>>>
> > >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> ready
> > >>>>> to be committed, so unless there are any objections I will do so on
> > >>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> > >>>>>
> > >>>>> I'll also create a script to convert patches to the new layout, and
> > >>>>> switch over the Jenkins jobs that test and build HDFS.
> > >>>>>
> > >>>>> Cheers,
> > >>>>> Tom
> > >>>>
> > >>>>
> > >>
> > >>
> > >
>