Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # dev - Re: Mavenizing the HDFS build


Copy link to this message
-
Re: Mavenizing the HDFS build
Alejandro Abdelnur 2011-08-19, 18:45
Cos,

Thanks for catching that, I've missed that AOP was being used for 2
different things.

Alejandro

On Fri, Aug 19, 2011 at 11:37 AM, Konstantin Boudnik <[EMAIL PROTECTED]> wrote:

> Right, Common has the tracking for AOP FI tests. There's Herrior work
> (system
> cluster tests) which is separate from FI although is using the same
> technology.
>
> My point was that HDFS ticket doesn't have any traces of it which makes me
> wonder if it has been removed or else. I see your point and I'll add new
> subtasks to the JIRAs.
>
> Cos
>
> On Fri, Aug 19, 2011 at 11:26AM, Alejandro Abdelnur wrote:
> > Hey Cos,
> >
> > Given the size of the Mavenization work we broke into several pieces and
> we
> > are working them incrementally.
> >
> > Because of that some disruption is happening to some parts of the build
> and
> > components.
> >
> > There is a JIRA open for the AOP stuff (
> > https://issues.apache.org/jira/browse/HADOOP-7481).
> >
> > There you've indicated you'd take a stab at it. Given that you are
> familiar
> > with AOP and how it is used in Hadoop, I guess you are the best person to
> > take care of this part of the puzzle.
> >
> > Thanks.
> >
> > Alejandro
> >
> > On Fri, Aug 19, 2011 at 11:09 AM, Konstantin Boudnik <[EMAIL PROTECTED]>
> wrote:
> >
> > > I see that the whole AOP stuff has been taken out along with Herriot
> work.
> > > I don't see any discussion about this on the JIRA. Neither I don't see
> any
> > > tickets created to track the effort (but a subtask for FI tests in
> > > HADOOP-7412).
> > >
> > > Any reason we are missing a big chunk of validation infrastructure in
> the
> > > mavenized build?
> > >
> > > Cos
> > >
> > > On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> > > > HDFS-2096 is now committed to trunk. The instructions for building
> > > > HDFS can be found in the top-level BUILDING.txt file.
> > > >
> > > > I added a script to
> https://issues.apache.org/jira/browse/HADOOP-7500
> > > > to help with migrating HDFS patches to the new layout.
> > > >
> > > > There are a few follow-up patches that need doing soon (e.g.
> > > > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > > > folks from doing development as usual.
> > > >
> > > > Thanks to everyone who helped with this!
> > > >
> > > > Cheers,
> > > > Tom
> > > >
> > > > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <[EMAIL PROTECTED]>
> wrote:
> > > > > Now that MR-279 has been merged into trunk, I plan to commit the
> HDFS
> > > > > mavenization changes tomorrow (Friday) at 9am PDT.
> > > > >
> > > > > Cheers,
> > > > > Tom
> > > > >
> > > > > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <
> [EMAIL PROTECTED]>
> > > wrote:
> > > > >> Thanks Tom.
> > > > >>
> > > > >> I'm running the final set of tests with the 'MR-279 rebased on
> trunk'
> > > and should be done by tmrw.
> > > > >>
> > > > >> Also, can you guys please ensure that secure HDFS works after
> > > mvn'ization?
> > > > >>
> > > > >> thanks,
> > > > >> Arun
> > > > >>
> > > > >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> > > > >>
> > > > >>> Hi Arun,
> > > > >>>
> > > > >>> I'm fine with that. When do you expect to start the vote?
> > > > >>>
> > > > >>> Cheers,
> > > > >>> Tom
> > > > >>>
> > > > >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <
> [EMAIL PROTECTED]>
> > > wrote:
> > > > >>>> Hi Tom,
> > > > >>>>
> > > > >>>> ═Can I request you to wait on this commit until we merge MR-279?
> As
> > > Vinod pointed out in his mail to mapreduce-dev@ we are very close to
> > > getting the merge done. We should call a vote asap. By holding off it
> the
> > > mvn patch it will save us a bit of time - we spent at more than a
> couple of
> > > days on resolving after the common mvn'ization.
> > > > >>>>
> > > > >>>> ═Thanks for understanding.
> > > > >>>>
> > > > >>>> Arun
> > > > >>>>
> > > > >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> > > > >>>>
> > > > >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> > > ready
> > > > >>>>