Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - hadoop trunk build failure - yarn, surefire related?


Copy link to this message
-
Re: hadoop trunk build failure - yarn, surefire related?
Hemanth Yamijala 2012-09-11, 11:02
Also, for the maven based builds, BUILDING.txt in the root folder of hadoop
source does get one started.

Thanks
hemanth

On Tue, Sep 11, 2012 at 4:28 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> I guess we'll need to clean that guide and divide it in two - For
> branch-1 maintenance contributors, and for trunk contributors.
>
> I had another page that serves a slightly different purpose, but may
> help you just the same:
> http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
>
> On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <[EMAIL PROTECTED]>
> wrote:
> > That's good to know - is there a more up to date guide than
> http://wiki.apache.org/hadoop/HowToContribute which still makes many
> references to ant builds?
> >
> >
> >
> >
> > -----Original Message-----
> > From: Harsh J [mailto:[EMAIL PROTECTED]]
> > Sent: 11 September 2012 11:36
> > To: [EMAIL PROTECTED]
> > Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >
> > Ah there is no longer a need to run ant anymore on trunk. Ignore the
> > leftover files in the base MR project directory - those should be
> > cleaned up soon. All of the functional pieces of the build right now
> > definitely use Maven.
> >
> > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[EMAIL PROTECTED]>
> wrote:
> >> Ok - thanks Harsh.
> >>
> >> Following Steve's earlier advice I tried the mvn install, which worked
> fine, then ant test in hadoop-mapreduce-project which failed. I was
> mid-email to mapreduce-dev@hadoop, now I'll try mvn test in
> hadoop-mapreduce-project and report back.
> >>
> >> Tony
> >>
> >>
> >> -----Original Message-----
> >> From: Harsh J [mailto:[EMAIL PROTECTED]]
> >> Sent: 11 September 2012 11:25
> >> To: [EMAIL PROTECTED]
> >> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>
> >> Tony,
> >>
> >> What I do is:
> >>
> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/;
> mvn test
> >>
> >> This seems to work in running without any missing dependencies at least.
> >>
> >> The user lists are all merged, but the developer lists remain separate
> >> as that works better.
> >>
> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]>
> wrote:
> >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots
> I can
> >>> see came from repository.apache.org though.
> >>>
> >>>
> >>>
> >>> How do I run the MR tests only?
> >>>
> >>>
> >>>
> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all
> lists
> >>> had merged into one though - did I get the wrong end of the stick?
> >>>
> >>>
> >>>
> >>> Tony
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
> >>> Sent: 11 September 2012 10:45
> >>>
> >>>
> >>> To: [EMAIL PROTECTED]
> >>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>>
> >>>
> >>>
> >>> It's probably some maven thing -in particular Maven's habit of
> grabbing the
> >>> online nightly snapshots off apache rather than local,
> >>>
> >>>
> >>>
> >>> try  mvn clean install -DskipTests -offline
> >>>
> >>> to force in all the artifacts, then run the MR tests
> >>>
> >>>
> >>>
> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the
> place to
> >>> discuss build and test process.
> >>>
> >>> On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]>
> wrote:
> >>>
> >>> Hi,
> >>>
> >>>
> >>>
> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> >>> codebase as part of following the "How To Contribute" guide at
> >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> >>> failing in hadoop-mapreduce-client-jobclient, the failure message is
> below -
> >>> something to do with org.hadoop.yarn.client and/or the maven surefire
> >>> plugin. Can anyone suggest how to proceed?  Thanks!
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> [INFO]
> >>>
> -----------------------------------------