Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> hadoop trunk build failure - yarn, surefire related?


+
Tony Burton 2012-09-11, 08:58
+
Narasingu Ramesh 2012-09-11, 09:05
+
Tony Burton 2012-09-11, 09:19
+
Steve Loughran 2012-09-11, 09:45
+
Tony Burton 2012-09-11, 09:54
+
Harsh J 2012-09-11, 10:25
+
Tony Burton 2012-09-11, 10:31
+
Harsh J 2012-09-11, 10:36
+
Tony Burton 2012-09-11, 10:39
+
Harsh J 2012-09-11, 10:58
Copy link to this message
-
RE: hadoop trunk build failure - yarn, surefire related?
Good suggestions Harsh and Hemanth.

When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.

Tony

-----Original Message-----
From: Harsh J [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 11:59
To: [EMAIL PROTECTED]
Subject: Re: hadoop trunk build failure - yarn, surefire related?

I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.

I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk

On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:[EMAIL PROTECTED]]
> Sent: 11 September 2012 11:36
> To: [EMAIL PROTECTED]
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:[EMAIL PROTECTED]]
>> Sent: 11 September 2012 11:25
>> To: [EMAIL PROTECTED]
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: [EMAIL PROTECTED]
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try  mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -

Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************

This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.  Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened.  It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).  Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.

Outbound email has been scanned for viruses and SPAM
+
Tony Burton 2012-09-11, 15:42
+
Hemanth Yamijala 2012-09-11, 11:02
+
Tony Burton 2012-09-11, 10:21
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB