Hi,

I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed?  Thanks!

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
**********************************************************************

This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.  Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened.  It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).  Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.

Outbound email has been scanned for viruses and SPAM

Hi,
         Please find i think one command is there then only build the all
applications.
Thanks & Regards,
Ramesh.Narasingu

On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <[EMAIL PROTECTED]>wrote:

>  Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed?  Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>

Hi Ramesh

Thanks for the quick reply, but I'm having trouble following your English. Are you saying that there is one command to build everything? If so, can you tell me what it is?

Tony
From: Narasingu Ramesh [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 10:06
To: [EMAIL PROTECTED]
Subject: Re: hadoop trunk build failure - yarn, surefire related?

Hi,
         Please find i think one command is there then only build the all applications.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi,

I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed?  Thanks!

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.

Outbound Email has been scanned for viruses and SPAM

This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************

This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.  Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened.  It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).  Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.

Outbound email has been scanned for viruses and SPAM

It's probably some maven thing -in particular Maven's habit of grabbing the
online nightly snapshots off apache rather than local,

try  mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests

Tony -why not get on the mapreduce-dev mailing list, as this is the place
to discuss build and test process.

On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]> wrote:

>  Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running ��mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed?  Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>

Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.

How do I run the MR tests only?

Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?

Tony
From: Steve Loughran [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 10:45
To: [EMAIL PROTECTED]
Subject: Re: hadoop trunk build failure - yarn, surefire related?

It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,

try  mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests

Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi,

I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed?  Thanks!

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.

Outbound Email has been scanned for viruses and SPAM

This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM

**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.  Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened.  It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).  Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.

Outbound email has been scanned for viruses and SPAM

I tried this:

cd into hadoop-mapreduce-project
ant test

and got further build errors - I’ll try mapreduce-dev.

From: Tony Burton [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 10:55
To: [EMAIL PROTECTED]
Subject: RE: hadoop trunk build failure - yarn, surefire related?

Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.

How do I run the MR tests only?

Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?

Tony
From: Steve Loughran [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 10:45
To: [EMAIL PROTECTED]
Subject: Re: hadoop trunk build failure - yarn, surefire related?

It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,

try  mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests

Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi,

I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed?  Thanks!

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.

Outbound Email has been scanned for viruses and SPAM

This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
P Think of the environment: please don't print this email unless you really need to.

Outbound Email has been scanned for viruses and SPAM

This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.

Inbound Email has been scanned for viruses and SPAM

**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this

Tony,

What I do is:

$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test

This seems to work in running without any missing dependencies at least.

The user lists are all merged, but the developer lists remain separate
as that works better.

On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
> Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though – did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
> Sent: 11 September 2012 10:45
>
>
> To: [EMAIL PROTECTED]
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try  mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]> wrote:
>
> Hi,
>
>
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below –
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed?  Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no

Harsh J

Ok - thanks Harsh.

Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.

Tony
-----Original Message-----
From: Harsh J [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 11:25
To: [EMAIL PROTECTED]
Subject: Re: hadoop trunk build failure - yarn, surefire related?

Tony,

What I do is:

$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test

This seems to work in running without any missing dependencies at least.

The user lists are all merged, but the developer lists remain separate
as that works better.

On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though - did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
> Sent: 11 September 2012 10:45
>
>
> To: [EMAIL PROTECTED]
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try  mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]> wrote:
>
> Hi,
>
>
>
> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> codebase as part of following the "How To Contribute" guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed?  Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the

Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************

This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.  Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened.  It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).  Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.

Outbound email has been scanned for viruses and SPAM

Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.

On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:[EMAIL PROTECTED]]
> Sent: 11 September 2012 11:25
> To: [EMAIL PROTECTED]
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: [EMAIL PROTECTED]
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try  mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed?  Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:
>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>> switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please

Harsh J

That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
-----Original Message-----
From: Harsh J [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 11:36
To: [EMAIL PROTECTED]
Subject: Re: hadoop trunk build failure - yarn, surefire related?

Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.

On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:[EMAIL PROTECTED]]
> Sent: 11 September 2012 11:25
> To: [EMAIL PROTECTED]
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: [EMAIL PROTECTED]
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try  mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed?  Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:

Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************

This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.  Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened.  It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).  Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.

Outbound email has been scanned for viruses and SPAM

I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.

I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk

On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:[EMAIL PROTECTED]]
> Sent: 11 September 2012 11:36
> To: [EMAIL PROTECTED]
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:[EMAIL PROTECTED]]
>> Sent: 11 September 2012 11:25
>> To: [EMAIL PROTECTED]
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: [EMAIL PROTECTED]
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try  mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed?  Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012

Harsh J

Also, for the maven based builds, BUILDING.txt in the root folder of hadoop
source does get one started.

Thanks
hemanth

On Tue, Sep 11, 2012 at 4:28 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> I guess we'll need to clean that guide and divide it in two - For
> branch-1 maintenance contributors, and for trunk contributors.
>
> I had another page that serves a slightly different purpose, but may
> help you just the same:
> http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
>
> On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <[EMAIL PROTECTED]>
> wrote:
> > That's good to know - is there a more up to date guide than
> http://wiki.apache.org/hadoop/HowToContribute which still makes many
> references to ant builds?
> >
> >
> >
> >
> > -----Original Message-----
> > From: Harsh J [mailto:[EMAIL PROTECTED]]
> > Sent: 11 September 2012 11:36
> > To: [EMAIL PROTECTED]
> > Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >
> > Ah there is no longer a need to run ant anymore on trunk. Ignore the
> > leftover files in the base MR project directory - those should be
> > cleaned up soon. All of the functional pieces of the build right now
> > definitely use Maven.
> >
> > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[EMAIL PROTECTED]>
> wrote:
> >> Ok - thanks Harsh.
> >>
> >> Following Steve's earlier advice I tried the mvn install, which worked
> fine, then ant test in hadoop-mapreduce-project which failed. I was
> mid-email to mapreduce-dev@hadoop, now I'll try mvn test in
> hadoop-mapreduce-project and report back.
> >>
> >> Tony
> >>
> >>
> >> -----Original Message-----
> >> From: Harsh J [mailto:[EMAIL PROTECTED]]
> >> Sent: 11 September 2012 11:25
> >> To: [EMAIL PROTECTED]
> >> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>
> >> Tony,
> >>
> >> What I do is:
> >>
> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/;
> mvn test
> >>
> >> This seems to work in running without any missing dependencies at least.
> >>
> >> The user lists are all merged, but the developer lists remain separate
> >> as that works better.
> >>
> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]>
> wrote:
> >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots
> I can
> >>> see came from repository.apache.org though.
> >>>
> >>>
> >>>
> >>> How do I run the MR tests only?
> >>>
> >>>
> >>>
> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all
> lists
> >>> had merged into one though - did I get the wrong end of the stick?
> >>>
> >>>
> >>>
> >>> Tony
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
> >>> Sent: 11 September 2012 10:45
> >>>
> >>>
> >>> To: [EMAIL PROTECTED]
> >>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>>
> >>>
> >>>
> >>> It's probably some maven thing -in particular Maven's habit of
> grabbing the
> >>> online nightly snapshots off apache rather than local,
> >>>
> >>>
> >>>
> >>> try  mvn clean install -DskipTests -offline
> >>>
> >>> to force in all the artifacts, then run the MR tests
> >>>
> >>>
> >>>
> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the
> place to
> >>> discuss build and test process.
> >>>
> >>> On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]>
> wrote:
> >>>
> >>> Hi,
> >>>
> >>>
> >>>
> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> >>> codebase as part of following the "How To Contribute" guide at
> >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> >>> failing in hadoop-mapreduce-client-jobclient, the failure message is
> below -
> >>> something to do with org.hadoop.yarn.client and/or the maven surefire
> >>> plugin. Can anyone suggest how to proceed?  Thanks!
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> [INFO]
> >>>
> -----------------------------------------

Good suggestions Harsh and Hemanth.

When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.

Tony

-----Original Message-----
From: Harsh J [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 11:59
To: [EMAIL PROTECTED]
Subject: Re: hadoop trunk build failure - yarn, surefire related?

I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.

I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk

On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:[EMAIL PROTECTED]]
> Sent: 11 September 2012 11:36
> To: [EMAIL PROTECTED]
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:[EMAIL PROTECTED]]
>> Sent: 11 September 2012 11:25
>> To: [EMAIL PROTECTED]
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: [EMAIL PROTECTED]
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try  mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <[EMAIL PROTECTED]> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -

Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************

This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.  Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened.  It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).  Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.

Outbound email has been scanned for viruses and SPAM

Another "mvn test" caused the build to fail slightly further down the road. As my Jira issue is documentation-only, I've submitted the patch anyway.

Is this multiple-failure scenario typical for trying to build hadoop from the trunk? It's sure putting me off submitting code in future. Is there any way the build process could be reconsidered such that there's only one source of instruction for how to successfully build the project?

Tony
-----Original Message-----
From: Tony Burton [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 12:15
To: [EMAIL PROTECTED]
Subject: RE: hadoop trunk build failure - yarn, surefire related?

Good suggestions Harsh and Hemanth.

When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.

Tony

-----Original Message-----
From: Harsh J [mailto:[EMAIL PROTECTED]]
Sent: 11 September 2012 11:59
To: [EMAIL PROTECTED]
Subject: Re: hadoop trunk build failure - yarn, surefire related?

I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.

I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk

On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:[EMAIL PROTECTED]]
> Sent: 11 September 2012 11:36
> To: [EMAIL PROTECTED]
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:[EMAIL PROTECTED]]
>> Sent: 11 September 2012 11:25
>> To: [EMAIL PROTECTED]
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[EMAIL PROTECTED]> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:[EMAIL PROTECTED]]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: [EMAIL PROTECTED]
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,

Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.  Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened.  It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).  Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.

Outbound email has been scanned for viruses and SPAM
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************

This email and any attachments are confidential, protected by copyright and may be legally privileged.  If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system.  Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer