It seems that we're not publishing maven snapshots correctly. I'm not
entirely sure why, but if you look at:
https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/
you'll see the latest snapshots are from 9/14 or so.

Anyone have any idea what's going on here?

-Todd
--
Todd Lipcon
Software Engineer, Cloudera

Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but
not the 0.23 builds.

It seems we should either (a) add "mvn deploy" to the
Hadoop-*-0.23-Build targets (which run nightly), or (b) add a
cross-project "0.23-commit" build which is triggered on any commit to
0.23 and does a mvn deploy across all the projects, without running
any tests.

Any preferences?

On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon <[EMAIL PROTECTED]> wrote:
> It seems that we're not publishing maven snapshots correctly. I'm not
> entirely sure why, but if you look at:
> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/
> you'll see the latest snapshots are from 9/14 or so.
>
> Anyone have any idea what's going on here?
>
> -Todd
> --
> Todd Lipcon
> Software Engineer, Cloudera
>

--
Todd Lipcon
Software Engineer, Cloudera

Todd,
I like the idea of setting up commit builds for 23 branch; I can set
this up.
-Giri

On 10/14/11 12:23 PM, Todd Lipcon wrote:
> Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but
> not the 0.23 builds.
>
> It seems we should either (a) add "mvn deploy" to the
> Hadoop-*-0.23-Build targets (which run nightly), or (b) add a
> cross-project "0.23-commit" build which is triggered on any commit to
> 0.23 and does a mvn deploy across all the projects, without running
> any tests.
>
> Any preferences?
>
> On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon<[EMAIL PROTECTED]>  wrote:
>> It seems that we're not publishing maven snapshots correctly. I'm not
>> entirely sure why, but if you look at:
>> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/
>> you'll see the latest snapshots are from 9/14 or so.
>>
>> Anyone have any idea what's going on here?
>>
>> -Todd
>> --
>> Todd Lipcon
>> Software Engineer, Cloudera
>>
>
>
--
-Giri

On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan
<[EMAIL PROTECTED]> wrote:
> Todd,
> I like the idea of setting up commit builds for 23 branch; I can set this
> up.

OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on it.

-Todd

>
> On 10/14/11 12:23 PM, Todd Lipcon wrote:
>>
>> Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but
>> not the 0.23 builds.
>>
>> It seems we should either (a) add "mvn deploy" to the
>> Hadoop-*-0.23-Build targets (which run nightly), or (b) add a
>> cross-project "0.23-commit" build which is triggered on any commit to
>> 0.23 and does a mvn deploy across all the projects, without running
>> any tests.
>>
>> Any preferences?
>>
>> On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon<[EMAIL PROTECTED]>  wrote:
>>>
>>> It seems that we're not publishing maven snapshots correctly. I'm not
>>> entirely sure why, but if you look at:
>>>
>>> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/
>>> you'll see the latest snapshots are from 9/14 or so.
>>>
>>> Anyone have any idea what's going on here?
>>>
>>> -Todd
>>> --
>>> Todd Lipcon
>>> Software Engineer, Cloudera
>>>
>>
>>
>
>
> --
> -Giri
>
>

--
Todd Lipcon
Software Engineer, Cloudera

+1, thanks Todd.

On Oct 14, 2011, at 12:53 PM, Todd Lipcon wrote:

> On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan
> <[EMAIL PROTECTED]> wrote:
>> Todd,
>> I like the idea of setting up commit builds for 23 branch; I can set this
>> up.
>
> OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on it.
>
> -Todd
>
>>
>> On 10/14/11 12:23 PM, Todd Lipcon wrote:
>>>
>>> Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but
>>> not the 0.23 builds.
>>>
>>> It seems we should either (a) add "mvn deploy" to the
>>> Hadoop-*-0.23-Build targets (which run nightly), or (b) add a
>>> cross-project "0.23-commit" build which is triggered on any commit to
>>> 0.23 and does a mvn deploy across all the projects, without running
>>> any tests.
>>>
>>> Any preferences?
>>>
>>> On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon<[EMAIL PROTECTED]>  wrote:
>>>>
>>>> It seems that we're not publishing maven snapshots correctly. I'm not
>>>> entirely sure why, but if you look at:
>>>>
>>>> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/
>>>> you'll see the latest snapshots are from 9/14 or so.
>>>>
>>>> Anyone have any idea what's going on here?
>>>>
>>>> -Todd
>>>> --
>>>> Todd Lipcon
>>>> Software Engineer, Cloudera
>>>>
>>>
>>>
>>
>>
>> --
>> -Giri
>>
>>
>
>
>
> --
> Todd Lipcon
> Software Engineer, Cloudera

I was able to publish HDFS and Common, but couldn't publish MR/YARN due to:

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-deploy-plugin:2.5:deploy
(default-deploy) on project hadoop-yarn-api: Deployment failed:
repository element was not specified in the POM inside
distributionManagement element or in
-DaltDeploymentRepository=id::layout::url parameter -> [Help 1]

I think this is MAPREDUCE-3003. Will wait on Tom or Alejandro to fix that.

-Todd

On Fri, Oct 14, 2011 at 12:57 PM, Arun C Murthy <[EMAIL PROTECTED]> wrote:
> +1, thanks Todd.
>
> On Oct 14, 2011, at 12:53 PM, Todd Lipcon wrote:
>
>> On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan
>> <[EMAIL PROTECTED]> wrote:
>>> Todd,
>>> I like the idea of setting up commit builds for 23 branch; I can set this
>>> up.
>>
>> OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on it.
>>
>> -Todd
>>
>>>
>>> On 10/14/11 12:23 PM, Todd Lipcon wrote:
>>>>
>>>> Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but
>>>> not the 0.23 builds.
>>>>
>>>> It seems we should either (a) add "mvn deploy" to the
>>>> Hadoop-*-0.23-Build targets (which run nightly), or (b) add a
>>>> cross-project "0.23-commit" build which is triggered on any commit to
>>>> 0.23 and does a mvn deploy across all the projects, without running
>>>> any tests.
>>>>
>>>> Any preferences?
>>>>
>>>> On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon<[EMAIL PROTECTED]>  wrote:
>>>>>
>>>>> It seems that we're not publishing maven snapshots correctly. I'm not
>>>>> entirely sure why, but if you look at:
>>>>>
>>>>> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/
>>>>> you'll see the latest snapshots are from 9/14 or so.
>>>>>
>>>>> Anyone have any idea what's going on here?
>>>>>
>>>>> -Todd
>>>>> --
>>>>> Todd Lipcon
>>>>> Software Engineer, Cloudera
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> -Giri
>>>
>>>
>>
>>
>>
>> --
>> Todd Lipcon
>> Software Engineer, Cloudera
>
>

--
Todd Lipcon
Software Engineer, Cloudera

I've just uploaded a patch for MAPREDUCE-3003.

What is left to test is to get HDFS/MR2 running for a build and run an
example.

I don't think I'll have a chance to do that test today.

If somebody volunteers and does the run and +1 then it can be committed to
trunk and on Monday or Tuesday we can commit to to 0.23 as part of
HADOOP-7741

Thanks.

Alejandro

On Fri, Oct 14, 2011 at 1:26 PM, Todd Lipcon <[EMAIL PROTECTED]> wrote:

> I was able to publish HDFS and Common, but couldn't publish MR/YARN due to:
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-deploy-plugin:2.5:deploy
> (default-deploy) on project hadoop-yarn-api: Deployment failed:
> repository element was not specified in the POM inside
> distributionManagement element or in
> -DaltDeploymentRepository=id::layout::url parameter -> [Help 1]
>
> I think this is MAPREDUCE-3003. Will wait on Tom or Alejandro to fix that.
>
> -Todd
>
> On Fri, Oct 14, 2011 at 12:57 PM, Arun C Murthy <[EMAIL PROTECTED]>
> wrote:
> > +1, thanks Todd.
> >
> > On Oct 14, 2011, at 12:53 PM, Todd Lipcon wrote:
> >
> >> On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan
> >> <[EMAIL PROTECTED]> wrote:
> >>> Todd,
> >>> I like the idea of setting up commit builds for 23 branch; I can set
> this
> >>> up.
> >>
> >> OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on
> it.
> >>
> >> -Todd
> >>
> >>>
> >>> On 10/14/11 12:23 PM, Todd Lipcon wrote:
> >>>>
> >>>> Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but
> >>>> not the 0.23 builds.
> >>>>
> >>>> It seems we should either (a) add "mvn deploy" to the
> >>>> Hadoop-*-0.23-Build targets (which run nightly), or (b) add a
> >>>> cross-project "0.23-commit" build which is triggered on any commit to
> >>>> 0.23 and does a mvn deploy across all the projects, without running
> >>>> any tests.
> >>>>
> >>>> Any preferences?
> >>>>
> >>>> On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon<[EMAIL PROTECTED]>
>  wrote:
> >>>>>
> >>>>> It seems that we're not publishing maven snapshots correctly. I'm not
> >>>>> entirely sure why, but if you look at:
> >>>>>
> >>>>>
> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/
> >>>>> you'll see the latest snapshots are from 9/14 or so.
> >>>>>
> >>>>> Anyone have any idea what's going on here?
> >>>>>
> >>>>> -Todd
> >>>>> --
> >>>>> Todd Lipcon
> >>>>> Software Engineer, Cloudera
> >>>>>
> >>>>
> >>>>
> >>>
> >>>
> >>> --
> >>> -Giri
> >>>
> >>>
> >>
> >>
> >>
> >> --
> >> Todd Lipcon
> >> Software Engineer, Cloudera
> >
> >
>
>
>
> --
> Todd Lipcon
> Software Engineer, Cloudera
>

Okay, I ve done the 0.23 commit setup.
Builds up and running for common/hdfs and Mapred

https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-0.23-Commit/
https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-0.23-Commit/
https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-0.23-Commit/

-Giri
On 10/14/11 12:53 PM, Todd Lipcon wrote:
> On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan
> <[EMAIL PROTECTED]>  wrote:
>> Todd,
>> I like the idea of setting up commit builds for 23 branch; I can set this
>> up.
> OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on it.
>
> -Todd
>
>> On 10/14/11 12:23 PM, Todd Lipcon wrote:
>>> Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but
>>> not the 0.23 builds.
>>>
>>> It seems we should either (a) add "mvn deploy" to the
>>> Hadoop-*-0.23-Build targets (which run nightly), or (b) add a
>>> cross-project "0.23-commit" build which is triggered on any commit to
>>> 0.23 and does a mvn deploy across all the projects, without running
>>> any tests.
>>>
>>> Any preferences?
>>>
>>> On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon<[EMAIL PROTECTED]>    wrote:
>>>> It seems that we're not publishing maven snapshots correctly. I'm not
>>>> entirely sure why, but if you look at:
>>>>
>>>> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/
>>>> you'll see the latest snapshots are from 9/14 or so.
>>>>
>>>> Anyone have any idea what's going on here?
>>>>
>>>> -Todd
>>>> --
>>>> Todd Lipcon
>>>> Software Engineer, Cloudera
>>>>
>>>
>>
>> --
>> -Giri
>>
>>
>
>
--
-Giri

Thanks Giri!

mahadev

On Fri, Oct 14, 2011 at 3:30 PM, giridharan kesavan
<[EMAIL PROTECTED]> wrote:
>
> Okay, I ve done the 0.23 commit setup.
> Builds up and running for common/hdfs and Mapred
>
> https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-0.23-Commit/
> https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-0.23-Commit/
> https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-0.23-Commit/
>
> -Giri
>
>
> On 10/14/11 12:53 PM, Todd Lipcon wrote:
>>
>> On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan
>> <[EMAIL PROTECTED]>  wrote:
>>>
>>> Todd,
>>> I like the idea of setting up commit builds for 23 branch; I can set this
>>> up.
>>
>> OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on
>> it.
>>
>> -Todd
>>
>>> On 10/14/11 12:23 PM, Todd Lipcon wrote:
>>>>
>>>> Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but
>>>> not the 0.23 builds.
>>>>
>>>> It seems we should either (a) add "mvn deploy" to the
>>>> Hadoop-*-0.23-Build targets (which run nightly), or (b) add a
>>>> cross-project "0.23-commit" build which is triggered on any commit to
>>>> 0.23 and does a mvn deploy across all the projects, without running
>>>> any tests.
>>>>
>>>> Any preferences?
>>>>
>>>> On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon<[EMAIL PROTECTED]>
>>>>  wrote:
>>>>>
>>>>> It seems that we're not publishing maven snapshots correctly. I'm not
>>>>> entirely sure why, but if you look at:
>>>>>
>>>>>
>>>>> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/
>>>>> you'll see the latest snapshots are from 9/14 or so.
>>>>>
>>>>> Anyone have any idea what's going on here?
>>>>>
>>>>> -Todd
>>>>> --
>>>>> Todd Lipcon
>>>>> Software Engineer, Cloudera
>>>>>
>>>>
>>>
>>> --
>>> -Giri
>>>
>>>
>>
>>
>
>
> --
> -Giri
>
>

Looks like recent snapshots have been pushed for common and hdfs, but not
mapred/mapreduce:

https://repository.apache.org/content/repositories/snapshots/org/apache/hado
op/hadoop-mapred/0.23.0-SNAPSHOT/
https://repository.apache.org/content/repositories/snapshots/org/apache/hado
op/hadoop-mapreduce/0.23.0-SNAPSHOT/

We are looking for this to build pig for .23
On 10/14/11 4:08 PM, "Olga Natkovich" <[EMAIL PROTECTED]> wrote:

> Is this what we needed?
>
> -----Original Message-----
> From: Mahadev Konar [mailto:[EMAIL PROTECTED]]
> Sent: Friday, October 14, 2011 4:00 PM
> To: [EMAIL PROTECTED]
> Cc: Todd Lipcon
> Subject: Re: Publishing maven snapshots for 0.23?
>
> Thanks Giri!
>
> mahadev
>
> On Fri, Oct 14, 2011 at 3:30 PM, giridharan kesavan
> <[EMAIL PROTECTED]> wrote:
>>
>> Okay, I ve done the 0.23 commit setup.
>> Builds up and running for common/hdfs and Mapred
>>
>> https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-0.23-Commit/
>> https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-0.23-Commit/
>> https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-0.23-Comm
>> it/
>>
>> -Giri
>>
>>
>> On 10/14/11 12:53 PM, Todd Lipcon wrote:
>>>
>>> On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan
>>> <[EMAIL PROTECTED]>  wrote:
>>>>
>>>> Todd,
>>>> I like the idea of setting up commit builds for 23 branch; I can set this
>>>> up.
>>>
>>> OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on
>>> it.
>>>
>>> -Todd
>>>
>>>> On 10/14/11 12:23 PM, Todd Lipcon wrote:
>>>>>
>>>>> Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but
>>>>> not the 0.23 builds.
>>>>>
>>>>> It seems we should either (a) add "mvn deploy" to the
>>>>> Hadoop-*-0.23-Build targets (which run nightly), or (b) add a
>>>>> cross-project "0.23-commit" build which is triggered on any commit to
>>>>> 0.23 and does a mvn deploy across all the projects, without running
>>>>> any tests.
>>>>>
>>>>> Any preferences?
>>>>>
>>>>> On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon<[EMAIL PROTECTED]>
>>>>>  wrote:
>>>>>>
>>>>>> It seems that we're not publishing maven snapshots correctly. I'm not
>>>>>> entirely sure why, but if you look at:
>>>>>>
>>>>>>
>>>>>> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/
>>>>>> hadoop-common/
>>>>>> you'll see the latest snapshots are from 9/14 or so.
>>>>>>
>>>>>> Anyone have any idea what's going on here?
>>>>>>
>>>>>> -Todd
>>>>>> --
>>>>>> Todd Lipcon
>>>>>> Software Engineer, Cloudera
>>>>>>
>>>>>
>>>>
>>>> --
>>>> -Giri
>>>>
>>>>
>>>
>>>
>>
>>
>> --
>> -Giri
>>
>>

On 14/10/11 20:53, Todd Lipcon wrote:
> On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan
> <[EMAIL PROTECTED]>  wrote:
>> Todd,
>> I like the idea of setting up commit builds for 23 branch; I can set this
>> up.
>

As I said on -general, I'd like some stable-ish pre-alpha artifacts for
downstream projects to use, something like a weekly -or after a big fix-
should be sufficient. Unlike SNAPSHOT these shouldn't change without
warning, letting people switch backwards and forwards to catch regressions