I think the PMC should abandon the hod common contrib component.  It's last meaningful contribution was February 2009:

HADOOP-2898. Provide an option to specify a port range for Hadoop services provisioned by HOD. Contributed by Peeyush Bishnoi.

There are 44 unresolved contrib/hod issues in Jira, 1 of them Patch Available since November 2009 (HADOOP-6369).

Here is my +1.

Nige

+1

On Thu, Feb 10, 2011 at 6:51 PM, Nigel Daley <[EMAIL PROTECTED]> wrote:

> I think the PMC should abandon the hod common contrib component.  It's last
> meaningful contribution was February 2009:
>
> HADOOP-2898. Provide an option to specify a port range for Hadoop services
> provisioned by HOD. Contributed by Peeyush Bishnoi.
>
> There are 44 unresolved contrib/hod issues in Jira, 1 of them Patch
> Available since November 2009 (HADOOP-6369).
>
> Here is my +1.
>
> Nige
>

--
Connect to me at http://www.facebook.com/dhruba

+1

On Thu, Feb 10, 2011 at 6:51 PM, Nigel Daley <[EMAIL PROTECTED]> wrote:
> I think the PMC should abandon the hod common contrib component.  It's last meaningful contribution was February 2009:
>
> HADOOP-2898. Provide an option to specify a port range for Hadoop services provisioned by HOD. Contributed by Peeyush Bishnoi.
>
> There are 44 unresolved contrib/hod issues in Jira, 1 of them Patch Available since November 2009 (HADOOP-6369).
>
> Here is my +1.
>
> Nige
>

+1

On 11/02/2011 02:51, Nigel Daley wrote:
> I think the PMC should abandon the hod common contrib component.  It's last meaningful contribution was February 2009:
>
> HADOOP-2898. Provide an option to specify a port range for Hadoop services provisioned by HOD. Contributed by Peeyush Bishnoi.
>
> There are 44 unresolved contrib/hod issues in Jira, 1 of them Patch Available since November 2009 (HADOOP-6369).
>
> Here is my +1.
>
> Nige

+1

On Feb 10, 2011, at 6:51 PM, Nigel Daley wrote:

> I think the PMC should abandon the hod common contrib component.  It's last meaningful contribution was February 2009:
>
> HADOOP-2898. Provide an option to specify a port range for Hadoop services provisioned by HOD. Contributed by Peeyush Bishnoi.
>
> There are 44 unresolved contrib/hod issues in Jira, 1 of them Patch Available since November 2009 (HADOOP-6369).

-1

a) I don't think hod is actually part of any unit tests, so including it would likely only be a burden on the tarball size.
b) The edu community uses this quite extensively, evidenced by the topic coming up on the mailing lists at least once every two months or so and has for years.  Can't say that about the other contrib modules other than the schedulers and streaming.
c) The community that does use it has even submitted a patch that we've ignored.
d) With SGE in flux, there is no equivalent functionality as far as I'm aware.

+1

Tom

On Thu, Feb 10, 2011 at 6:51 PM, Nigel Daley <[EMAIL PROTECTED]> wrote:
> I think the PMC should abandon the hod common contrib component.  It's last meaningful contribution was February 2009:
>
> HADOOP-2898. Provide an option to specify a port range for Hadoop services provisioned by HOD. Contributed by Peeyush Bishnoi.
>
> There are 44 unresolved contrib/hod issues in Jira, 1 of them Patch Available since November 2009 (HADOOP-6369).
>
> Here is my +1.
>
> Nige
>

On Feb 11, 2011, at 9:48 AM, Allen Wittenauer wrote:

>
> On Feb 10, 2011, at 6:51 PM, Nigel Daley wrote:
>
>> I think the PMC should abandon the hod common contrib component.  It's last meaningful contribution was February 2009:
>>
>> HADOOP-2898. Provide an option to specify a port range for Hadoop services provisioned by HOD. Contributed by Peeyush Bishnoi.
>>
>> There are 44 unresolved contrib/hod issues in Jira, 1 of them Patch Available since November 2009 (HADOOP-6369).
>
> -1
>
> a) I don't think hod is actually part of any unit tests, so including it would likely only be a burden on the tarball size.

Not true.  HOD has python unit tests and is the reason our builds have dependencies on python.

> b) The edu community uses this quite extensively, evidenced by the topic coming up on the mailing lists at least once every two months or so and has for years.  Can't say that about the other contrib modules other than the schedulers and streaming.

Then they are using old version of Hadoop.  AFAICT HOD does not work with 0.20 or beyond.

> c) The community that does use it has even submitted a patch that we've ignored.

Which means the committers of this project gave up on it long ago.

Nige

On Feb 11, 2011, at 6:17 PM, Nigel Daley wrote:

>> a) I don't think hod is actually part of any unit tests, so  
>> including it would likely only be a burden on the tarball size.
>
> Not true.  HOD has python unit tests and is the reason our builds  
> have dependencies on python.

But Allen's point is that I don't recall ever seeing HOD test failures  
causing the build to fail.

>> b) The edu community uses this quite extensively, evidenced by the  
>> topic coming up on the mailing lists at least once every two months  
>> or so and has for years.  Can't say that about the other contrib  
>> modules other than the schedulers and streaming.
>
> Then they are using old version of Hadoop.  AFAICT HOD does not work  
> with 0.20 or beyond.

Out of curiosity, what goes wrong? Clearly nothing major has changed  
in starting up a mapreduce cluster in a very long time.

>> c) The community that does use it has even submitted a patch that  
>> we've ignored.
>
> Which means the committers of this project gave up on it long ago.

There are also some patches on core Hadoop that have been sitting for  
a long time, so I don't think that is a valid inference.

I would love to hear some of the people who are using HOD speak up and  
give us their feedback.

-- Owen

On Feb 11, 2011, at 9:15 PM, Owen O'Malley wrote:

>
> On Feb 11, 2011, at 6:17 PM, Nigel Daley wrote:
>
>>> a) I don't think hod is actually part of any unit tests, so including it would likely only be a burden on the tarball size.
>>
>> Not true.  HOD has python unit tests and is the reason our builds have dependencies on python.
>
> But Allen's point is that I don't recall ever seeing HOD test failures causing the build to fail.

Ah, looks like we haven't been testing it via Hudson for a long time.

Nige

Hemanth Yamijala and myself were the main contributors to HOD.

Answers to few of the questions:
  - IIRC, Hod needed python 2.5 (or some such latest) which was not
available on Hudson. The tests gracefully run only when that version is
available. We always used to run these tests on dev boxes before pushing
patches. May be the versions upgraded after that, but I am not sure.
  - HOD wasn't tested extensively with Hadoop 0.20 and beyond. But I
could successfully run HOD clusters with Hadoop 20. Thing that could
affect the run are the configuration properties, environment variables
and the scripts which at that time were backwards compatible. If some
properties were removed in 21/22 breaking compatibility with pre 20
versions (very much possible), that will warrant fixing HOD. Otherwise,
things should work as they are.

Sure would like to know any interest with the users.

Thanks,
+Vinod
On Saturday 12 February 2011 10:45 AM, Owen O'Malley wrote:
> On Feb 11, 2011, at 6:17 PM, Nigel Daley wrote:
>
>>> a) I don't think hod is actually part of any unit tests, so
>>> including it would likely only be a burden on the tarball size.
>> Not true.  HOD has python unit tests and is the reason our builds
>> have dependencies on python.
> But Allen's point is that I don't recall ever seeing HOD test failures
> causing the build to fail.
>
>>> b) The edu community uses this quite extensively, evidenced by the
>>> topic coming up on the mailing lists at least once every two months
>>> or so and has for years.  Can't say that about the other contrib
>>> modules other than the schedulers and streaming.
>> Then they are using old version of Hadoop.  AFAICT HOD does not work
>> with 0.20 or beyond.
> Out of curiosity, what goes wrong? Clearly nothing major has changed
> in starting up a mapreduce cluster in a very long time.
>
>>> c) The community that does use it has even submitted a patch that
>>> we've ignored.
>> Which means the committers of this project gave up on it long ago.
> There are also some patches on core Hadoop that have been sitting for
> a long time, so I don't think that is a valid inference.
>
> I would love to hear some of the people who are using HOD speak up and
> give us their feedback.
>
> -- Owen
>

I am the co-author (with Gianluigi Zanetti) of HADOOP-6369 -- add Grid
Engine support to HOD. At CRS4 we've been using (our patched version of)
HOD since 2008 and we still use it in production. We use Hadoop 0.20.2
since it was released one year ago.

Simone

On 02/12/11 06:15, Owen O'Malley wrote:
>
> On Feb 11, 2011, at 6:17 PM, Nigel Daley wrote:
>
>>> a) I don't think hod is actually part of any unit tests, so including
>>> it would likely only be a burden on the tarball size.
>>
>> Not true.  HOD has python unit tests and is the reason our builds have
>> dependencies on python.
>
> But Allen's point is that I don't recall ever seeing HOD test failures
> causing the build to fail.
>
>>> b) The edu community uses this quite extensively, evidenced by the
>>> topic coming up on the mailing lists at least once every two months
>>> or so and has for years.  Can't say that about the other contrib
>>> modules other than the schedulers and streaming.
>>
>> Then they are using old version of Hadoop.  AFAICT HOD does not work
>> with 0.20 or beyond.
>
> Out of curiosity, what goes wrong? Clearly nothing major has changed in
> starting up a mapreduce cluster in a very long time.
>
>>> c) The community that does use it has even submitted a patch that
>>> we've ignored.
>>
>> Which means the committers of this project gave up on it long ago.
>
> There are also some patches on core Hadoop that have been sitting for a
> long time, so I don't think that is a valid inference.
>
> I would love to hear some of the people who are using HOD speak up and
> give us their feedback.
>
> -- Owen
--
Simone Leo
Data Fusion - Distributed Computing
CRS4
POLARIS - Building #1
Piscina Manna
I-09010 Pula (CA) - Italy
e-mail: [EMAIL PROTECTED]
http://www.crs4.it

For closure, this vote fails due to a binding -1 vote.

Nige

On Feb 18, 2011, at 6:40 AM, Simone Leo wrote:

> I am the co-author (with Gianluigi Zanetti) of HADOOP-6369 -- add Grid
> Engine support to HOD. At CRS4 we've been using (our patched version of)
> HOD since 2008 and we still use it in production. We use Hadoop 0.20.2
> since it was released one year ago.
>
> Simone
>
> On 02/12/11 06:15, Owen O'Malley wrote:
>>
>> On Feb 11, 2011, at 6:17 PM, Nigel Daley wrote:
>>
>>>> a) I don't think hod is actually part of any unit tests, so including
>>>> it would likely only be a burden on the tarball size.
>>>
>>> Not true.  HOD has python unit tests and is the reason our builds have
>>> dependencies on python.
>>
>> But Allen's point is that I don't recall ever seeing HOD test failures
>> causing the build to fail.
>>
>>>> b) The edu community uses this quite extensively, evidenced by the
>>>> topic coming up on the mailing lists at least once every two months
>>>> or so and has for years.  Can't say that about the other contrib
>>>> modules other than the schedulers and streaming.
>>>
>>> Then they are using old version of Hadoop.  AFAICT HOD does not work
>>> with 0.20 or beyond.
>>
>> Out of curiosity, what goes wrong? Clearly nothing major has changed in
>> starting up a mapreduce cluster in a very long time.
>>
>>>> c) The community that does use it has even submitted a patch that
>>>> we've ignored.
>>>
>>> Which means the committers of this project gave up on it long ago.
>>
>> There are also some patches on core Hadoop that have been sitting for a
>> long time, so I don't think that is a valid inference.
>>
>> I would love to hear some of the people who are using HOD speak up and
>> give us their feedback.
>>
>> -- Owen
>
>
> --
> Simone Leo
> Data Fusion - Distributed Computing
> CRS4
> POLARIS - Building #1
> Piscina Manna
> I-09010 Pula (CA) - Italy
> e-mail: [EMAIL PROTECTED]
> http://www.crs4.it

Can any committer with knowledge of HOD please review this patch?

If there are no committers with such knowledge, I would encourage us to
either (a) add a committer to maintain hod, or (b) reconsider the vote to
abandon it as an official contrib. Perhaps Simone and Gianluigi could move
it to a separate incubator project?

-Todd

On Fri, Feb 18, 2011 at 6:40 AM, Simone Leo <[EMAIL PROTECTED]> wrote:

> I am the co-author (with Gianluigi Zanetti) of HADOOP-6369 -- add Grid
> Engine support to HOD. At CRS4 we've been using (our patched version of)
> HOD since 2008 and we still use it in production. We use Hadoop 0.20.2
> since it was released one year ago.
>
> Simone
>
> On 02/12/11 06:15, Owen O'Malley wrote:
> >
> > On Feb 11, 2011, at 6:17 PM, Nigel Daley wrote:
> >
> >>> a) I don't think hod is actually part of any unit tests, so including
> >>> it would likely only be a burden on the tarball size.
> >>
> >> Not true.  HOD has python unit tests and is the reason our builds have
> >> dependencies on python.
> >
> > But Allen's point is that I don't recall ever seeing HOD test failures
> > causing the build to fail.
> >
> >>> b) The edu community uses this quite extensively, evidenced by the
> >>> topic coming up on the mailing lists at least once every two months
> >>> or so and has for years.  Can't say that about the other contrib
> >>> modules other than the schedulers and streaming.
> >>
> >> Then they are using old version of Hadoop.  AFAICT HOD does not work
> >> with 0.20 or beyond.
> >
> > Out of curiosity, what goes wrong? Clearly nothing major has changed in
> > starting up a mapreduce cluster in a very long time.
> >
> >>> c) The community that does use it has even submitted a patch that
> >>> we've ignored.
> >>
> >> Which means the committers of this project gave up on it long ago.
> >
> > There are also some patches on core Hadoop that have been sitting for a
> > long time, so I don't think that is a valid inference.
> >
> > I would love to hear some of the people who are using HOD speak up and
> > give us their feedback.
> >
> > -- Owen
>
>
> --
> Simone Leo
> Data Fusion - Distributed Computing
> CRS4
> POLARIS - Building #1
> Piscina Manna
> I-09010 Pula (CA) - Italy
> e-mail: [EMAIL PROTECTED]
> http://www.crs4.it
>

--
Todd Lipcon
Software Engineer, Cloudera

On Feb 11, 2011, at 11:48 AM, Allen Wittenauer wrote:

>
> On Feb 10, 2011, at 6:51 PM, Nigel Daley wrote:
>
>> I think the PMC should abandon the hod common contrib component.  It's last meaningful contribution was February 2009:
>>
>> HADOOP-2898. Provide an option to specify a port range for Hadoop services provisioned by HOD. Contributed by Peeyush Bishnoi.
>>
>> There are 44 unresolved contrib/hod issues in Jira, 1 of them Patch Available since November 2009 (HADOOP-6369).
>
> -1
I'm removing my -1 to make this a +/-0.

Do what you want.