Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> Spinning out Hadoop Eclipse Tools


Copy link to this message
-
Re: Spinning out Hadoop Eclipse Tools
Hi Adam,

+1 this seems like a great idea!

Here's a guide to creating an Apache Incubator proposal:

http://incubator.apache.org/guides/proposal.html

You'll need 3 ASF members to be your mentors, 1 of which whom
is willing to be your Champion (the person that takes leadership
of shepherding you guys through the Incubator).

I'm happy to help out in this effort however I can. I had a great experience
mentoring the MRUnit folks and they have done a great job!

Cheers,
Chris

On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:

> Hey Adam,
>
> That would be awesome.   +1
>
> We've discussed moving the various contrib projects out of Hadoop in
> the past, and think it make sense for all the reasons you mention.  A
> good example of how we've done this  was done previously is MRUnit,
> now hosted at http://mrunit.apache.org.
>
> Next steps, if others agree then you can draft a proposal to vote on.
> See this thread and jira for an example:
> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%[EMAIL PROTECTED]%3E
> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>
> Thanks,
> Eli
>
> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <[EMAIL PROTECTED]> wrote:
>> Hello all,
>>
>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>
>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>
>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>
>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>
>> If there is agreement on this, how do we go about getting it done?
>>
>> Thanks,
>>
>> Adam Berry
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: [EMAIL PROTECTED]
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++