Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> Spinning out Hadoop Eclipse Tools


Copy link to this message
-
Re: Spinning out Hadoop Eclipse Tools
I am +1 on this too.  I would love to see better tool support for Hadoop.

--Bobby

On 9/17/12 2:42 PM, "Eli Collins" <[EMAIL PROTECTED]> wrote:

>Hey Adam,
>
>That would be awesome.   +1
>
>We've discussed moving the various contrib projects out of Hadoop in
>the past, and think it make sense for all the reasons you mention.  A
>good example of how we've done this  was done previously is MRUnit,
>now hosted at http://mrunit.apache.org.
>
>Next steps, if others agree then you can draft a proposal to vote on.
>See this thread and jira for an example:
>http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C774
>[EMAIL PROTECTED]%3E
>https://issues.apache.org/jira/browse/MAPREDUCE-2430
>
>Thanks,
>Eli
>
>On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <[EMAIL PROTECTED]>
>wrote:
>> Hello all,
>>
>> I'm proposing spinning out the eclipse plugin from the main hadoop
>>source into a separate incubating project. I'm willing to commit to this
>>effort.
>>
>> With a separate project, that isn't tied (source wise) to the Hadoop
>>source we could make dev tools that could support multiple versions of
>>Hadoop from within a single IDE, which would be very helpful when
>>migrating jobs or dealing with clusters running different versions.
>>
>> The current tools seem to support the 0.20 line, and help with
>>developing MR jobs, and also have some HDFS tools included. So the early
>>work would be to ensure that these features were supported across the
>>version space of Hadoop.
>>
>> Down the line we could also add support for additional tools such as
>>MRUnit and other products in the Hadoop ecosystem, to eventually yield a
>>one stop project for all dev tools around this space.
>>
>> If there is agreement on this, how do we go about getting it done?
>>
>> Thanks,
>>
>> Adam Berry