Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # general >> Build Hadoop 1.0.4 eclipse plugin


+
William Kang 2013-01-12, 18:58
+
Gaurav Kumar 2013-01-12, 19:11
+
William Kang 2013-01-15, 01:51
+
William Kang 2013-01-20, 03:45
+
Gaurav Kumar 2013-01-20, 05:13
+
William Kang 2013-01-20, 18:46
Copy link to this message
-
Re: Build Hadoop 1.0.4 eclipse plugin
I have a compiled eclipse plugin to share:
http://yiyujia.blogspot.com/2012/10/eclipse-mapreduce-plugin-build-for.html

I also write down my steps to compile the plugin from the source code:
http://yiyujia.blogspot.com/2012/11/build-hadoop-eclipse-plugin-from-source.html

I am using CentOS.

On Sun, Jan 20, 2013 at 1:46 PM, William Kang <[EMAIL PROTECTED]>wrote:

> Hi Gaurav,
> I looked up in the eclipse's error log, and the errors are listed:
> The command ("dfs.browser.action.delete") is undefined
> The command ("dfs.browser.action.refresh") is undefined
> The command ("dfs.browser.action.upload_dir") is undefined
> The command ("dfs.browser.action.upload_files") is undefined
> The command ("dfs.browser.action.mkdir") is undefined
> The command ("dfs.browser.action.donload") is undefined
>
> Everything is running on Ubuntu 64 12.04 for both the cluster and
> development machine.
>
> The interesting thing is that the HDFS browsing, uploading, etc., all
> work fine. And if I chose run the driver as "Java Application" it
> works fine in the standalone mode as well. But if I chose to run the
> driver "Run on Hadoop", it simply run in the standalone mode and
> totally ignoring the cluster.
>
> Thanks for your helps.
>
>
> William
>
> On Sun, Jan 20, 2013 at 12:13 AM, Gaurav Kumar <[EMAIL PROTECTED]>
> wrote:
> > Hi William,
> >
> > What error/exception ware you getting specifically?
> > On which platforms are your clusters and eclipse running?
> >
> > Thanks & Regards,
> > Gaurav Kumar
> > Software Engineer
> > HCL Technologies Ltd.
> > Mob: +91-9953294125
> > Blog: TechnoTurd <http://technoturd.wordpress.com/>
> > Connect with me on LinkedIn <http://in.linkedin.com/in/gauravkumar37>
> > <http://in.linkedin.com/in/gauravkumar37>
> >
> >
> > On Sun, Jan 20, 2013 at 9:15 AM, William Kang <[EMAIL PROTECTED]
> >wrote:
> >
> >> Hi,
> >> I got the plugin to work fine with browsing the HDFS system and run
> >> code in the local mode. But the "Run on Hadoop" button doesn't work at
> >> all so I cant deploy the code to the cluster.
> >>
> >> Any suggestions?
> >>
> >> Many thanks.
> >>
> >>
> >> Cao
> >>
> >> On Mon, Jan 14, 2013 at 8:51 PM, William Kang <[EMAIL PROTECTED]>
> >> wrote:
> >> > Hi Gaurav,
> >> > Thanks a lot. It worked! The only small incident is that it doesn't
> >> > compile correctly with Java7. But it works fine with Java6. Thank you
> >> > very much for the instruction.
> >> >
> >> >
> >> > Cao
> >> >
> >> > On Sat, Jan 12, 2013 at 2:11 PM, Gaurav Kumar <
> [EMAIL PROTECTED]>
> >> wrote:
> >> >> Hi William,
> >> >>
> >> >> The general approach is to
> >> >>
> >> >>    1. checkout the code from Apache's SVN
> >> >>    2. modify build.properties in /src/contrib/eclipse-plugin and add
> >> >>    eclipse.home=<path to eclipse>
> >> >>    3. download apache forrest 0.8 and sun jdk 5
> >> >>    4. run ant command as "ant clean package
> >> >>    -Djava5.home=/opt/java/jdk1.5.0_22
> >> -Dforrest.home=/opt/apache-forrest-0.8"
> >> >>    (replace the paths as per your config)
> >> >>    5. you should be online for this
> >> >>    6. after that eclipse plugin should be there in
> >> >>    /build/contrib/eclipse-plugin
> >> >>    7. Now the plugin thus made is not correct
> >> >>    8. open the jar and add the jars of the following in /lib of the
> jar-
> >> >>    commons-configuration, commons-lang,
> >> jackson-core-asl,jackson-mapper-asl
> >> >>    9. modify MANIFEST.MF in /META-INF of the jar to include these
> paths
> >> >>    such as "Bundle-ClassPath:
> >> >>
> >>
>  classes/,lib/hadoop-core.jar,lib/jackson-mapper-asl-1.8.8.jar,lib/jackson-core-asl-1.8.8.jar,lib/commons-configuration-1.6.jar,lib/commons-lang-2.4.jar"
> >> >>    10. copy this jar to plugins folder of eclipse
> >> >>    11. run "eclipse -clean"
> >> >>    12. switch to map reduce perspective
> >> >>
> >> >> 2 noteworthy points:
> >> >>
> >> >>    1. it's really not worth it to build the plugin for later
> versions of
> >> >>    hadoop because even if the plugin has compiled, it doesn't work