Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> MRv2 Configuration in Eclipse

Copy link to this message
Re: MRv2 Configuration in Eclipse

I am able to run the RM, NM and HS from Eclipse with a couple of settings
and run the org.apache.hadoop.examples.RandomWriter from command
promptusing the 'hadoop jar' command. Would be nice for easier
development and
debugging of these components.

But, when I run the org.apache.hadoop.examples.RandomWriter from Eclipse, I
get the below exceptions. I created a new Java project in Eclipse and copied
the RandomWriter.java to it. This exception is getting repeated map number
of times, looks like the error is thrown for every map launch.

Not sure what this error means, any help is appreciated.

2011-08-13 21:44:35,785 INFO  mapreduce.Job (Job.java:printTaskEvents(1213))
- Task Id : attempt_1313250752016_0003_m_000001_2, Status : FAILED
java.lang.RuntimeException: java.lang.ClassNotFoundException:
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:640)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:348)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:148)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:143)
Caused by: java.lang.ClassNotFoundException:
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    ... 8 more


On Wed, Aug 10, 2011 at 10:56 AM, Arun C Murthy <[EMAIL PROTECTED]> wrote:

> Praveen,
> I'm not aware of any devs using eclipse to run MRv2, I haven't tried it
> myself.
>  OTOH, if you do get to we are happy to follow your lead, please feel free
> to provide us instructions and we can update the README... thanks.
> Arun
> On Aug 9, 2011, at 7:39 PM, Praveen Sripati wrote:
> > Hi,
> >
> > Are there any instructions to start the ResourceManager, NodeManager,
> > HistoryServer from Eclipse? I got the code from SVN, compiled it and ran
> the
> > sample program. The projects have also been exported in Eclipse. I want
> to
> > run the RM, NM and HS from Eclipse, so as to see the flow and fix any
> > problems in the code.
> >
> > Thanks,
> > Praveen