Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Issue with DistributedCache


Copy link to this message
-
Re: Issue with DistributedCache
Hi Denis
       Unfortunately the mailing lists strips off attachments, So it'd be
great if you could paste the source in some location and share the url of
the same. If the source is small enough then please include the same in
subject body.

For a quick comparison,  Try comparing your code with the following sample.
I just scribbled it long back and it was working
http://kickstarthadoop.blogspot.com/2011/05/word-count-example-with-hadoop-020.html

Hope it helps!..

Regards
Bejoy.K.S

On Thu, Nov 24, 2011 at 4:20 PM, Denis Kreis <[EMAIL PROTECTED]> wrote:

> Hi
>
> I' trying to modify the word count example
> (http://wiki.apache.org/hadoop/WordCount) using the new api
> (org.apache.hadoop.mapreduce.*). I run the job on a remote
> pseudo-distributed cluster. It works fine with the old api, but when I
> using the new one, i'm getting this:
>
>
> 11/11/24 11:28:02 INFO mapred.JobClient: Task Id :
> attempt_201111241046_0005_m_000000_0, Status : FAILED
> java.lang.RuntimeException: java.lang.ClassNotFoundException:
> WordCountNewAPI$WordCountMapper
>        at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:866)
>        at
> org.apache.hadoop.mapreduce.JobContext.getMapperClass(JobContext.java:199)
>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:719)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at javax.security.auth.Subject.doAs(Subject.java:396)
>        at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>        at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: java.lang.ClassNotFoundException:
> WordCountNewAPI$WordCountMapper
>        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>        at java.lang.Class.forName0(Native Method)
>        at java.lang.Class.forName(Class.java:247)
>        at
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:819)
>        at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:864)
>        ... 8 more
>
> The sources are in the attachment
>
> Regards
> Denis
>