Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - NoClassDefFoundError: org/apache/hadoop/mapreduce/util/HostUtil


Copy link to this message
-
NoClassDefFoundError: org/apache/hadoop/mapreduce/util/HostUtil
Krishna Rao 2013-02-07, 10:45
Hi all,

I'm occasionally getting the following error, usually after running an
expensive Hive query (creating 20 or so MR jobs):

***
Error during job, obtaining debugging information...
Examining task ID: task_201301291405_1640_r_000001 (and more) from job
job_201301291405_1640
Exception in thread "Thread-29" java.lang.NoClassDefFoundError:
org/apache/hadoop/mapreduce/util/HostUtil
        at
org.apache.hadoop.hive.shims.Hadoop23Shims.getTaskAttemptLogUrl(Hadoop23Shims.java:51)
        at
org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:186)
        at
org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:142)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.mapreduce.util.HostUtil
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        ... 4 more
CmdRunner::runCmd: Error running cmd in script, error: FAILED: Execution
Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
***

Any ideas on what's causing it?
How can I find out more info on this error?

Cheers,

Krishna