Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> hive-0.10 and nullpointerexception


Copy link to this message
-
Re: hive-0.10 and nullpointerexception
For the sake of readers, I just saw another manifestation of this problem.

The issue was that mapreduce.framework.name in mapred-site.xml was set
to "yarn" instead of "classic" when the intent was to use MR1.

Hope that helps,
Mark

On Mon, Mar 4, 2013 at 8:26 AM, Mark Grover <[EMAIL PROTECTED]> wrote:
> Sorry for the delayed response, Marcin, I was away.
>
> This error in the Gist means that the jar containing the class in
> question is not on your classpath.
> Exception in thread "Thread-39" java.lang.NoClassDefFoundError:
> org/apache/hadoop/mapreduce/util/HostUtil
>         at org.apache.hadoop.hive.shims.Hadoop23Shims.getTaskAttemptLogUrl(Hadoop23Shims.java:53)
>         at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:186)
>         at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:142)
>         at java.lang.Thread.run(Thread.java:619)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.mapreduce.util.HostUtil
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>         at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>         ... 4 more
>
> So if you add the appropriate jar (hadoop-mapreduce jar?) to your
> classpath, that should take you further.Have you tried that?
>
> On Mon, Feb 25, 2013 at 4:01 AM, Marcin Cylke <[EMAIL PROTECTED]> wrote:
>> On 25/02/13 10:05, Marcin Cylke wrote:
>>
>>> I'll build the trunk and try to test it. Then I'll let you know if that
>>> helped.
>>
>> I've just performed the test on current trunk. The problem is still
>> there, no changes.
>>
>> Any ideas? Perhaps my config says something interesting? I've added it
>> to the GIST: https://gist.github.com/zygm0nt/5028591#file-hive-site-xml
>>
>> The config consists some addidional parameters, but I don't think they
>> would influence MapReduce behavior.
>>
>> Regards
>> Marcin
>>