-Re: hive-0.10 and nullpointerexception
Mark Grover 2013-03-18, 17:30
For the sake of readers, I just saw another manifestation of this problem.
The issue was that mapreduce.framework.name in mapred-site.xml was set
to "yarn" instead of "classic" when the intent was to use MR1.
Hope that helps,
On Mon, Mar 4, 2013 at 8:26 AM, Mark Grover <[EMAIL PROTECTED]> wrote:
> Sorry for the delayed response, Marcin, I was away.
> This error in the Gist means that the jar containing the class in
> question is not on your classpath.
> Exception in thread "Thread-39" java.lang.NoClassDefFoundError:
> at org.apache.hadoop.hive.shims.Hadoop23Shims.getTaskAttemptLogUrl(Hadoop23Shims.java:53)
> at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:186)
> at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:142)
> at java.lang.Thread.run(Thread.java:619)
> Caused by: java.lang.ClassNotFoundException:
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> ... 4 more
> So if you add the appropriate jar (hadoop-mapreduce jar?) to your
> classpath, that should take you further.Have you tried that?
> On Mon, Feb 25, 2013 at 4:01 AM, Marcin Cylke <[EMAIL PROTECTED]> wrote:
>> On 25/02/13 10:05, Marcin Cylke wrote:
>>> I'll build the trunk and try to test it. Then I'll let you know if that
>> I've just performed the test on current trunk. The problem is still
>> there, no changes.
>> Any ideas? Perhaps my config says something interesting? I've added it
>> to the GIST: https://gist.github.com/zygm0nt/5028591#file-hive-site-xml
>> The config consists some addidional parameters, but I don't think they
>> would influence MapReduce behavior.