Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - serde jar causing problems in loading other jars.


Copy link to this message
-
Re: serde jar causing problems in loading other jars.
Ehsan Haq 2013-01-23, 18:46
Thanks Dean, i will try to remove unnesessary jars and come back with the
outcome.
On Jan 23, 2013 7:11 PM, "Dean Wampler" <[EMAIL PROTECTED]>
wrote:

> I see from your listing that your jar contains the contents of many, if
> not all, of the Apache and logging jars that are also in the hadoop/lib and
> hive/lib directories, including the core hadoop and hive jars themselves.
> plus some Google, JSON, and other libraries. Most likely, this is causing
> issues, besides creating an unnecessarily large jar file of your code.
>
> You should remove ALL the contents of other jars from your jar and use ADD
> JAR only on the unique jars, like the Joda time jar you're using. I suspect
> that will reduce or eliminate the problems, even though that it can be
> tedious. I suspect you only really need to add a few extra jars, though.
>
> The  root-cause exception :
>
> Caused by: java.lang.NullPointerException
>         at org.datanucleus.plugin.NonManagedPluginRegistry.registerBundle(
> NonManagedPluginRegistry.java:443)
>         at org.datanucleus.plugin.NonManagedPluginRegistry.registerBundle(
> NonManagedPluginRegistry.java:355)
>         ...
>
> involves the $HIVE_HOME/lib/datanucleus-core-X.Y.Z.jar. I can only guess
> that loading multiple copies of other jar contents is tripping it up
> somehow.
>
> Good luck,
> dean
>
> On Wed, Jan 23, 2013 at 11:44 AM, Ehsan Haq <[EMAIL PROTECTED]> wrote:
>
>> I tried to rename my serde jar to zzzz.jar so that it would be loaded in
>> the last, but still the same behaviour. when i run "show tables;" on the
>> terminal, I get this exception in the logs. Also the list of the classes in
>> the serde jar files is added in the attachment
>>
>> 2013-01-23 18:29:59,852 ERROR exec.Task
>> (SessionState.java:printError(380)) - FAILED: Error in metadata:
>> javax.jdo.JDOFatalInternalException: Unexpected exception caught.
>> NestedThrowables:
>> java.lang.reflect.InvocationTargetException
>> org.apache.hadoop.hive.ql.metadata.HiveException:
>> javax.jdo.JDOFatalInternalException: Unexpected exception caught.
>> NestedThrowables:
>> java.lang.reflect.InvocationTargetException
>>         at
>> org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1099)
>>         at
>> org.apache.hadoop.hive.ql.metadata.Hive.databaseExists(Hive.java:1084)
>>         at
>> org.apache.hadoop.hive.ql.exec.DDLTask.showTables(DDLTask.java:1957)
>>         at
>> org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:306)
>>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
>>         at
>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)
>>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)
>>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
>>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
>>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:601)
>>         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>> Caused by: javax.jdo.JDOFatalInternalException: Unexpected exception
>> caught.
>> NestedThrowables:
>> java.lang.reflect.InvocationTargetException
>>         at
>> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1186)
>>         at
>> javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:803)