Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> serde jar causing problems in loading other jars.

Copy link to this message
Re: serde jar causing problems in loading other jars.
I see from your listing that your jar contains the contents of many, if not
all, of the Apache and logging jars that are also in the hadoop/lib and
hive/lib directories, including the core hadoop and hive jars themselves.
plus some Google, JSON, and other libraries. Most likely, this is causing
issues, besides creating an unnecessarily large jar file of your code.

You should remove ALL the contents of other jars from your jar and use ADD
JAR only on the unique jars, like the Joda time jar you're using. I suspect
that will reduce or eliminate the problems, even though that it can be
tedious. I suspect you only really need to add a few extra jars, though.

The  root-cause exception :

Caused by: java.lang.NullPointerException
        at org.datanucleus.plugin.NonManagedPluginRegistry.registerBundle(
        at org.datanucleus.plugin.NonManagedPluginRegistry.registerBundle(

involves the $HIVE_HOME/lib/datanucleus-core-X.Y.Z.jar. I can only guess
that loading multiple copies of other jar contents is tripping it up

Good luck,

On Wed, Jan 23, 2013 at 11:44 AM, Ehsan Haq <[EMAIL PROTECTED]> wrote:

> I tried to rename my serde jar to zzzz.jar so that it would be loaded in
> the last, but still the same behaviour. when i run "show tables;" on the
> terminal, I get this exception in the logs. Also the list of the classes in
> the serde jar files is added in the attachment
> 2013-01-23 18:29:59,852 ERROR exec.Task
> (SessionState.java:printError(380)) - FAILED: Error in metadata:
> javax.jdo.JDOFatalInternalException: Unexpected exception caught.
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
> org.apache.hadoop.hive.ql.metadata.HiveException:
> javax.jdo.JDOFatalInternalException: Unexpected exception caught.
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
>         at
> org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1099)
>         at
> org.apache.hadoop.hive.ql.metadata.Hive.databaseExists(Hive.java:1084)
>         at
> org.apache.hadoop.hive.ql.exec.DDLTask.showTables(DDLTask.java:1957)
>         at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:306)
>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
>         at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)
>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)
>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255)
>         at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212)
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Caused by: javax.jdo.JDOFatalInternalException: Unexpected exception
> caught.
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
>         at
> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1186)
>         at
> javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:803)
>         at
> javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:698)
>         at
> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:246)
>         at
> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:275)

*Dean Wampler, Ph.D.*