Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> serde jar causing problems in loading other jars.


Copy link to this message
-
Re: serde jar causing problems in loading other jars.
Thanks Dean, i will try to remove unnesessary jars and come back with the
outcome.
On Jan 23, 2013 7:11 PM, "Dean Wampler" <[EMAIL PROTECTED]>
wrote:

> I see from your listing that your jar contains the contents of many, if
> not all, of the Apache and logging jars that are also in the hadoop/lib and
> hive/lib directories, including the core hadoop and hive jars themselves.
> plus some Google, JSON, and other libraries. Most likely, this is causing
> issues, besides creating an unnecessarily large jar file of your code.
>
> You should remove ALL the contents of other jars from your jar and use ADD
> JAR only on the unique jars, like the Joda time jar you're using. I suspect
> that will reduce or eliminate the problems, even though that it can be
> tedious. I suspect you only really need to add a few extra jars, though.
>
> The  root-cause exception :
>
> Caused by: java.lang.NullPointerException
>         at org.datanucleus.plugin.NonManagedPluginRegistry.registerBundle(
> NonManagedPluginRegistry.java:443)
>         at org.datanucleus.plugin.NonManagedPluginRegistry.registerBundle(
> NonManagedPluginRegistry.java:355)
>         ...
>
> involves the $HIVE_HOME/lib/datanucleus-core-X.Y.Z.jar. I can only guess
> that loading multiple copies of other jar contents is tripping it up
> somehow.
>
> Good luck,
> dean
>
> On Wed, Jan 23, 2013 at 11:44 AM, Ehsan Haq <[EMAIL PROTECTED]> wrote:
>
>> I tried to rename my serde jar to zzzz.jar so that it would be loaded in
>> the last, but still the same behaviour. when i run "show tables;" on the
>> terminal, I get this exception in the logs. Also the list of the classes in
>> the serde jar files is added in the attachment
>>
>> 2013-01-23 18:29:59,852 ERROR exec.Task
>> (SessionState.java:printError(380)) - FAILED: Error in metadata:
>> javax.jdo.JDOFatalInternalException: Unexpected exception caught.
>> NestedThrowables:
>> java.lang.reflect.InvocationTargetException
>> org.apache.hadoop.hive.ql.metadata.HiveException:
>> javax.jdo.JDOFatalInternalException: Unexpected exception caught.
>> NestedThrowables:
>> java.lang.reflect.InvocationTargetException
>>         at
>> org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1099)
>>         at
>> org.apache.hadoop.hive.ql.metadata.Hive.databaseExists(Hive.java:1084)
>>         at
>> org.apache.hadoop.hive.ql.exec.DDLTask.showTables(DDLTask.java:1957)
>>         at
>> org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:306)
>>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
>>         at
>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)
>>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)
>>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
>>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
>>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:601)
>>         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>> Caused by: javax.jdo.JDOFatalInternalException: Unexpected exception
>> caught.
>> NestedThrowables:
>> java.lang.reflect.InvocationTargetException
>>         at
>> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1186)
>>         at
>> javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:803)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB