Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - Creating Indexes


Copy link to this message
-
Re: Creating Indexes
Bejoy KS 2012-11-01, 13:09
AFAIK you don't any hive jars on cluster. The hive jars are just required on the client node .

Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: Dean Wampler <[EMAIL PROTECTED]>
Date: Thu, 1 Nov 2012 08:01:51
To: <[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Re: Creating Indexes

It looks like you're using Derby with a real cluster, not just a single
machine in local or pseudo-distributed mode. I haven't tried this myself,
but the derby jar is probably not on the machine that ran the reducer task
that failed.

dean

On Thu, Nov 1, 2012 at 4:31 AM, Peter Marron <
[EMAIL PROTECTED]> wrote:

>  Hi Shreepadma,****
>
> ** **
>
> I agree that the error looks odd. However I can’t believe that I would have
> ****
>
> got this far with Hive if there was no derby jar. Nevertheless I checked.*
> ***
>
> Here is a directory listing of the Hive install:****
>
> ** **
>
> pmarron@pmarron-ubuntu:/data/hive/lib$ ls****
>
> ant-contrib-1.0b3.jar          commons-pool-1.5.4.jar
> hive-common-0.8.1.jar         hive-shims-0.8.1.jar  mockito-all-1.8.2.jar*
> ***
>
> antlr-2.7.7.jar                datanucleus-connectionpool-2.0.3.jar
> hive-contrib-0.8.1.jar        javaewah-0.3.jar      php****
>
> antlr-3.0.1.jar                datanucleus-core-2.0.3.jar
> hive_contrib.jar              jdo2-api-2.3-ec.jar   py****
>
> antlr-runtime-3.0.1.jar        datanucleus-enhancer-2.0.3.jar
> hive-exec-0.8.1.jar           jline-0.9.94.jar      slf4j-api-1.6.1.jar***
> *
>
> asm-3.1.jar                    datanucleus-rdbms-2.0.3.jar
> hive-hbase-handler-0.8.1.jar  json-20090211.jar     slf4j-log4j12-1.6.1.jar
> ****
>
> commons-cli-1.2.jar            *derby-10.4.2.0.jar*
> hive-hwi-0.8.1.jar            junit-4.10.jar
> stringtemplate-3.1-b1.jar****
>
> commons-codec-1.3.jar          guava-r06.jar
> hive-hwi-0.8.1.war            libfb303-0.7.0.jar    velocity-1.5.jar****
>
> commons-collections-3.2.1.jar  hbase-0.89.0-SNAPSHOT.jar
>         hive-jdbc-0.8.1.jar           libfb303.jar
> zookeeper-3.3.1.jar****
>
> commons-dbcp-1.4.jar           hbase-0.89.0-SNAPSHOT-tests.jar
> hive-metastore-0.8.1.jar      libthrift-0.7.0.jar****
>
> commons-lang-2.4.jar           hive-anttasks-0.8.1.jar
>             hive-pdk-0.8.1.jar            libthrift.jar****
>
> commons-logging-1.0.4.jar      hive-builtins-0.8.1.jar
> hive-serde-0.8.1.jar          log4j-1.2.15.jar****
>
> commons-logging-api-1.0.4.jar  hive-cli-0.8.1.jar
> hive-service-0.8.1.jar        log4j-1.2.16.jar****
>
> ** **
>
> Also I found a derby.log in my home directory which I have attached.****
>
> ** **
>
> Regards,****
>
> ** **
>
> Z****
>
> ** **
>
> *From:* Shreepadma Venugopalan [mailto:[EMAIL PROTECTED]]
> *Sent:* 31 October 2012 21:58
>
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Creating Indexes****
>
>  ** **
>
> Hi Peter,****
>
> ** **
>
> From the execution log,****
>
> ** **
>
> java.lang.ClassNotFoundException: org.apache.derby.jdbc.EmbeddedDriver****
>
>           at java.net.URLClassLoader$1.run(URLClassLoader.java:366)****
>
>           at java.net.URLClassLoader$1.run(URLClassLoader.java:355)****
>
>           at java.security.AccessController.doPrivileged(Native Method)***
> *
>
>           at java.net.URLClassLoader.findClass(URLClassLoader.java:354)***
> *
>
>           at java.lang.ClassLoader.loadClass(ClassLoader.java:423)****
>
>           at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> ****
>
>           at java.lang.ClassLoader.loadClass(ClassLoader.java:356)****
>
>           at java.lang.Class.forName0(Native Method)****
>
>           at java.lang.Class.forName(Class.java:186)****
>
>           at
> org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher.connect(JDBCStatsPublisher.java:68)
> ****
>
>           at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.publishStats(FileSinkOperator.java:778)
> ****
>
>           at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:723)

*Dean Wampler, Ph.D.*
thinkbiganalytics.com
+1-312-339-1330