Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Creating Indexes


Copy link to this message
-
Re: Creating Indexes
AFAIK you don't any hive jars on cluster. The hive jars are just required on the client node .

Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: Dean Wampler <[EMAIL PROTECTED]>
Date: Thu, 1 Nov 2012 08:01:51
To: <[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Re: Creating Indexes

It looks like you're using Derby with a real cluster, not just a single
machine in local or pseudo-distributed mode. I haven't tried this myself,
but the derby jar is probably not on the machine that ran the reducer task
that failed.

dean

On Thu, Nov 1, 2012 at 4:31 AM, Peter Marron <
[EMAIL PROTECTED]> wrote:

>  Hi Shreepadma,****
>
> ** **
>
> I agree that the error looks odd. However I can’t believe that I would have
> ****
>
> got this far with Hive if there was no derby jar. Nevertheless I checked.*
> ***
>
> Here is a directory listing of the Hive install:****
>
> ** **
>
> pmarron@pmarron-ubuntu:/data/hive/lib$ ls****
>
> ant-contrib-1.0b3.jar          commons-pool-1.5.4.jar
> hive-common-0.8.1.jar         hive-shims-0.8.1.jar  mockito-all-1.8.2.jar*
> ***
>
> antlr-2.7.7.jar                datanucleus-connectionpool-2.0.3.jar
> hive-contrib-0.8.1.jar        javaewah-0.3.jar      php****
>
> antlr-3.0.1.jar                datanucleus-core-2.0.3.jar
> hive_contrib.jar              jdo2-api-2.3-ec.jar   py****
>
> antlr-runtime-3.0.1.jar        datanucleus-enhancer-2.0.3.jar
> hive-exec-0.8.1.jar           jline-0.9.94.jar      slf4j-api-1.6.1.jar***
> *
>
> asm-3.1.jar                    datanucleus-rdbms-2.0.3.jar
> hive-hbase-handler-0.8.1.jar  json-20090211.jar     slf4j-log4j12-1.6.1.jar
> ****
>
> commons-cli-1.2.jar            *derby-10.4.2.0.jar*
> hive-hwi-0.8.1.jar            junit-4.10.jar
> stringtemplate-3.1-b1.jar****
>
> commons-codec-1.3.jar          guava-r06.jar
> hive-hwi-0.8.1.war            libfb303-0.7.0.jar    velocity-1.5.jar****
>
> commons-collections-3.2.1.jar  hbase-0.89.0-SNAPSHOT.jar
>         hive-jdbc-0.8.1.jar           libfb303.jar
> zookeeper-3.3.1.jar****
>
> commons-dbcp-1.4.jar           hbase-0.89.0-SNAPSHOT-tests.jar
> hive-metastore-0.8.1.jar      libthrift-0.7.0.jar****
>
> commons-lang-2.4.jar           hive-anttasks-0.8.1.jar
>             hive-pdk-0.8.1.jar            libthrift.jar****
>
> commons-logging-1.0.4.jar      hive-builtins-0.8.1.jar
> hive-serde-0.8.1.jar          log4j-1.2.15.jar****
>
> commons-logging-api-1.0.4.jar  hive-cli-0.8.1.jar
> hive-service-0.8.1.jar        log4j-1.2.16.jar****
>
> ** **
>
> Also I found a derby.log in my home directory which I have attached.****
>
> ** **
>
> Regards,****
>
> ** **
>
> Z****
>
> ** **
>
> *From:* Shreepadma Venugopalan [mailto:[EMAIL PROTECTED]]
> *Sent:* 31 October 2012 21:58
>
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Creating Indexes****
>
>  ** **
>
> Hi Peter,****
>
> ** **
>
> From the execution log,****
>
> ** **
>
> java.lang.ClassNotFoundException: org.apache.derby.jdbc.EmbeddedDriver****
>
>           at java.net.URLClassLoader$1.run(URLClassLoader.java:366)****
>
>           at java.net.URLClassLoader$1.run(URLClassLoader.java:355)****
>
>           at java.security.AccessController.doPrivileged(Native Method)***
> *
>
>           at java.net.URLClassLoader.findClass(URLClassLoader.java:354)***
> *
>
>           at java.lang.ClassLoader.loadClass(ClassLoader.java:423)****
>
>           at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> ****
>
>           at java.lang.ClassLoader.loadClass(ClassLoader.java:356)****
>
>           at java.lang.Class.forName0(Native Method)****
>
>           at java.lang.Class.forName(Class.java:186)****
>
>           at
> org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher.connect(JDBCStatsPublisher.java:68)
> ****
>
>           at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.publishStats(FileSinkOperator.java:778)
> ****
>
>           at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:723)

*Dean Wampler, Ph.D.*
thinkbiganalytics.com
+1-312-339-1330
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB