Hive, mail # user - Re: Missing Hive Execution Jar

Missing Hive Execution Jar

Aryeh Berkowitz 2010-02-23, 14:29

I'm trying to run Hive, but I'm getting the message Missing Hive Execution Jar: hive/lib/hive-exec-*.jar. I followed all the download and build instructions on the Wiki page.

Re: Missing Hive Execution Jar

Russell Jurney 2010-02-23, 14:34

Do a find | grep jar, in hive's directory, then cp all jars found to
lib/ off the main hive directory. There are several that are not
automatically copied there as part of the build, and this will fix
things.

I also had to set some env var, but I can't remember which one.

Russ

On Feb 23, 2010, at 9:29 AM, Aryeh Berkowitz <[EMAIL PROTECTED]> wrote:

> I’m trying to run Hive, but I’m getting the message Missing Hive
> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> d and build instructions on the Wiki page.

RE: Missing Hive Execution Jar

Aryeh Berkowitz 2010-02-23, 15:08

Thanks! I'm now getting an "Unable to determine Hadoop version information" error.

-----Original Message-----
From: Russell Jurney [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, February 23, 2010 9:35 AM
To: [EMAIL PROTECTED]
Subject: Re: Missing Hive Execution Jar

Do a find | grep jar, in hive's directory, then cp all jars found to
lib/ off the main hive directory. There are several that are not
automatically copied there as part of the build, and this will fix
things.

I also had to set some env var, but I can't remember which one.

Russ

On Feb 23, 2010, at 9:29 AM, Aryeh Berkowitz <[EMAIL PROTECTED]> wrote:

> I'm trying to run Hive, but I'm getting the message Missing Hive
> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> d and build instructions on the Wiki page.

Re: Missing Hive Execution Jar

Russell Jurney 2010-02-23, 15:15

Sounds like the aforementioned environment variable issue. I'm not at
a computer to look it up, but I found the path to set by googling the
error message, so try that. It was on the first page.

Russ

On Feb 23, 2010, at 10:08 AM, Aryeh Berkowitz <[EMAIL PROTECTED]> wrote:

> Thanks! I'm now getting an "Unable to determine Hadoop version
> information" error.
>
> -----Original Message-----
> From: Russell Jurney [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, February 23, 2010 9:35 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Missing Hive Execution Jar
>
> Do a find | grep jar, in hive's directory, then cp all jars found to
> lib/ off the main hive directory. There are several that are not
> automatically copied there as part of the build, and this will fix
> things.
>
> I also had to set some env var, but I can't remember which one.
>
> Russ
>
> On Feb 23, 2010, at 9:29 AM, Aryeh Berkowitz <[EMAIL PROTECTED]>
> wrote:
>
>> I'm trying to run Hive, but I'm getting the message Missing Hive
>> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
>> d and build instructions on the Wiki page.

RE: Missing Hive Execution Jar

Aryeh Berkowitz 2010-02-23, 15:35

I can't find anything. If you can tell me what it is, I'd appreciate it. Thanks!

-----Original Message-----
From: Russell Jurney [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, February 23, 2010 10:15 AM
To: [EMAIL PROTECTED]
Subject: Re: Missing Hive Execution Jar

Sounds like the aforementioned environment variable issue. I'm not at
a computer to look it up, but I found the path to set by googling the
error message, so try that. It was on the first page.

Russ

On Feb 23, 2010, at 10:08 AM, Aryeh Berkowitz <[EMAIL PROTECTED]> wrote:

> Thanks! I'm now getting an "Unable to determine Hadoop version
> information" error.
>
> -----Original Message-----
> From: Russell Jurney [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, February 23, 2010 9:35 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Missing Hive Execution Jar
>
> Do a find | grep jar, in hive's directory, then cp all jars found to
> lib/ off the main hive directory. There are several that are not
> automatically copied there as part of the build, and this will fix
> things.
>
> I also had to set some env var, but I can't remember which one.
>
> Russ
>
> On Feb 23, 2010, at 9:29 AM, Aryeh Berkowitz <[EMAIL PROTECTED]>
> wrote:
>
>> I'm trying to run Hive, but I'm getting the message Missing Hive
>> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
>> d and build instructions on the Wiki page.

Re: Missing Hive Execution Jar

Carl Steinbach 2010-02-23, 19:12

>
> > I’m trying to run Hive, but I’m getting the message Missing Hive
> > Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> > d and build instructions on the Wiki page.
>

It sounds like you are trying to run the hive script located in bin/ instead
of the one located in build/dist/bin (build/dist is the default installation
directory). Assuming that you have the Hive source code checked out to a
directory named hive-trunk and that you built Hive without specifying the
'target.dir' property, you want HIVE_HOME to point to hive-trunk/build/dist,
and you should add $HIVE_HOME/bin to your PATH. So when you run 'hive' it
should pick up the copy in hive-trunk/build/dist/bin instead of the version
in hive-trunk/bin.
Do a find | grep jar, in hive's directory, then cp all jars found to
> lib/ off the main hive directory. There are several that are not
> automatically copied there as part of the build, and this will fix
> things.
>

Please don't do this. There are conflicting versions of libthrift and
libfb303 located in subdirectories of the Hive source tree. Ordinarily this
does not cause a problem since they don't end up on the CLASSPATH. If you
already copied all of the jars to lib/ you should probably rm -rf your
workspace and do a fresh checkout and build.

Thanks.

Carl

RE: Missing Hive Execution Jar

Aryeh Berkowitz 2010-02-23, 19:58

Thanks Carl! I'm now getting the following error:

10/02/23 14:57:47 ERROR exec.DDLTask: FAILED: Error in metadata: java.lang.IllegalArgumentException: URI: does not have a scheme
org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.IllegalArgumentException: URI: does not have a scheme
   at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
   at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:1391)
   at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:123)
   at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
   at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
   at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:630)
   at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)
   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)
   at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
   at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
   at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.lang.IllegalArgumentException: URI: does not have a scheme
   at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:92)
   at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:921)
   at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:931)
   at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:320)
   ... 15 more

From: Carl Steinbach [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, February 23, 2010 2:13 PM
To: [EMAIL PROTECTED]
Subject: Re: Missing Hive Execution Jar

> I'm trying to run Hive, but I'm getting the message Missing Hive
> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> d and build instructions on the Wiki page.

It sounds like you are trying to run the hive script located in bin/ instead of the one located in build/dist/bin (build/dist is the default installation directory). Assuming that you have the Hive source code checked out to a directory named hive-trunk and that you built Hive without specifying the 'target.dir' property, you want HIVE_HOME to point to hive-trunk/build/dist, and you should add $HIVE_HOME/bin to your PATH. So when you run 'hive' it should pick up the copy in hive-trunk/build/dist/bin instead of the version in hive-trunk/bin.

Do a find | grep jar, in hive's directory, then cp all jars found to
lib/ off the main hive directory. There are several that are not
automatically copied there as part of the build, and this will fix
things.

Please don't do this. There are conflicting versions of libthrift and libfb303 located in subdirectories of the Hive source tree. Ordinarily this does not cause a problem since they don't end up on the CLASSPATH. If you already copied all of the jars to lib/ you should probably rm -rf your workspace and do a fresh checkout and build.

Thanks.

Carl

Re: Missing Hive Execution Jar

Carl Steinbach 2010-02-23, 20:47

I think it's complaining about the value you have set for the configuration
property "hive.metastore.uris". Are you setting this on the command line, or
does it appear in your Hive configuration file? If so, what is the value?

Carl

On Tue, Feb 23, 2010 at 11:58 AM, Aryeh Berkowitz <[EMAIL PROTECTED]> wrote:

> Thanks Carl! I’m now getting the following error:
>
>
>
> 10/02/23 14:57:47 ERROR exec.DDLTask: FAILED: Error in metadata:
> java.lang.IllegalArgumentException: URI: does not have a scheme
>
> org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.IllegalArgumentException: URI: does not have a scheme
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
>
> at
> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:1391)
>
> at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:123)
>
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
>
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
>
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:630)
>
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)
>
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
>
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
> Caused by: java.lang.IllegalArgumentException: URI: does not have a scheme
>
> at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:92)
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:921)
>
> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:931)
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:320)
>
> ... 15 more
>
>
>
> *From:* Carl Steinbach [mailto:[EMAIL PROTECTED]]
> *Sent:* Tuesday, February 23, 2010 2:13 PM
>
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Missing Hive Execution Jar
>
>
>
> > I’m trying to run Hive, but I’m getting the message Missing Hive
>
> > Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> > d and build instructions on the Wiki page.
>
>
> It sounds like you are trying to run the hive script located in bin/
> instead of the one located in build/dist/bin (build/dist is the default
> installation directory). Assuming that you have the Hive source code checked
> out to a directory named hive-trunk and that you built Hive without
> specifying the 'target.dir' property, you want HIVE_HOME to point to
> hive-trunk/build/dist, and you should add $HIVE_HOME/bin to your PATH. So
> when you run 'hive' it should pick up the copy in hive-trunk/build/dist/bin
> instead of the version in hive-trunk/bin.
>
>
>
> Do a find | grep jar, in hive's directory, then cp all jars found to
> lib/ off the main hive directory. There are several that are not
> automatically copied there as part of the build, and this will fix
> things.
>
>
> Please don't do this. There are conflicting versions of libthrift and
> libfb303 located in subdirectories of the Hive source tree. Ordinarily this
> does not cause a problem since they don't end up on the CLASSPATH. If you
> already copied all of the jars to lib/ you should probably rm -rf your
> workspace and do a fresh checkout and build.
>
> Thanks.
>
> Carl
>
>
>
>
>
>

RE: Missing Hive Execution Jar

Aryeh Berkowitz 2010-02-24, 13:53

I don't seem to have that configuration property in my hive-default. What should it be?

From: Carl Steinbach [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, February 23, 2010 3:47 PM
To: [EMAIL PROTECTED]
Subject: Re: Missing Hive Execution Jar

I think it's complaining about the value you have set for the configuration property "hive.metastore.uris". Are you setting this on the command line, or does it appear in your Hive configuration file? If so, what is the value?

Carl
On Tue, Feb 23, 2010 at 11:58 AM, Aryeh Berkowitz <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Thanks Carl! I'm now getting the following error:

10/02/23 14:57:47 ERROR exec.DDLTask: FAILED: Error in metadata: java.lang.IllegalArgumentException: URI: does not have a scheme
org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.IllegalArgumentException: URI: does not have a scheme
   at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
   at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:1391)
   at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:123)
   at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
   at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
   at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:630)
   at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)
   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)
   at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
   at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
   at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.lang.IllegalArgumentException: URI: does not have a scheme
   at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:92)
   at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:921)
   at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:931)
   at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:320)
   ... 15 more

From: Carl Steinbach [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Tuesday, February 23, 2010 2:13 PM

To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: Missing Hive Execution Jar

> I'm trying to run Hive, but I'm getting the message Missing Hive

> Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> d and build instructions on the Wiki page.

It sounds like you are trying to run the hive script located in bin/ instead of the one located in build/dist/bin (build/dist is the default installation directory). Assuming that you have the Hive source code checked out to a directory named hive-trunk and that you built Hive without specifying the 'target.dir' property, you want HIVE_HOME to point to hive-trunk/build/dist, and you should add $HIVE_HOME/bin to your PATH. So when you run 'hive' it should pick up the copy in hive-trunk/build/dist/bin instead of the version in hive-trunk/bin.

Do a find | grep jar, in hive's directory, then cp all jars found to
lib/ off the main hive directory. There are several that are not
automatically copied there as part of the build, and this will fix
things.

Please don't do this. There are conflicting versions of libthrift and libfb303 located in subdirectories of the Hive source tree. Ordinarily this does not cause a problem since they don't end up on the CLASSPATH. If you already copied all of the jars to lib/ you should probably rm -rf your workspace and do a fresh checkout and build.

Thanks.

Carl

Re: Missing Hive Execution Jar

Carl Steinbach 2010-02-24, 18:32

Hi Aryeh,

I greped through the source code for the string "does not have a scheme" and
traced it back to HiveMetaStoreClient.java where the error you see is
getting thrown. This code should print the value of 'hive.metastore.uris' in
the error message0, but it doesn't. I recommend modifying the code so that
it prints the value of this property when it throws the error message. Then
you will need to figure out where you are setting this value. If not in
hive-default.xml, then maybe you are setting it in hive-site.xml, or on the
command line using the -hiveconf switch?

Thanks.

Carl

On Wed, Feb 24, 2010 at 5:53 AM, Aryeh Berkowitz <[EMAIL PROTECTED]> wrote:

> I don’t seem to have that configuration property in my hive-default. What
> should it be?
>
>
>
> *From:* Carl Steinbach [mailto:[EMAIL PROTECTED]]
> *Sent:* Tuesday, February 23, 2010 3:47 PM
>
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Missing Hive Execution Jar
>
>
>
> I think it's complaining about the value you have set for the configuration
> property "hive.metastore.uris". Are you setting this on the command line, or
> does it appear in your Hive configuration file? If so, what is the value?
>
> Carl
>
> On Tue, Feb 23, 2010 at 11:58 AM, Aryeh Berkowitz <[EMAIL PROTECTED]>
> wrote:
>
> Thanks Carl! I’m now getting the following error:
>
>
>
> 10/02/23 14:57:47 ERROR exec.DDLTask: FAILED: Error in metadata:
> java.lang.IllegalArgumentException: URI: does not have a scheme
>
> org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.IllegalArgumentException: URI: does not have a scheme
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
>
> at
> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:1391)
>
> at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:123)
>
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
>
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
>
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:630)
>
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)
>
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
>
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
>
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
> Caused by: java.lang.IllegalArgumentException: URI: does not have a scheme
>
> at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:92)
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:921)
>
> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:931)
>
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:320)
>
> ... 15 more
>
>
>
> *From:* Carl Steinbach [mailto:[EMAIL PROTECTED]]
> *Sent:* Tuesday, February 23, 2010 2:13 PM
>
>
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Missing Hive Execution Jar
>
>
>
> > I’m trying to run Hive, but I’m getting the message Missing Hive
>
>
> > Execution Jar: hive/lib/hive-exec-*.jar. I followed all the downloa
> > d and build instructions on the Wiki page.
>
>
> It sounds like you are trying to run the hive script located in bin/
> instead of the one located in build/dist/bin (build/dist is the default
> installation directory). Assuming that you have the Hive source code checked
> out to a directory named hive-trunk and that you built Hive without