Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Cannot get hive working templeton


Copy link to this message
-
Cannot get hive working templeton
Hi,

I am using Hive 0.11.0 over Hadoop 1.0.4.
Recently I have started investigating the user of Templeton and I have managed to get
most of the services working. Specifically I can access resources like these:

http://hpcluster1:50111/templeton/v1/version
http://hpcluster1:50111/templeton/v1/status
http://hpcluster1:50111/templeton/v1/ddl/database
http://hpcluster1:50111/templeton/v1/queue
http://hpcluster1:50111/templeton/v1/mapreduce/jar

and everything works. Very satisfying. However whenever I try to access the resources like this:

curl -s -d user.name=pmarron -d execute="show tables;"  http://hpcluster1:50111/templeton/v1/hive

It creates a job, but the job always fails. When I look at the logs I see this error:

templeton: starting [hive-0.10.0.tar.gz/hive-0.10.0/bin/hive, --service, cli, --hiveconf, mapreduce.job.credentials.binary=/home/hadoop/local/taskTracker/pmarron/jobcache/job_201307161533_0194/jobToken, --hiveconf, hive.metastore.local=false, --hiveconf, hive.metastore.uris=thrift://localhost:10000, --hiveconf, hive.metastore.sasl.enabled=false, -e, show tables;]
With environment variables: HADOOP_USER_NAME=pmarron
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
Logging initialized using configuration in jar:file:/home/hadoop/local/taskTracker/distcache/-6482896583959475161_-1791958366_1973852064/hpcluster1/apps/templeton/hive-0.10.0.tar.gz/hive-0.10.0/lib/hive-common-0.10.0.jar!/hive-log4j.properties
Hive history file=/tmp/pmarron/hive_job_log_pmarron_201308081535_710870291.txt
FAILED: Error in metadata: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
templeton: job failed with exit code 1

However if I execute the command from the debug logs it works:

-bash-4.1$ hive --service cli   --hiveconf hive.metastore.local=false --hiveconf hive.metastore.uris=thrift://localhost:10000 --hiveconf hive.metastore.sasl.enabled=false -e "show tables"
13/08/08 15:42:03 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.

Logging initialized using configuration in jar:file:/home/pmarron/hive-0.11.0/lib/hive-common-0.11.0.jar!/hive-log4j.properties
Hive history file=/tmp/pmarron/[EMAIL PROTECTED]
OK
champions
champions2
championsrows
championsvalues
dummy
ordinals
ordinalsrows
ordinalsvalues
Time taken: 1.203 seconds, Fetched: 8 row(s)
-bash-4.1$

I suspect that this is a configuration error, but I've found all the ones that I can and fixed them.
Anyone have any suggestions for things that I need to check to get this to work?

Thanks.

Z