Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Cannot get hive working templeton


Copy link to this message
-
Cannot get hive working templeton
Hi,

I am using Hive 0.11.0 over Hadoop 1.0.4.
Recently I have started investigating the user of Templeton and I have managed to get
most of the services working. Specifically I can access resources like these:

http://hpcluster1:50111/templeton/v1/version
http://hpcluster1:50111/templeton/v1/status
http://hpcluster1:50111/templeton/v1/ddl/database
http://hpcluster1:50111/templeton/v1/queue
http://hpcluster1:50111/templeton/v1/mapreduce/jar

and everything works. Very satisfying. However whenever I try to access the resources like this:

curl -s -d user.name=pmarron -d execute="show tables;"  http://hpcluster1:50111/templeton/v1/hive

It creates a job, but the job always fails. When I look at the logs I see this error:

templeton: starting [hive-0.10.0.tar.gz/hive-0.10.0/bin/hive, --service, cli, --hiveconf, mapreduce.job.credentials.binary=/home/hadoop/local/taskTracker/pmarron/jobcache/job_201307161533_0194/jobToken, --hiveconf, hive.metastore.local=false, --hiveconf, hive.metastore.uris=thrift://localhost:10000, --hiveconf, hive.metastore.sasl.enabled=false, -e, show tables;]
With environment variables: HADOOP_USER_NAME=pmarron
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
Logging initialized using configuration in jar:file:/home/hadoop/local/taskTracker/distcache/-6482896583959475161_-1791958366_1973852064/hpcluster1/apps/templeton/hive-0.10.0.tar.gz/hive-0.10.0/lib/hive-common-0.10.0.jar!/hive-log4j.properties
Hive history file=/tmp/pmarron/hive_job_log_pmarron_201308081535_710870291.txt
FAILED: Error in metadata: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
templeton: job failed with exit code 1

However if I execute the command from the debug logs it works:

-bash-4.1$ hive --service cli   --hiveconf hive.metastore.local=false --hiveconf hive.metastore.uris=thrift://localhost:10000 --hiveconf hive.metastore.sasl.enabled=false -e "show tables"
13/08/08 15:42:03 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.

Logging initialized using configuration in jar:file:/home/pmarron/hive-0.11.0/lib/hive-common-0.11.0.jar!/hive-log4j.properties
Hive history file=/tmp/pmarron/[EMAIL PROTECTED]
OK
champions
champions2
championsrows
championsvalues
dummy
ordinals
ordinalsrows
ordinalsvalues
Time taken: 1.203 seconds, Fetched: 8 row(s)
-bash-4.1$

I suspect that this is a configuration error, but I've found all the ones that I can and fixed them.
Anyone have any suggestions for things that I need to check to get this to work?

Thanks.

Z
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB