Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> alter table add partition error


Copy link to this message
-
RE: alter table add partition error
Sorry, don't know python - so couldn't make sense out of the following
error when I run the command you suggested:

[src/metastore/src/gen-py/hive_metastore]./ThriftHiveMetastore-remote -h
localhost:9080 get_partition_by_name default dummy
datestamp=20100602/srcid=100/action=view/testid=10

Traceback (most recent call last):

  File "./ThriftHiveMetastore-remote", line 11, in ?

    from thrift.transport import TTransport

ImportError: No module named thrift.transport

 

Thanks,

Pradeep

 

________________________________

From: Paul Yang [mailto:[EMAIL PROTECTED]]
Sent: Friday, June 18, 2010 12:10 PM
To: [EMAIL PROTECTED]
Subject: RE: alter table add partition error

 

Hi Pradeep,

 

In trunk/metastore/src/gen-py/hive_metastore/, there is a script called
ThriftHiveMetastore-remote that can be used to test out the thrift
server independent of the CLI. As a quick test to narrow down the
problem, after the partition is created, can you try running

 

ThriftHiveMetastore-remote -h localhost:9080 get_partition_by_name
default dummy datestamp=20100602/srcid=100/action=view/testid=10

 

Cheers,

Paul

 

From: Pradeep Kamath [mailto:[EMAIL PROTECTED]]
Sent: Friday, June 18, 2010 11:26 AM
To: [EMAIL PROTECTED]
Subject: RE: alter table add partition error

 

Hi Ning,

 I have pasted below [1] the values for HADOOP_CLASSPATH and CLASSPATH
from an "env" command printed just before the following line in
execHiveCmd.sh

exec $HADOOP jar ${HIVE_LIB}/hive-cli-*.jar $CLASS $HIVE_OPTS "$@"

 

There is only one occurrence of libthrift.jar whose cksum matches the
one from lib/libthrift.jar from a hive checkout build.

 

The hive_config_without_thrift is a conf directory containing a
hive-site.xml with jdo settings to connect to the database directly. By
default I have hive set up to use a hive-site.xml [2] which connects to
a thrift server running on localhost.

 

Any pointers appreciated!

 

Thanks,

Pradeep

 

[1]

HADOOP_CLASSPATH=/home/y/libexec/hive_client/conf:/home/y/libexec/hive_c
lient/lib/antlr-runtime-3.0.1.jar:/home/y/libexec/hive_client/lib/asm-3.
1.jar:/home/y/libexec/hive_client/lib/commons-cli-2.0-SNAPSHOT.jar:/home
/y/libexec/hive_client/lib/commons-codec-1.3.jar:/home/y/libexec/hive_cl
ient/lib/commons-collections-3.2.1.jar:/home/y/libexec/hive_client/lib/c
ommons-dbcp-1.2.2.jar:/home/y/libexec/hive_client/lib/commons-lang-2.4.j
ar:/home/y/libexec/hive_client/lib/commons-logging-1.0.4.jar:/home/y/lib
exec/hive_client/lib/commons-logging-api-1.0.4.jar:/home/y/libexec/hive_
client/lib/commons-pool-1.2.jar:/home/y/libexec/hive_client/lib/datanucl
eus-connectionpool-1.0.2.jar:/home/y/libexec/hive_client/lib/datanucleus
-core-1.1.2.jar:/home/y/libexec/hive_client/lib/datanucleus-enhancer-1.1
.2.jar:/home/y/libexec/hive_client/lib/datanucleus-rdbms-1.1.2.jar:/home
/y/libexec/hive_client/lib/derby.jar:/home/y/libexec/hive_client/lib/hba
se-0.20.3.jar:/home/y/libexec/hive_client/lib/hbase-0.20.3-test.jar:/hom
e/y/libexec/hive_client/lib/hive-anttasks-0.6.0.jar:/home/y/libexec/hive
_client/lib/hive-cli-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-comm
on-0.6.0.jar:/home/y/libexec/hive_client/lib/hive_contrib.jar:/home/y/li
bexec/hive_client/lib/hive-exec-0.6.0.jar:/home/y/libexec/hive_client/li
b/hive_hbase-handler.jar:/home/y/libexec/hive_client/lib/hive-hwi-0.6.0.
jar:/home/y/libexec/hive_client/lib/hive-jdbc-0.6.0.jar:/home/y/libexec/
hive_client/lib/hive-metastore-0.6.0.jar:/home/y/libexec/hive_client/lib
/hive-serde-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-service-0.6.0
.jar:/home/y/libexec/hive_client/lib/hive-shims-0.6.0.jar:/home/y/libexe
c/hive_client/lib/jdo2-api-2.3-SNAPSHOT.jar:/home/y/libexec/hive_client/
lib/jline-0.9.94.jar:/home/y/libexec/hive_client/lib/json.jar:/home/y/li
bexec/hive_client/lib/junit-3.8.1.jar:/home/y/libexec/hive_client/lib/li
bfb303.jar:/home/y/libexec/hive_client/lib/libthrift.jar:/home/y/libexec
/hive_client/lib/log4j-1.2.15.jar:/home/y/libexec/hive_client/lib/ojdbc6
.jar:/home/y/libexec/hive_client/lib/pig-0.7.0-dev-core.jar:/home/y/libe
xec/hive_client/lib/stringtemplate-3.1b1.jar:/home/y/libexec/hive_client
/lib/velocity-1.5.jar:/home/y/libexec/hive_client/lib/zookeeper-3.2.2.ja
r:

 

CLASSPATH=/home/y/libexec/hive_client/conf:/home/y/libexec/hive_client/l
ib/antlr-runtime-3.0.1.jar:/home/y/libexec/hive_client/lib/asm-3.1.jar:/
home/y/libexec/hive_client/lib/commons-cli-2.0-SNAPSHOT.jar:/home/y/libe
xec/hive_client/lib/commons-codec-1.3.jar:/home/y/libexec/hive_client/li
b/commons-collections-3.2.1.jar:/home/y/libexec/hive_client/lib/commons-
dbcp-1.2.2.jar:/home/y/libexec/hive_client/lib/commons-lang-2.4.jar:/hom
e/y/libexec/hive_client/lib/commons-logging-1.0.4.jar:/home/y/libexec/hi
ve_client/lib/commons-logging-api-1.0.4.jar:/home/y/libexec/hive_client/
lib/commons-pool-1.2.jar:/home/y/libexec/hive_client/lib/datanucleus-con
nectionpool-1.0.2.jar:/home/y/libexec/hive_client/lib/datanucleus-core-1
.1.2.jar:/home/y/libexec/hive_client/lib/datanucleus-enhancer-1.1.2.jar:
/home/y/libexec/hive_client/lib/datanucleus-rdbms-1.1.2.jar:/home/y/libe
xec/hive_client/lib/derby.jar:/home/y/libexec/hive_client/lib/hbase-0.20
.3.jar:/home/y/libexec/hive_client/lib/hbase-0.20.3-test.jar:/home/y/lib
exec/hive_client/lib/hive-anttasks-0.6.0.jar:/home/y/libexec/hive_client
/lib/hive-cli-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-common-0.6.
0.jar:/home/y/libexec/hive_client/lib/hive_contrib.jar:/home/y/libexec/h
ive_client/lib/hive-exec-0.6.0.jar:/home/y/libexec/hive_client/lib/hive_
hbase-handler.jar:/home/y/libexec/hive_client/lib/hive-hwi-0.6.0.jar:/ho
me/y/libexec/hive_client/lib/hive-jdbc-0.6.0.jar:/home/y/libexec/hive_cl
ient/lib/hive-metastore-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-s
erde-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-service-0.6.0.jar:/h
ome/y/libexec/hive_client/lib/hive-shims-0.6.0.jar:/home/y/libexec/hive_
client/lib/jdo2-api-2.3-SNAPSHOT.jar:/home/y/libexec/hive_client/lib/jli
ne-0
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB