Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - alter table add partition error


Copy link to this message
-
RE: alter table add partition error
Pradeep Kamath 2010-06-18, 20:37
Sorry, don't know python - so couldn't make sense out of the following
error when I run the command you suggested:

[src/metastore/src/gen-py/hive_metastore]./ThriftHiveMetastore-remote -h
localhost:9080 get_partition_by_name default dummy
datestamp=20100602/srcid=100/action=view/testid=10

Traceback (most recent call last):

  File "./ThriftHiveMetastore-remote", line 11, in ?

    from thrift.transport import TTransport

ImportError: No module named thrift.transport

 

Thanks,

Pradeep

 

________________________________

From: Paul Yang [mailto:[EMAIL PROTECTED]]
Sent: Friday, June 18, 2010 12:10 PM
To: [EMAIL PROTECTED]
Subject: RE: alter table add partition error

 

Hi Pradeep,

 

In trunk/metastore/src/gen-py/hive_metastore/, there is a script called
ThriftHiveMetastore-remote that can be used to test out the thrift
server independent of the CLI. As a quick test to narrow down the
problem, after the partition is created, can you try running

 

ThriftHiveMetastore-remote -h localhost:9080 get_partition_by_name
default dummy datestamp=20100602/srcid=100/action=view/testid=10

 

Cheers,

Paul

 

From: Pradeep Kamath [mailto:[EMAIL PROTECTED]]
Sent: Friday, June 18, 2010 11:26 AM
To: [EMAIL PROTECTED]
Subject: RE: alter table add partition error

 

Hi Ning,

 I have pasted below [1] the values for HADOOP_CLASSPATH and CLASSPATH
from an "env" command printed just before the following line in
execHiveCmd.sh

exec $HADOOP jar ${HIVE_LIB}/hive-cli-*.jar $CLASS $HIVE_OPTS "$@"

 

There is only one occurrence of libthrift.jar whose cksum matches the
one from lib/libthrift.jar from a hive checkout build.

 

The hive_config_without_thrift is a conf directory containing a
hive-site.xml with jdo settings to connect to the database directly. By
default I have hive set up to use a hive-site.xml [2] which connects to
a thrift server running on localhost.

 

Any pointers appreciated!

 

Thanks,

Pradeep

 

[1]

HADOOP_CLASSPATH=/home/y/libexec/hive_client/conf:/home/y/libexec/hive_c
lient/lib/antlr-runtime-3.0.1.jar:/home/y/libexec/hive_client/lib/asm-3.
1.jar:/home/y/libexec/hive_client/lib/commons-cli-2.0-SNAPSHOT.jar:/home
/y/libexec/hive_client/lib/commons-codec-1.3.jar:/home/y/libexec/hive_cl
ient/lib/commons-collections-3.2.1.jar:/home/y/libexec/hive_client/lib/c
ommons-dbcp-1.2.2.jar:/home/y/libexec/hive_client/lib/commons-lang-2.4.j
ar:/home/y/libexec/hive_client/lib/commons-logging-1.0.4.jar:/home/y/lib
exec/hive_client/lib/commons-logging-api-1.0.4.jar:/home/y/libexec/hive_
client/lib/commons-pool-1.2.jar:/home/y/libexec/hive_client/lib/datanucl
eus-connectionpool-1.0.2.jar:/home/y/libexec/hive_client/lib/datanucleus
-core-1.1.2.jar:/home/y/libexec/hive_client/lib/datanucleus-enhancer-1.1
.2.jar:/home/y/libexec/hive_client/lib/datanucleus-rdbms-1.1.2.jar:/home
/y/libexec/hive_client/lib/derby.jar:/home/y/libexec/hive_client/lib/hba
se-0.20.3.jar:/home/y/libexec/hive_client/lib/hbase-0.20.3-test.jar:/hom
e/y/libexec/hive_client/lib/hive-anttasks-0.6.0.jar:/home/y/libexec/hive
_client/lib/hive-cli-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-comm
on-0.6.0.jar:/home/y/libexec/hive_client/lib/hive_contrib.jar:/home/y/li
bexec/hive_client/lib/hive-exec-0.6.0.jar:/home/y/libexec/hive_client/li
b/hive_hbase-handler.jar:/home/y/libexec/hive_client/lib/hive-hwi-0.6.0.
jar:/home/y/libexec/hive_client/lib/hive-jdbc-0.6.0.jar:/home/y/libexec/
hive_client/lib/hive-metastore-0.6.0.jar:/home/y/libexec/hive_client/lib
/hive-serde-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-service-0.6.0
.jar:/home/y/libexec/hive_client/lib/hive-shims-0.6.0.jar:/home/y/libexe
c/hive_client/lib/jdo2-api-2.3-SNAPSHOT.jar:/home/y/libexec/hive_client/
lib/jline-0.9.94.jar:/home/y/libexec/hive_client/lib/json.jar:/home/y/li
bexec/hive_client/lib/junit-3.8.1.jar:/home/y/libexec/hive_client/lib/li
bfb303.jar:/home/y/libexec/hive_client/lib/libthrift.jar:/home/y/libexec
/hive_client/lib/log4j-1.2.15.jar:/home/y/libexec/hive_client/lib/ojdbc6
.jar:/home/y/libexec/hive_client/lib/pig-0.7.0-dev-core.jar:/home/y/libe
xec/hive_client/lib/stringtemplate-3.1b1.jar:/home/y/libexec/hive_client
/lib/velocity-1.5.jar:/home/y/libexec/hive_client/lib/zookeeper-3.2.2.ja
r:

 

CLASSPATH=/home/y/libexec/hive_client/conf:/home/y/libexec/hive_client/l
ib/antlr-runtime-3.0.1.jar:/home/y/libexec/hive_client/lib/asm-3.1.jar:/
home/y/libexec/hive_client/lib/commons-cli-2.0-SNAPSHOT.jar:/home/y/libe
xec/hive_client/lib/commons-codec-1.3.jar:/home/y/libexec/hive_client/li
b/commons-collections-3.2.1.jar:/home/y/libexec/hive_client/lib/commons-
dbcp-1.2.2.jar:/home/y/libexec/hive_client/lib/commons-lang-2.4.jar:/hom
e/y/libexec/hive_client/lib/commons-logging-1.0.4.jar:/home/y/libexec/hi
ve_client/lib/commons-logging-api-1.0.4.jar:/home/y/libexec/hive_client/
lib/commons-pool-1.2.jar:/home/y/libexec/hive_client/lib/datanucleus-con
nectionpool-1.0.2.jar:/home/y/libexec/hive_client/lib/datanucleus-core-1
.1.2.jar:/home/y/libexec/hive_client/lib/datanucleus-enhancer-1.1.2.jar:
/home/y/libexec/hive_client/lib/datanucleus-rdbms-1.1.2.jar:/home/y/libe
xec/hive_client/lib/derby.jar:/home/y/libexec/hive_client/lib/hbase-0.20
.3.jar:/home/y/libexec/hive_client/lib/hbase-0.20.3-test.jar:/home/y/lib
exec/hive_client/lib/hive-anttasks-0.6.0.jar:/home/y/libexec/hive_client
/lib/hive-cli-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-common-0.6.
0.jar:/home/y/libexec/hive_client/lib/hive_contrib.jar:/home/y/libexec/h
ive_client/lib/hive-exec-0.6.0.jar:/home/y/libexec/hive_client/lib/hive_
hbase-handler.jar:/home/y/libexec/hive_client/lib/hive-hwi-0.6.0.jar:/ho
me/y/libexec/hive_client/lib/hive-jdbc-0.6.0.jar:/home/y/libexec/hive_cl
ient/lib/hive-metastore-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-s
erde-0.6.0.jar:/home/y/libexec/hive_client/lib/hive-service-0.6.0.jar:/h
ome/y/libexec/hive_client/lib/hive-shims-0.6.0.jar:/home/y/libexec/hive_
client/lib/jdo2-api-2.3-SNAPSHOT.jar:/home/y/libexec/hive_client/lib/jli
ne-0