|
|
-
Hive 0.7.1 does not work with PostgreSQL 9.0.2
Xiaobo Gu 2011-08-20, 06:20
Hi, I have just set up a PostgreSQL 9.0.2 server for hive 0.7.1 metastore, and I am using the postgresql-9.0-801.jdbc4.jar jdbc driver, when I test the following HQL, CREATE TABLE records (year STRING, temperature INT, quality INT) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'; the following error messages are thrown in metastore services standard error:
11/08/20 10:12:33 INFO metastore.HiveMetaStore: 1: create_table: db=default tbl=records 11/08/20 10:12:33 INFO HiveMetaStore.audit: ugi=gpadmin ip=/192.168.72.6 cmd=create_table: db=default tbl=records 11/08/20 10:12:33 INFO metastore.HiveMetaStore: 1: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 11/08/20 10:12:33 INFO metastore.ObjectStore: ObjectStore, initialize called 11/08/20 10:12:33 INFO metastore.ObjectStore: Initialized ObjectStore 11/08/20 10:12:33 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own data store table. 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MSerDeInfo [Table : "SERDES", InheritanceStrategy : new-table] 11/08/20 10:12:33 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table. 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MStorageDescriptor [Table : "SDS", InheritanceStr ategy : new-table] 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MTable [Table : "TBLS", InheritanceStrategy : new -table] 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MSerDeInfo.parameters [Table : "SERDE_PARAMS"] 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MTable.parameters [Table : "TABLE_PARAMS"] 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MTable.partitionKeys [Table : "PARTITION_KEYS"] 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MStorageDescriptor.bucketCols [Table : "BUCKETING _COLS"] 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MStorageDescriptor.cols [Table : "COLUMNS"] 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MStorageDescriptor.parameters [Table : "SD_PARAMS "] 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MStorageDescriptor.sortCols [Table : "SORT_COLS"] 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) for table "SERDES" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 0 foreign key(s) for table "SERDES" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 index(es) for table "SERDES" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 unique key(s) for table "TBLS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 foreign key(s) for table "TBLS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 4 index(es) for table "TBLS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) for table "SDS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 foreign key(s) for table "SDS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 index(es) for table "SDS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) for table "SORT_COLS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 foreign key(s) for table "SORT_COLS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 index(es) for table "SORT_COLS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) for table "TABLE_PARAMS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 foreign key(s) for table "TABLE_PARAMS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 index(es) for table "TABLE_PARAMS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) for table "SD_PARAMS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 foreign key(s) for table "SD_PARAMS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 index(es) for table "SD_PARAMS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) for table "SERDE_PARAMS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 foreign key(s) for table "SERDE_PARAMS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 index(es) for table "SERDE_PARAMS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) for table "PARTITION_KEYS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 foreign key(s) for table "PARTITION_KEYS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 index(es) for table "PARTITION_KEYS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) for table "COLUMNS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 foreign key(s) for table "COLUMNS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 index(es) for table "COLUMNS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) for table "BUCKETING_COLS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 foreign key(s) for table "BUCKETING_COLS" 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 index(es) for table "BUCKETING_COLS" 11/08/20 10:12:34 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MSerDeInfo 11/08/20 10:12:34 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MStorageDescriptor 11/08/20 10:12:34 INFO DataNucleus.MetaData: Listener found initialisation for persistabl
-
Re: Hive 0.7.1 does not work with PostgreSQL 9.0.2
wd 2011-08-21, 00:17
you can try hive 0.5, after create the metadata, use upgrade sql file in hive 0.7.1 to upgrade to 0.7.1
On Sat, Aug 20, 2011 at 2:20 PM, Xiaobo Gu <[EMAIL PROTECTED]> wrote: > Hi, > I have just set up a PostgreSQL 9.0.2 server for hive 0.7.1 metastore, > and I am using the postgresql-9.0-801.jdbc4.jar jdbc driver, when I > test the following HQL, > > > CREATE TABLE records (year STRING, temperature INT, quality INT) > ROW FORMAT DELIMITED > FIELDS TERMINATED BY '\t'; > > > the following error messages are thrown in metastore services standard error: > > 11/08/20 10:12:33 INFO metastore.HiveMetaStore: 1: create_table: > db=default tbl=records > 11/08/20 10:12:33 INFO HiveMetaStore.audit: ugi=gpadmin > ip=/192.168.72.6 cmd=create_table: db=default tbl=records > 11/08/20 10:12:33 INFO metastore.HiveMetaStore: 1: Opening raw store > with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore > 11/08/20 10:12:33 INFO metastore.ObjectStore: ObjectStore, initialize called > 11/08/20 10:12:33 INFO metastore.ObjectStore: Initialized ObjectStore > 11/08/20 10:12:33 INFO DataNucleus.Datastore: The class > "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as > "embedded-only" so does not have its own data > store table. > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Class : org.apache.hadoop.hive.metastore.model.MSerDeInfo [Table : > "SERDES", InheritanceStrategy > : new-table] > 11/08/20 10:12:33 INFO DataNucleus.Datastore: The class > "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as > "embedded-only" so does not have its own datastore > table. > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Class : org.apache.hadoop.hive.metastore.model.MStorageDescriptor > [Table : "SDS", InheritanceStr > ategy : new-table] > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Class : org.apache.hadoop.hive.metastore.model.MTable [Table : > "TBLS", InheritanceStrategy : new > -table] > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Field : org.apache.hadoop.hive.metastore.model.MSerDeInfo.parameters > [Table : "SERDE_PARAMS"] > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Field : org.apache.hadoop.hive.metastore.model.MTable.parameters > [Table : "TABLE_PARAMS"] > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Field : org.apache.hadoop.hive.metastore.model.MTable.partitionKeys > [Table : "PARTITION_KEYS"] > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Field : org.apache.hadoop.hive.metastore.model.MStorageDescriptor.bucketCols > [Table : "BUCKETING > _COLS"] > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Field : org.apache.hadoop.hive.metastore.model.MStorageDescriptor.cols > [Table : "COLUMNS"] > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Field : org.apache.hadoop.hive.metastore.model.MStorageDescriptor.parameters > [Table : "SD_PARAMS > "] > 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence > of Field : org.apache.hadoop.hive.metastore.model.MStorageDescriptor.sortCols > [Table : "SORT_COLS"] > 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) > for table "SERDES" > 11/08/20 10:12:33 INFO Datastore.Schema: Validating 0 foreign key(s) > for table "SERDES" > 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 index(es) for > table "SERDES" > 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 unique key(s) > for table "TBLS" > 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 foreign key(s) > for table "TBLS" > 11/08/20 10:12:33 INFO Datastore.Schema: Validating 4 index(es) for table "TBLS" > 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) > for table "SDS" > 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 foreign key(s) > for table "SDS" > 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 index(es) for table "SDS"
-
Re: Hive 0.7.1 does not work with PostgreSQL 9.0.2
Xiaobo Gu 2011-08-21, 01:54
thanks ,I change the DDL manually ,change bit to boolean ,it works ,
2011/8/21, wd <[EMAIL PROTECTED]>: > you can try hive 0.5, after create the metadata, use upgrade sql file > in hive 0.7.1 to upgrade to 0.7.1 > > On Sat, Aug 20, 2011 at 2:20 PM, Xiaobo Gu <[EMAIL PROTECTED]> wrote: >> Hi, >> I have just set up a PostgreSQL 9.0.2 server for hive 0.7.1 metastore, >> and I am using the postgresql-9.0-801.jdbc4.jar jdbc driver, when I >> test the following HQL, >> >> >> CREATE TABLE records (year STRING, temperature INT, quality INT) >> ROW FORMAT DELIMITED >> FIELDS TERMINATED BY '\t'; >> >> >> the following error messages are thrown in metastore services standard >> error: >> >> 11/08/20 10:12:33 INFO metastore.HiveMetaStore: 1: create_table: >> db=default tbl=records >> 11/08/20 10:12:33 INFO HiveMetaStore.audit: ugi=gpadmin >> ip=/192.168.72.6 cmd=create_table: db=default tbl=records >> 11/08/20 10:12:33 INFO metastore.HiveMetaStore: 1: Opening raw store >> with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore >> 11/08/20 10:12:33 INFO metastore.ObjectStore: ObjectStore, initialize >> called >> 11/08/20 10:12:33 INFO metastore.ObjectStore: Initialized ObjectStore >> 11/08/20 10:12:33 INFO DataNucleus.Datastore: The class >> "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as >> "embedded-only" so does not have its own data >> store table. >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Class : org.apache.hadoop.hive.metastore.model.MSerDeInfo [Table : >> "SERDES", InheritanceStrategy >> : new-table] >> 11/08/20 10:12:33 INFO DataNucleus.Datastore: The class >> "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as >> "embedded-only" so does not have its own datastore >> table. >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Class : org.apache.hadoop.hive.metastore.model.MStorageDescriptor >> [Table : "SDS", InheritanceStr >> ategy : new-table] >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Class : org.apache.hadoop.hive.metastore.model.MTable [Table : >> "TBLS", InheritanceStrategy : new >> -table] >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Field : org.apache.hadoop.hive.metastore.model.MSerDeInfo.parameters >> [Table : "SERDE_PARAMS"] >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Field : org.apache.hadoop.hive.metastore.model.MTable.parameters >> [Table : "TABLE_PARAMS"] >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Field : org.apache.hadoop.hive.metastore.model.MTable.partitionKeys >> [Table : "PARTITION_KEYS"] >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Field : >> org.apache.hadoop.hive.metastore.model.MStorageDescriptor.bucketCols >> [Table : "BUCKETING >> _COLS"] >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Field : org.apache.hadoop.hive.metastore.model.MStorageDescriptor.cols >> [Table : "COLUMNS"] >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Field : >> org.apache.hadoop.hive.metastore.model.MStorageDescriptor.parameters >> [Table : "SD_PARAMS >> "] >> 11/08/20 10:12:33 INFO DataNucleus.Persistence: Managing Persistence >> of Field : >> org.apache.hadoop.hive.metastore.model.MStorageDescriptor.sortCols >> [Table : "SORT_COLS"] >> 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s) >> for table "SERDES" >> 11/08/20 10:12:33 INFO Datastore.Schema: Validating 0 foreign key(s) >> for table "SERDES" >> 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 index(es) for >> table "SERDES" >> 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 unique key(s) >> for table "TBLS" >> 11/08/20 10:12:33 INFO Datastore.Schema: Validating 2 foreign key(s) >> for table "TBLS" >> 11/08/20 10:12:33 INFO Datastore.Schema: Validating 4 index(es) for table >> "TBLS" >> 11/08/20 10:12:33 INFO Datastore.Schema: Validating 1 unique key(s)
|
|