Hi,
  I tried using the oracle thin jdbc driver with the settings below in
hive-site.xml but got the exception pasted below[1]- anybody hit this?
(I am using Oracle 11g and hive trunk as of a month back).

Thanks,
Pradeep

[1]
-bash-3.1$ bin/hive
Hive history
file=/tmp/pradeepk/hive_job_log_pradeepk_201006032327_643566363.txt
hive> show tables;
FAILED: Error in metadata: MetaException(message:Got exception:
javax.jdo.JDODataStoreException An exception was thrown while
adding/validating class(es) : ORA-01754: a table may contain only one
column of type LONG

java.sql.SQLSyntaxErrorException: ORA-01754: a table may contain only
one column of type LONG

        at
oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:91)
        at
oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:133)
        at
oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:206)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:455)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:413)
        at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:1034)
        at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:183)
        at
oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:942)
        at
oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1222)
        at
oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1770)
        at
oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1739)

Carl Steinbach wrote:
> Hi Pradeep,
>
> Your config values will need to look something like this:
>
> javax.jdo.option.ConnectionURL = jdbc:oracle:thin:@'host':'port':'db-name'
> javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver
> javax.jdo.option.ConnectionUserName </hadoop/ConnectionUserName> =
> your-user-name
> javax.jdo.option.ConnectionPassword </hadoop/ConnectionPassword> =
> your-password
>
> Obviously you need to replace 'host', 'port' and 'db-name' with
> appropriate values. You also need to get a copy of the Oracle thin
> JDBC driver (or some other JDBC driver that supports Oracle) and make
> sure that it is available in Hive's classpath (e.g. by referencing it
> in HIVE_AUX_JARS_PATH). If this does not work out of the box I
> recommend consulting the documentation that comes with your JDBC driver.
>
> Thanks.
>
> Carl
>
> On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath
> <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> wrote:
>
>     Hi Sonal,
>      I want to set up hive metastore with Oracle as backend and wanted
>     the config values for that.
>
>     Thanks,
>     Pradee
>
>     -----Original Message-----
>     From: Sonal Goyal [mailto:[EMAIL PROTECTED]
>     <mailto:[EMAIL PROTECTED]>]
>     Sent: Tuesday, May 25, 2010 10:42 AM
>     To: [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
>     Subject: Fwd: metastore set up with Oracle backend?
>
>     Hi Pradeep,
>
>     You can check the config values for MySQL as a metastore for Hive at
>     the following link:
>
>     http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx
>
>     Thanks and Regards,
>     Sonal
>     www.meghsoft.com <http://www.meghsoft.com>
>     http://in.linkedin.com/in/sonalgoyal
>
>
>     On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath
>     <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> wrote:
>     >
>     > Hi Aaron,
>     >
>     >   Can you share some details along the lines of what is
>     described in
>     http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore
>     for MySQL? (Essentially what changes are needed in properties to
>     get this working)
>     >
>     >
>     >
>     > Thanks,
>     >
>     > Pradeep
>     >
>     >
>     >
>     > ________________________________
>     >
>     > From: Aaron McCurry [mailto:[EMAIL PROTECTED]
>     <mailto:[EMAIL PROTECTED]>]

Hmm, this is because MTable now has two LONGVARCHAR fields (viewOriginalText and viewExpandedText).  Can you find a way to get the Oracle driver or JDO to map these to CLOB instead of LONG VARCHAR?  Oracle allows multiple CLOB fields on the same table, but only one LONG VARCHAR (legacy crud).

JVS

________________________________________
From: Pradeep Kamath [[EMAIL PROTECTED]]
Sent: Friday, June 04, 2010 9:22 AM
To: [EMAIL PROTECTED]
Subject: Re: metastore set up with Oracle backend?

Hi,
  I tried using the oracle thin jdbc driver with the settings below in hive-site.xml but got the exception pasted below[1]- anybody hit this? (I am using Oracle 11g and hive trunk as of a month back).

Thanks,
Pradeep

[1]
-bash-3.1$ bin/hive
Hive history file=/tmp/pradeepk/hive_job_log_pradeepk_201006032327_643566363.txt
hive> show tables;
FAILED: Error in metadata: MetaException(message:Got exception: javax.jdo.JDODataStoreException An exception was thrown while adding/validating class(es) : ORA-01754: a table may contain only one column of type LONG

java.sql.SQLSyntaxErrorException: ORA-01754: a table may contain only one column of type LONG

        at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:91)
        at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:133)
        at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:206)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:455)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:413)
        at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:1034)
        at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:183)
        at oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:942)
        at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1222)
        at oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1770)
        at oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1739)

Carl Steinbach wrote:
Hi Pradeep,

Your config values will need to look something like this:

javax.jdo.option.ConnectionURL = jdbc:oracle:thin:@'host':'port':'db-name'
javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver
javax.jdo.option.ConnectionUserName</hadoop/ConnectionUserName> = your-user-name
javax.jdo.option.ConnectionPassword</hadoop/ConnectionPassword> = your-password

Obviously you need to replace 'host', 'port' and 'db-name' with appropriate values. You also need to get a copy of the Oracle thin JDBC driver (or some other JDBC driver that supports Oracle) and make sure that it is available in Hive's classpath (e.g. by referencing it in HIVE_AUX_JARS_PATH). If this does not work out of the box I recommend consulting the documentation that comes with your JDBC driver.

Thanks.

Carl

On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi Sonal,
 I want to set up hive metastore with Oracle as backend and wanted the config values for that.

Thanks,
Pradee

-----Original Message-----
From: Sonal Goyal [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Tuesday, May 25, 2010 10:42 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Fwd: metastore set up with Oracle backend?

Hi Pradeep,

You can check the config values for MySQL as a metastore for Hive at
the following link:

http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx

Thanks and Regards,
Sonal
www.meghsoft.com<http://www.meghsoft.com>
http://in.linkedin.com/in/sonalgoyal
On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
>
> Hi Aaron,
>
>   Can you share some details along the lines of what is described in http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore for MySQL? (Essentially what changes are needed in properties to get this working)

Thanks for the pointer John! - I got it working by editing
metastore/src/model/package.jdo to make the following change:

       <field name="viewOriginalText">
-        <column name="VIEW_ORIGINAL_TEXT" jdbc-type="LONGVARCHAR"/>
+        <column name="VIEW_ORIGINAL_TEXT" jdbc-type="CLOB"/>
       </field>
       <field name="viewExpandedText">
-        <column name="VIEW_EXPANDED_TEXT" jdbc-type="LONGVARCHAR"/>
+        <column name="VIEW_EXPANDED_TEXT" jdbc-type="CLOB"/>
       </field>

I then rebuilt hive and used the resulting build and it worked - is
there a way to achieve the same without changing
metastore/src/model/package.jdo and rebuilding?

Thanks,
Pradeep

John Sichi wrote:
> Hmm, this is because MTable now has two LONGVARCHAR fields (viewOriginalText and viewExpandedText).  Can you find a way to get the Oracle driver or JDO to map these to CLOB instead of LONG VARCHAR?  Oracle allows multiple CLOB fields on the same table, but only one LONG VARCHAR (legacy crud).
>
> JVS
>
> ________________________________________
> From: Pradeep Kamath [[EMAIL PROTECTED]]
> Sent: Friday, June 04, 2010 9:22 AM
> To: [EMAIL PROTECTED]
> Subject: Re: metastore set up with Oracle backend?
>
> Hi,
>   I tried using the oracle thin jdbc driver with the settings below in hive-site.xml but got the exception pasted below[1]- anybody hit this? (I am using Oracle 11g and hive trunk as of a month back).
>
> Thanks,
> Pradeep
>
> [1]
> -bash-3.1$ bin/hive
> Hive history file=/tmp/pradeepk/hive_job_log_pradeepk_201006032327_643566363.txt
> hive> show tables;
> FAILED: Error in metadata: MetaException(message:Got exception: javax.jdo.JDODataStoreException An exception was thrown while adding/validating class(es) : ORA-01754: a table may contain only one column of type LONG
>
> java.sql.SQLSyntaxErrorException: ORA-01754: a table may contain only one column of type LONG
>
>         at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:91)
>         at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:133)
>         at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:206)
>         at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:455)
>         at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:413)
>         at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:1034)
>         at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:183)
>         at oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:942)
>         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1222)
>         at oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1770)
>         at oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1739)
>
>
>
> Carl Steinbach wrote:
> Hi Pradeep,
>
> Your config values will need to look something like this:
>
> javax.jdo.option.ConnectionURL = jdbc:oracle:thin:@'host':'port':'db-name'
> javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver
> javax.jdo.option.ConnectionUserName</hadoop/ConnectionUserName> = your-user-name
> javax.jdo.option.ConnectionPassword</hadoop/ConnectionPassword> = your-password
>
> Obviously you need to replace 'host', 'port' and 'db-name' with appropriate values. You also need to get a copy of the Oracle thin JDBC driver (or some other JDBC driver that supports Oracle) and make sure that it is available in Hive's classpath (e.g. by referencing it in HIVE_AUX_JARS_PATH). If this does not work out of the box I recommend consulting the documentation that comes with your JDBC driver.
>
> Thanks.
>
> Carl
>
> On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
> Hi Sonal,
>  I want to set up hive metastore with Oracle as backend and wanted the config values for that.
>
> Thanks,
> Pradee
>
> -----Original Message-----
> From: Sonal Goyal [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]

I don't know how to do that.  If CLOB gets mapped correctly for MySQL and Derby, we could just change the default so it would be Oracle-compatible.  Otherwise, if we can't find some other place to override the mapping, maybe we could templatize the .jdo file, although I'm not sure how that would work since it gets burned into a .jar.

Another option is to precreate your schema in Oracle and then tell JDO not to try to create/update it automatically.

JVS

On Jun 4, 2010, at 1:58 PM, Pradeep Kamath wrote:

Thanks for the pointer John! - I got it working by editing metastore/src/model/package.jdo to make the following change:

       <field name="viewOriginalText">
-        <column name="VIEW_ORIGINAL_TEXT" jdbc-type="LONGVARCHAR"/>
+        <column name="VIEW_ORIGINAL_TEXT" jdbc-type="CLOB"/>
       </field>
       <field name="viewExpandedText">
-        <column name="VIEW_EXPANDED_TEXT" jdbc-type="LONGVARCHAR"/>
+        <column name="VIEW_EXPANDED_TEXT" jdbc-type="CLOB"/>
       </field>

I then rebuilt hive and used the resulting build and it worked - is there a way to achieve the same without changing metastore/src/model/package.jdo and rebuilding?

Thanks,
Pradeep

John Sichi wrote:

Hmm, this is because MTable now has two LONGVARCHAR fields (viewOriginalText and viewExpandedText).  Can you find a way to get the Oracle driver or JDO to map these to CLOB instead of LONG VARCHAR?  Oracle allows multiple CLOB fields on the same table, but only one LONG VARCHAR (legacy crud).

JVS

________________________________________
From: Pradeep Kamath [[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Friday, June 04, 2010 9:22 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: metastore set up with Oracle backend?

Hi,
  I tried using the oracle thin jdbc driver with the settings below in hive-site.xml but got the exception pasted below[1]- anybody hit this? (I am using Oracle 11g and hive trunk as of a month back).

Thanks,
Pradeep

[1]
-bash-3.1$ bin/hive
Hive history file=/tmp/pradeepk/hive_job_log_pradeepk_201006032327_643566363.txt
hive> show tables;
FAILED: Error in metadata: MetaException(message:Got exception: javax.jdo.JDODataStoreException An exception was thrown while adding/validating class(es) : ORA-01754: a table may contain only one column of type LONG

java.sql.SQLSyntaxErrorException: ORA-01754: a table may contain only one column of type LONG

        at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:91)
        at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:133)
        at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:206)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:455)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:413)
        at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:1034)
        at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:183)
        at oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:942)
        at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1222)
        at oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1770)
        at oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1739)

Carl Steinbach wrote:
Hi Pradeep,

Your config values will need to look something like this:

javax.jdo.option.ConnectionURL = jdbc:oracle:thin:@'host':'port':'db-name'
javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver
javax.jdo.option.ConnectionUserName</hadoop/ConnectionUserName> = your-user-name
javax.jdo.option.ConnectionPassword</hadoop/ConnectionPassword> = your-password

Obviously you need to replace 'host', 'port' and 'db-name' with appropriate values. You also need to get a copy of the Oracle thin JDBC driver (or some other JDBC driver that supports Oracle) and make sure that it is available in Hive's classpath (e.g. by referencing it in HIVE_AUX_JARS_PATH). If this does not work out of the box I recommend consulting the documentation that comes with your JDBC driver.

Thanks.

Carl

On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]>> wrote:
Hi Sonal,
 I want to set up hive metastore with Oracle as backend and wanted the config values for that.

Thanks,
Pradee

From: Sonal Goyal [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]>]
Sent: Tuesday, May 25, 2010 10:42 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]>
Subject: Fwd: metastore set up with Oracle backend?

Hi Pradeep,

You can check the config values for MySQL as a metastore for Hive at
the following link:

http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx

Thanks and Regards,
Sonal
www.meghsoft.com<http://www.meghsoft.com/><http://www.meghsoft.com><http://www.meghsoft.com/>
http://in.linkedin.com/in/sonalgoyal
On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]>> wrote:
Hi Aaron,

  Can you share some details along the lines of what is described in http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore for MySQL? (Essentially what changes are needed in properties to get this working)

Thanks,

Pradeep

________________________________

From: Aaron McCurry [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]>]
Sent: Monday, May 24, 2010 1:42 PM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]><mailto:[EMAIL PROTECTED]>
Subject: Re: metastore set up with Oracle backend?

I have done it, everything seemed to work