Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Migrating to hive 8.1 on EMR


+
Ranjan Bagchi 2012-06-18, 19:56
Copy link to this message
-
Re: Migrating to hive 8.1 on EMR
Hi Ranjan,

Looks like the NPE is getting generated here:

    if (0 == getCols().size()) {
      throw new HiveException(
          "at least one column must be specified for the table");
    }

Which would seem to indicate that the table record which was fetched
doesn't have any columns.

Did you run the metastore upgrade scripts for 0.8.0 (located in
metastore/scripts/upgrade)? Hive 0.8.0 includes HIVE-2246 which changed the
name and schema of the metastore table used to store column information.

Thanks.

Carl

On Mon, Jun 18, 2012 at 12:56 PM, Ranjan Bagchi <[EMAIL PROTECTED]>wrote:

> Hi,
>
> I've built a datastore using Hive 7.1 backed by S3 using persistent
> metadata.  Now that hive 8.1 is available, I'd like to migrate to the new
> version.
>
> However, I'm having trouble reading tables with the persistent schema.
>  Looking in the logs, I'm getting stack traces like the following:
> 2012-06-18 19:51:23,176 ERROR org.apache.hadoop.hive.ql.exec.Task
> (SessionState.
> java:printError(380)) - Failed with exception null
> java.lang.NullPointerException
>        at
> org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162
> )
>        at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:946)
>        at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:860)
>        at
> org.apache.hadoop.hive.ql.exec.DDLTask.describeTable(DDLTask.java:252
> 7)
>        at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:298)
>        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
>        at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.ja
> va:57)
>        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)
>        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)
>        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)
>        at
> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:261)
>        at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:218)
>        at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:409)
>        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:684)
>        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:567)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
> 2012-06-18 19:51:23,180 ERROR org.apache.hadoop.hive.ql.Driver
> (SessionState.java:printError(380)) - FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask
>
> Does anyone have experience with this?
>
> Thanks,
>
> Ranjan
>
>
+
Mark Grover 2012-06-19, 17:31
+
Mark Grover 2012-06-19, 19:22
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB