Hi,

I am trying to insert a table in hive, and I am getting this strange error.

Here is what I do

insert overwrite table hivetable
struct(lpad(ch, 20, ' '),lpad(start, 10, 0),lpad(strand,10,' '),lpad(ref,
3, ' ')),
struct(X,mmm,c_count,t_count,mm)
from atable;

and here is what I get. Any and all ideas are welcome :)

Thank you,
Mark

java.lang.ClassNotFoundException: org/apache/hadoop/hive/hbase/HBaseSerDe
Continuing ...
java.lang.ClassNotFoundException:
org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat
Continuing ...
java.lang.ClassNotFoundException:
org/apache/hadoop/hive/hbase/HiveHBaseTableOutputFormat
Continuing ...
java.lang.NullPointerException
Continuing ...
java.lang.NullPointerException
 at
org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:280)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:433)
 at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:389)
 at
org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:62)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:433)
 at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:389)
 at
org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:133)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
 at
org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:444)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
 at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:98)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:616)
 at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
 at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
 at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
 at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:616)
 at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
 at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
 at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
 at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:387)
 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
 at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:416)
 at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
 at org.apache.hadoop.mapred.Child.main(Child.java:260)

Hi Mark

I noticed,there is no 'Select' clause seen in 'Insert Overwrite'.

I believe your table is using a HiveHbase Storage Handler. Ensure that the required jars are given in hive --auxpath. You'll require the following jars
Hive Hbase Handler jar
Hbase jar
Zookeeper jar
Guava jar
Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: Mark Kerzner <[EMAIL PROTECTED]>
Date: Wed, 14 Nov 2012 17:05:20
To: Hadoop User<[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Strange error in Hive

Hi,

I am trying to insert a table in hive, and I am getting this strange error.

Here is what I do

insert overwrite table hivetable
struct(lpad(ch, 20, ' '),lpad(start, 10, 0),lpad(strand,10,' '),lpad(ref,
3, ' ')),
struct(X,mmm,c_count,t_count,mm)
from atable;

and here is what I get. Any and all ideas are welcome :)

Thank you,
Mark

java.lang.ClassNotFoundException: org/apache/hadoop/hive/hbase/HBaseSerDe
Continuing ...
java.lang.ClassNotFoundException:
org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat
Continuing ...
java.lang.ClassNotFoundException:
org/apache/hadoop/hive/hbase/HiveHBaseTableOutputFormat
Continuing ...
java.lang.NullPointerException
Continuing ...
java.lang.NullPointerException
 at
org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:280)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:433)
 at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:389)
 at
org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:62)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:433)
 at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:389)
 at
org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:133)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
 at
org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:444)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
 at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:98)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:616)
 at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
 at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
 at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
 at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:616)
 at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
 at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
 at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
 at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:387)
 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
 at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:416)
 at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
 at org.apache.hadoop.mapred.Child.main(Child.java:260)