Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - FAILED: Error in metadata: MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException: in HBase+Hive intergration


Copy link to this message
-
FAILED: Error in metadata: MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException: in HBase+Hive intergration
sagar nikam 2013-01-09, 01:24
Respected Sir,

Componet used:-
-Ubuntu 12.04, hive(0.9.0), hbase(0.94.3), hadoop(0.20.2)-single-node,
zookeeper-3.4.3, guava-11.0.2, hive-hbase-handler-0.9.0

tutorials:-https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration

steps
1) start hadoop,
2) start hbase-master
3) start hiveserver
4) start hive shell using --auxpath parameters as in tutorial
 (all works without errors -   when I jps,-->
JobTracker,HMaster,DataNode,NameNode,SecondaryNameNode,TaskTracker,Jps)

    hbase(main):001:0> status
    1 servers, 0 dead, 2.0000 average load
On hive shell I create can create table as

    CREATE TABLE IF NOT EXISTS familia (id_familia INT,fk_veiculo
INT,fk_cliente INT,nome STRING) ROW FORMAT delimited fields terminated by
',' STORED AS TEXTFILE;
    load data local inpath
'/home/trendwise/hive_data/tables_csv/familia.csv' overwrite into table
familia;

but when I do below query,nothing shown,just cursor blinking.I waited for
long time,then error shown

    CREATE TABLE hbase_familia_1 (key int, id_familia int, fk_veiculo
INT,fk_cliente INT,nome STRING)
    STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
    WITH SERDEPROPERTIES("hbase.columns.mapping" = ":key, cf1:id_familia,
cf2:fk_veiculo,cf3:fk_cliente, cf4:nome")
    TBLPROPERTIES ("hbase.table.name" = "hbase_familia");

I did `list` on hbase shell,which didn't show any table what I tried ?

Error:-

    FAILED: Error in metadata:
MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
Retried 10 times
at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:127)
at
org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:73)
at
org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:147)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:398)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:538)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3305)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:242)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1118)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:258)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
    ) FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask

hbase-site.xml

    <property>
     <name>hbase.rootdir</name>
     <value>hdfs://localhost:54310/hbase</value>
    </property>
    <property>
     <name>dfs.replication</name>
     <value>1</value>
    </property>
    <property>
     <name>hbase.zookeeper.property.dataDir</name>
     <value>/home/trendwise/hadoop/hbase-0.94.3/hbase_dataDir</value>
    </property>
    <property>
     <name>hbase.zookeeper.property.clientPort</name>
     <value>2222</value>
     <description>Property from ZooKeeper's config zoo.cfg.
     </description>
    </property>
    <property>
     <name>hbase.zookeeper.quorum</name>
     <value>localhost</value>
     <description></description>
    </property>
    <property>
     <name>hbase.cluster.distributed</name>
     <value>true</value>
     <description></description>
    </property>
core-site.xml (Hadoop)

<configuration>
<property>
  <name>hadoop.tmp.dir</name>
  <value>/home/trendwise/hadoop/hadoop-0.20.2/hadoop_temp/</value>
  <description>A base for other temporary directories.</description>
</property>

<property>
  <name>fs.default.name</name>
  <value>hdfs://localhost:54310</value>
  <description>The name of the default file system.  A URI whose
  scheme and authority determine the FileSystem implementation.  The
  uri's scheme determines the config property (fs.SCHEME.impl) naming
  the FileSystem implementation class.  The uri's authority is used to
  determine the host, port, etc. for a filesystem.</description>
</property>

<property>
  <name>fs.inmemory.size.mb </name>
  <value>200 </value>
 </property>
<property>
  <name>io.sort.factor</name>
  <value>100 </value>
 </property>
<property>
  <name>io.sort.mb</name>
  <value>200 </value>
 </property>
<property>
  <name>io.file.buffer.size</name>
  <value>131072 </value>
 </property>

hive-site.xml (attached)
+
Ted Reynolds 2013-01-09, 16:37
+
sagar nikam 2013-06-14, 07:09