Respected Sir,
Componet used:-
-Ubuntu 12.04, hive(0.9.0), hbase(0.94.3), hadoop(0.20.2)-single-node,
zookeeper-3.4.3, guava-11.0.2, hive-hbase-handler-0.9.0
tutorials:-
https://cwiki.apache.org/confluence/display/Hive/HBaseIntegrationsteps
1) start hadoop,
2) start hbase-master
3) start hiveserver
4) start hive shell using --auxpath parameters as in tutorial
(all works without errors - when I jps,-->
JobTracker,HMaster,DataNode,NameNode,SecondaryNameNode,TaskTracker,Jps)
hbase(main):001:0> status
1 servers, 0 dead, 2.0000 average load
On hive shell I create can create table as
CREATE TABLE IF NOT EXISTS familia (id_familia INT,fk_veiculo
INT,fk_cliente INT,nome STRING) ROW FORMAT delimited fields terminated by
',' STORED AS TEXTFILE;
load data local inpath
'/home/trendwise/hive_data/tables_csv/familia.csv' overwrite into table
familia;
but when I do below query,nothing shown,just cursor blinking.I waited for
long time,then error shown
CREATE TABLE hbase_familia_1 (key int, id_familia int, fk_veiculo
INT,fk_cliente INT,nome STRING)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES("hbase.columns.mapping" = ":key, cf1:id_familia,
cf2:fk_veiculo,cf3:fk_cliente, cf4:nome")
TBLPROPERTIES ("hbase.table.name" = "hbase_familia");
I did `list` on hbase shell,which didn't show any table what I tried ?
Error:-
FAILED: Error in metadata:
MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
Retried 10 times
at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:127)
at
org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:73)
at
org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:147)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:398)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:538)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3305)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:242)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1118)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:258)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
) FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask
hbase-site.xml
<property>
<name>hbase.rootdir</name>
<value>hdfs://localhost:54310/hbase</value>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/home/trendwise/hadoop/hbase-0.94.3/hbase_dataDir</value>
</property>
<property>
<name>hbase.zookeeper.property.clientPort</name>
<value>2222</value>
<description>Property from ZooKeeper's config zoo.cfg.
</description>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>localhost</value>
<description></description>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
<description></description>
</property>
core-site.xml (Hadoop)
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/trendwise/hadoop/hadoop-0.20.2/hadoop_temp/</value>
<description>A base for other temporary directories.</description>
</property>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:54310</value>
<description>The name of the default file system. A URI whose
scheme and authority determine the FileSystem implementation. The
uri's scheme determines the config property (fs.SCHEME.impl) naming
the FileSystem implementation class. The uri's authority is used to
determine the host, port, etc. for a filesystem.</description>
</property>
<property>
<name>fs.inmemory.size.mb </name>
<value>200 </value>
</property>
<property>
<name>io.sort.factor</name>
<value>100 </value>
</property>
<property>
<name>io.sort.mb</name>
<value>200 </value>
</property>
<property>
<name>io.file.buffer.size</name>
<value>131072 </value>
</property>
hive-site.xml (attached)