|
|
-
FAILED: Error in metadata: MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException: in HBase+Hive intergrationsagar nikam 2013-01-09, 01:24
Respected Sir,
Componet used:- -Ubuntu 12.04, hive(0.9.0), hbase(0.94.3), hadoop(0.20.2)-single-node, zookeeper-3.4.3, guava-11.0.2, hive-hbase-handler-0.9.0 tutorials:-https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration steps 1) start hadoop, 2) start hbase-master 3) start hiveserver 4) start hive shell using --auxpath parameters as in tutorial (all works without errors - when I jps,--> JobTracker,HMaster,DataNode,NameNode,SecondaryNameNode,TaskTracker,Jps) hbase(main):001:0> status 1 servers, 0 dead, 2.0000 average load On hive shell I create can create table as CREATE TABLE IF NOT EXISTS familia (id_familia INT,fk_veiculo INT,fk_cliente INT,nome STRING) ROW FORMAT delimited fields terminated by ',' STORED AS TEXTFILE; load data local inpath '/home/trendwise/hive_data/tables_csv/familia.csv' overwrite into table familia; but when I do below query,nothing shown,just cursor blinking.I waited for long time,then error shown CREATE TABLE hbase_familia_1 (key int, id_familia int, fk_veiculo INT,fk_cliente INT,nome STRING) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES("hbase.columns.mapping" = ":key, cf1:id_familia, cf2:fk_veiculo,cf3:fk_cliente, cf4:nome") TBLPROPERTIES ("hbase.table.name" = "hbase_familia"); I did `list` on hbase shell,which didn't show any table what I tried ? Error:- FAILED: Error in metadata: MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException: Retried 10 times at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:127) at org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:73) at org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:147) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:398) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:538) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3305) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:242) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1118) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:258) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) ) FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask hbase-site.xml <property> <name>hbase.rootdir</name> <value>hdfs://localhost:54310/hbase</value> </property> <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>hbase.zookeeper.property.dataDir</name> <value>/home/trendwise/hadoop/hbase-0.94.3/hbase_dataDir</value> </property> <property> <name>hbase.zookeeper.property.clientPort</name> <value>2222</value> <description>Property from ZooKeeper's config zoo.cfg. </description> </property> <property> <name>hbase.zookeeper.quorum</name> <value>localhost</value> <description></description> </property> <property> <name>hbase.cluster.distributed</name> <value>true</value> <description></description> </property> core-site.xml (Hadoop) <configuration> <property> <name>hadoop.tmp.dir</name> <value>/home/trendwise/hadoop/hadoop-0.20.2/hadoop_temp/</value> <description>A base for other temporary directories.</description> </property> <property> <name>fs.default.name</name> <value>hdfs://localhost:54310</value> <description>The name of the default file system. A URI whose scheme and authority determine the FileSystem implementation. The uri's scheme determines the config property (fs.SCHEME.impl) naming the FileSystem implementation class. The uri's authority is used to determine the host, port, etc. for a filesystem.</description> </property> <property> <name>fs.inmemory.size.mb </name> <value>200 </value> </property> <property> <name>io.sort.factor</name> <value>100 </value> </property> <property> <name>io.sort.mb</name> <value>200 </value> </property> <property> <name>io.file.buffer.size</name> <value>131072 </value> </property> hive-site.xml (attached) +
Ted Reynolds 2013-01-09, 16:37
+
sagar nikam 2013-06-14, 07:09
|