Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - Hive-Hbase integration require Hbase in Pseudo distributed??


+
Alok Kumar 2011-12-02, 08:30
+
Ankit Jain 2011-12-02, 08:33
+
Mohammad Tariq 2011-12-02, 09:22
+
Alok Kumar 2011-12-02, 10:00
+
Ankit Jain 2011-12-02, 11:44
Copy link to this message
-
Re: Hive-Hbase integration require Hbase in Pseudo distributed??
Alok Kumar 2011-12-02, 12:04
Hi,

// Hadoop core-site.xml
<configuration>
    <property>
        <name>fs.default.name</name>
        <value>hdfs://localhost:9000</value>
    </property>
    <property>
        <name>hadoop.tmp.dir</name>
        <value>/home/alokkumar/hadoop/tmp</value>
    </property>
 </configuration>

// hbase-site.xml
<configuration>
    <property>
            <name>hbase.rootdir</name>
       <!--    <value>hdfs://localhost:9000/hbase</value>-->
        <value>file:///home/alokkumar/hbase/</value>
    </property>
</configuration>

with these conf Hbase/Hive are runnning independently file..
hbase(main):003:0> status
1 servers, 0 dead, 4.0000 average load

but i'm stil getting $hive> CREATE TABLE hbase_table_1(key int, value
string)
    > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
    > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val");
FAILED: Error in metadata:
MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
localhost:45966
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:394)
    at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:83)

Regards,
Alok

On Fri, Dec 2, 2011 at 5:14 PM, Ankit Jain <[EMAIL PROTECTED]> wrote:

> HI,
>
> Can you post the Hbase-site.xml and hadoop core-site.xml properties here.
>
> Regards,
> Ankit
>
>
> On Fri, Dec 2, 2011 at 3:30 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
>
>> Hi Ankit,
>>
>> you were right, my Hbase shell/HMaster was not running though it was
>> coming in jps :)
>>
>> nw i've run my HMaster n Hbase shell is up.. n getting this error--
>> Do I need zookeeper configured in standalone mode?
>>
>> hive> CREATE TABLE hbase_table_1(key int, value string)
>>     > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>>     > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
>>     > TBLPROPERTIES ("hbase.table.name" = "xyz");
>>
>> FAILED: Error in metadata:
>> MetaException(message:org.apache.hadoop.hbase.ZooKeeperConnectionException:
>> org.apache.hadoop.hbase.ZooKeeperConnectionException:
>> org.apache.zookeeper.KeeperException$ConnectionLossException:
>> KeeperErrorCode = ConnectionLoss for /hbase
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:985)
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
>>     at
>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:79)
>>
>>     at
>> org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:74)
>>     at
>> org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:158)
>>     at
>> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:375)
>>     at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:540)
>>     at
>> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3473)
>>     at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:225)
>>     at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
>>     at
>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>>     at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)
>>     at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)
>>     at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)
>>     at
>> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255)
>>     at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212)
>>     at
>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
+
Ankit Jain 2011-12-02, 12:19
+
Alok Kumar 2011-12-02, 12:24
+
Mohammad Tariq 2011-12-02, 12:28
+
jcfolsom@... 2011-12-02, 18:39
+
John Sichi 2011-12-02, 21:51
+
jcfolsom@... 2011-12-03, 07:32