Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Hive-Hbase integration require Hbase in Pseudo distributed??


+
Alok Kumar 2011-12-02, 08:30
+
Ankit Jain 2011-12-02, 08:33
+
Mohammad Tariq 2011-12-02, 09:22
+
Alok Kumar 2011-12-02, 10:00
+
Ankit Jain 2011-12-02, 11:44
Copy link to this message
-
Re: Hive-Hbase integration require Hbase in Pseudo distributed??
Hi,

// Hadoop core-site.xml
<configuration>
    <property>
        <name>fs.default.name</name>
        <value>hdfs://localhost:9000</value>
    </property>
    <property>
        <name>hadoop.tmp.dir</name>
        <value>/home/alokkumar/hadoop/tmp</value>
    </property>
 </configuration>

// hbase-site.xml
<configuration>
    <property>
            <name>hbase.rootdir</name>
       <!--    <value>hdfs://localhost:9000/hbase</value>-->
        <value>file:///home/alokkumar/hbase/</value>
    </property>
</configuration>

with these conf Hbase/Hive are runnning independently file..
hbase(main):003:0> status
1 servers, 0 dead, 4.0000 average load

but i'm stil getting $hive> CREATE TABLE hbase_table_1(key int, value
string)
    > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
    > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val");
FAILED: Error in metadata:
MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
localhost:45966
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:394)
    at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:83)

Regards,
Alok

On Fri, Dec 2, 2011 at 5:14 PM, Ankit Jain <[EMAIL PROTECTED]> wrote:

> HI,
>
> Can you post the Hbase-site.xml and hadoop core-site.xml properties here.
>
> Regards,
> Ankit
>
>
> On Fri, Dec 2, 2011 at 3:30 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
>
>> Hi Ankit,
>>
>> you were right, my Hbase shell/HMaster was not running though it was
>> coming in jps :)
>>
>> nw i've run my HMaster n Hbase shell is up.. n getting this error--
>> Do I need zookeeper configured in standalone mode?
>>
>> hive> CREATE TABLE hbase_table_1(key int, value string)
>>     > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>>     > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
>>     > TBLPROPERTIES ("hbase.table.name" = "xyz");
>>
>> FAILED: Error in metadata:
>> MetaException(message:org.apache.hadoop.hbase.ZooKeeperConnectionException:
>> org.apache.hadoop.hbase.ZooKeeperConnectionException:
>> org.apache.zookeeper.KeeperException$ConnectionLossException:
>> KeeperErrorCode = ConnectionLoss for /hbase
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:985)
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
>>     at
>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:79)
>>
>>     at
>> org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:74)
>>     at
>> org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:158)
>>     at
>> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:375)
>>     at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:540)
>>     at
>> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3473)
>>     at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:225)
>>     at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
>>     at
>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>>     at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)
>>     at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)
>>     at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)
>>     at
>> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255)
>>     at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212)
>>     at
>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
+
Ankit Jain 2011-12-02, 12:19
+
Alok Kumar 2011-12-02, 12:24
+
Mohammad Tariq 2011-12-02, 12:28
+
jcfolsom@... 2011-12-02, 18:39
+
John Sichi 2011-12-02, 21:51
+
jcfolsom@... 2011-12-03, 07:32
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB