Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Hive-Hbase integration require Hbase in Pseudo distributed??


+
Alok Kumar 2011-12-02, 08:30
+
Ankit Jain 2011-12-02, 08:33
+
Mohammad Tariq 2011-12-02, 09:22
+
Alok Kumar 2011-12-02, 10:00
+
Ankit Jain 2011-12-02, 11:44
+
Alok Kumar 2011-12-02, 12:04
+
Ankit Jain 2011-12-02, 12:19
Copy link to this message
-
Re: Hive-Hbase integration require Hbase in Pseudo distributed??
hi,

yeah i've used

$HIVE_HOME/bin/hive --auxpath
$HIVE_HOME/lib/hive-hbase-handler-*.jar,$HIVE_HOME/lib/hbase-*.jar,$HIVE_HOME/lib/zookeeper-*.jar
-hiveconf hbase.master=localhost:60000
------------------------------------------------
Hadoop version : hadoop-0.20.203.0
Hbase version : hbase-0.90.4
Hive version : hive-0.9.0 (built from trunk)
on
Ubuntu 11.10
-----------------------------------------------

Regards,

Alok

On Fri, Dec 2, 2011 at 5:49 PM, Ankit Jain <[EMAIL PROTECTED]> wrote:

> Hi,
>
> have you used following command to start the hive shell.
>
> $HIVE_HOME/bin/hive --auxpath $HIVE_HOME/lib/hive-hbase-handler-*.jar,$HIVE_HOME/lib/hbase-*.jar,$HIVE_HOME/lib/zookeeper-*.jar -hiveconf hbase.master=127.0.0.1:60000
>
> If no then used above command.
> Regards,
> Ankit
>
>
> On Fri, Dec 2, 2011 at 5:34 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> // Hadoop core-site.xml
>> <configuration>
>>     <property>
>>         <name>fs.default.name</name>
>>         <value>hdfs://localhost:9000</value>
>>     </property>
>>     <property>
>>         <name>hadoop.tmp.dir</name>
>>         <value>/home/alokkumar/hadoop/tmp</value>
>>     </property>
>>  </configuration>
>>
>> // hbase-site.xml
>> <configuration>
>>     <property>
>>             <name>hbase.rootdir</name>
>>        <!--    <value>hdfs://localhost:9000/hbase</value>-->
>>         <value>file:///home/alokkumar/hbase/</value>
>>     </property>
>> </configuration>
>>
>> with these conf Hbase/Hive are runnning independently file..
>> hbase(main):003:0> status
>> 1 servers, 0 dead, 4.0000 average load
>>
>> but i'm stil getting $hive> CREATE TABLE hbase_table_1(key int, value
>> string)
>>     > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>>     > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val");
>> FAILED: Error in metadata:
>> MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
>> localhost:45966
>>
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:394)
>>     at
>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:83)
>>
>> Regards,
>> Alok
>>
>>
>> On Fri, Dec 2, 2011 at 5:14 PM, Ankit Jain <[EMAIL PROTECTED]>wrote:
>>
>>> HI,
>>>
>>> Can you post the Hbase-site.xml and hadoop core-site.xml properties here.
>>>
>>> Regards,
>>> Ankit
>>>
>>>
>>> On Fri, Dec 2, 2011 at 3:30 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
>>>
>>>> Hi Ankit,
>>>>
>>>> you were right, my Hbase shell/HMaster was not running though it was
>>>> coming in jps :)
>>>>
>>>> nw i've run my HMaster n Hbase shell is up.. n getting this error--
>>>> Do I need zookeeper configured in standalone mode?
>>>>
>>>> hive> CREATE TABLE hbase_table_1(key int, value string)
>>>>     > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>>>>     > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
>>>>     > TBLPROPERTIES ("hbase.table.name" = "xyz");
>>>>
>>>> FAILED: Error in metadata:
>>>> MetaException(message:org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>>> org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>>> org.apache.zookeeper.KeeperException$ConnectionLossException:
>>>> KeeperErrorCode = ConnectionLoss for /hbase
>>>>     at
>>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:985)
>>>>     at
>>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>>>>     at
>>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
>>>>     at
>>>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
>>>>     at
>>>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:79)
>>>>
>>>>     at
>>>> org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:74)
Alok Kumar
+
Mohammad Tariq 2011-12-02, 12:28
+
jcfolsom@... 2011-12-02, 18:39
+
John Sichi 2011-12-02, 21:51
+
jcfolsom@... 2011-12-03, 07:32