Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - Hive-Hbase integration require Hbase in Pseudo distributed??


Copy link to this message
-
Re: Hive-Hbase integration require Hbase in Pseudo distributed??
Mohammad Tariq 2011-12-02, 12:28
Anyone there, cud you please confirm if I can use hive-hbase in
standalone mode???
will it work? or should i go for Pseudo distributed mode ?

Regards,
    Mohammad Tariq

On Fri, Dec 2, 2011 at 5:54 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
> hi,
>
> yeah i've used
>
> $HIVE_HOME/bin/hive --auxpath
> $HIVE_HOME/lib/hive-hbase-handler-*.jar,$HIVE_HOME/lib/hbase-*.jar,$HIVE_HOME/lib/zookeeper-*.jar
> -hiveconf hbase.master=localhost:60000
> ------------------------------------------------
>
> Hadoop version : hadoop-0.20.203.0
> Hbase version : hbase-0.90.4
> Hive version : hive-0.9.0 (built from trunk)
> on
> Ubuntu 11.10
> -----------------------------------------------
>
> Regards,
>
> Alok
>
>
> On Fri, Dec 2, 2011 at 5:49 PM, Ankit Jain <[EMAIL PROTECTED]> wrote:
>>
>> Hi,
>>
>> have you used following command to start the hive shell.
>>
>> $HIVE_HOME/bin/hive --auxpath
>> $HIVE_HOME/lib/hive-hbase-handler-*.jar,$HIVE_HOME/lib/hbase-*.jar,$HIVE_HOME/lib/zookeeper-*.jar
>> -hiveconf hbase.master=127.0.0.1:60000
>>
>>
>> If no then used above command.
>> Regards,
>> Ankit
>>
>>
>> On Fri, Dec 2, 2011 at 5:34 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
>>>
>>> Hi,
>>>
>>> // Hadoop core-site.xml
>>> <configuration>
>>>     <property>
>>>         <name>fs.default.name</name>
>>>         <value>hdfs://localhost:9000</value>
>>>     </property>
>>>     <property>
>>>         <name>hadoop.tmp.dir</name>
>>>         <value>/home/alokkumar/hadoop/tmp</value>
>>>     </property>
>>>  </configuration>
>>>
>>> // hbase-site.xml
>>> <configuration>
>>>     <property>
>>>             <name>hbase.rootdir</name>
>>>        <!--    <value>hdfs://localhost:9000/hbase</value>-->
>>>         <value>file:///home/alokkumar/hbase/</value>
>>>     </property>
>>> </configuration>
>>>
>>> with these conf Hbase/Hive are runnning independently file..
>>> hbase(main):003:0> status
>>> 1 servers, 0 dead, 4.0000 average load
>>>
>>> but i'm stil getting $hive> CREATE TABLE hbase_table_1(key int, value
>>> string)
>>>     > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>>>     > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val");
>>> FAILED: Error in metadata:
>>> MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
>>> localhost:45966
>>>
>>>     at
>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:394)
>>>     at
>>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:83)
>>>
>>> Regards,
>>> Alok
>>>
>>>
>>> On Fri, Dec 2, 2011 at 5:14 PM, Ankit Jain <[EMAIL PROTECTED]>
>>> wrote:
>>>>
>>>> HI,
>>>>
>>>> Can you post the Hbase-site.xml and hadoop core-site.xml properties
>>>> here.
>>>>
>>>> Regards,
>>>> Ankit
>>>>
>>>>
>>>> On Fri, Dec 2, 2011 at 3:30 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
>>>>>
>>>>> Hi Ankit,
>>>>>
>>>>> you were right, my Hbase shell/HMaster was not running though it was
>>>>> coming in jps :)
>>>>>
>>>>> nw i've run my HMaster n Hbase shell is up.. n getting this error--
>>>>> Do I need zookeeper configured in standalone mode?
>>>>>
>>>>> hive> CREATE TABLE hbase_table_1(key int, value string)
>>>>>     > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>>>>>     > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
>>>>>     > TBLPROPERTIES ("hbase.table.name" = "xyz");
>>>>>
>>>>> FAILED: Error in metadata:
>>>>> MetaException(message:org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>>>> org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>>>> org.apache.zookeeper.KeeperException$ConnectionLossException:
>>>>> KeeperErrorCode = ConnectionLoss for /hbase
>>>>>     at
>>>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:985)
>>>>>     at
>>>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>>>>>     at
>>>>