Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Hive-Hbase integration require Hbase in Pseudo distributed??


Copy link to this message
-
Re: Hive-Hbase integration require Hbase in Pseudo distributed??
hi,

yeah i've used

$HIVE_HOME/bin/hive --auxpath
$HIVE_HOME/lib/hive-hbase-handler-*.jar,$HIVE_HOME/lib/hbase-*.jar,$HIVE_HOME/lib/zookeeper-*.jar
-hiveconf hbase.master=localhost:60000
------------------------------------------------
Hadoop version : hadoop-0.20.203.0
Hbase version : hbase-0.90.4
Hive version : hive-0.9.0 (built from trunk)
on
Ubuntu 11.10
-----------------------------------------------

Regards,

Alok

On Fri, Dec 2, 2011 at 5:49 PM, Ankit Jain <[EMAIL PROTECTED]> wrote:

> Hi,
>
> have you used following command to start the hive shell.
>
> $HIVE_HOME/bin/hive --auxpath $HIVE_HOME/lib/hive-hbase-handler-*.jar,$HIVE_HOME/lib/hbase-*.jar,$HIVE_HOME/lib/zookeeper-*.jar -hiveconf hbase.master=127.0.0.1:60000
>
> If no then used above command.
> Regards,
> Ankit
>
>
> On Fri, Dec 2, 2011 at 5:34 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> // Hadoop core-site.xml
>> <configuration>
>>     <property>
>>         <name>fs.default.name</name>
>>         <value>hdfs://localhost:9000</value>
>>     </property>
>>     <property>
>>         <name>hadoop.tmp.dir</name>
>>         <value>/home/alokkumar/hadoop/tmp</value>
>>     </property>
>>  </configuration>
>>
>> // hbase-site.xml
>> <configuration>
>>     <property>
>>             <name>hbase.rootdir</name>
>>        <!--    <value>hdfs://localhost:9000/hbase</value>-->
>>         <value>file:///home/alokkumar/hbase/</value>
>>     </property>
>> </configuration>
>>
>> with these conf Hbase/Hive are runnning independently file..
>> hbase(main):003:0> status
>> 1 servers, 0 dead, 4.0000 average load
>>
>> but i'm stil getting $hive> CREATE TABLE hbase_table_1(key int, value
>> string)
>>     > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>>     > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val");
>> FAILED: Error in metadata:
>> MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
>> localhost:45966
>>
>>     at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:394)
>>     at
>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:83)
>>
>> Regards,
>> Alok
>>
>>
>> On Fri, Dec 2, 2011 at 5:14 PM, Ankit Jain <[EMAIL PROTECTED]>wrote:
>>
>>> HI,
>>>
>>> Can you post the Hbase-site.xml and hadoop core-site.xml properties here.
>>>
>>> Regards,
>>> Ankit
>>>
>>>
>>> On Fri, Dec 2, 2011 at 3:30 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
>>>
>>>> Hi Ankit,
>>>>
>>>> you were right, my Hbase shell/HMaster was not running though it was
>>>> coming in jps :)
>>>>
>>>> nw i've run my HMaster n Hbase shell is up.. n getting this error--
>>>> Do I need zookeeper configured in standalone mode?
>>>>
>>>> hive> CREATE TABLE hbase_table_1(key int, value string)
>>>>     > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>>>>     > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
>>>>     > TBLPROPERTIES ("hbase.table.name" = "xyz");
>>>>
>>>> FAILED: Error in metadata:
>>>> MetaException(message:org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>>> org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>>> org.apache.zookeeper.KeeperException$ConnectionLossException:
>>>> KeeperErrorCode = ConnectionLoss for /hbase
>>>>     at
>>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:985)
>>>>     at
>>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>>>>     at
>>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
>>>>     at
>>>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
>>>>     at
>>>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:79)
>>>>
>>>>     at
>>>> org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:74)
Alok Kumar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB