Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> HBASE and HIVE Integration


Copy link to this message
-
Re: HBASE and HIVE Integration
Can you also post logs from "/tmp/<USER>/hive.log". That might contain some
info on your job failure.

On Wed, Jul 25, 2012 at 8:28 AM, vijay shinde <[EMAIL PROTECTED]>wrote:

> Hi Bejoy,
>
> Thanks for quick reply. Here are some additional details
>
> Cloudera Version - CDH3U4
>
> *hive-site.xml*
> **
> *<property>
> <name>hive.aux.jars.path</name>
>
> <value>file:///usr/lib/hive/lib/hive-hbase-handler-0.7.1-cdh3u2.jar,file:///usr/lib/hive/lib/hbase-0.90.4-cdh3u2.jar,file:///usr/lib/hive/lib/zookeeper-3.3.1.jar,file:///usr/lib/hive/lib/hive-contrib-0.7.1-cdh3u2.jar</value>
> </property>
> *
> *Execution Log*
>
>
> 1. *start zookeeper*
>
> [root@localhost zookeeper]# ./bin/zkServer.sh start
>
>
>
> 2. *start hbase*
>
>
>
> 3. *start hive. I am setting hive jars in hive-site.xml*
>
>
>
> ./bin/hive -hiveconf hbase.master=127.0.1.1:60010
>
>
> 4. *Create new HBase table which is to be managed by Hive*
> **
>
> CREATE TABLE hive_hbasetable_k(key int, value string)
>
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>
> WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
>
> TBLPROPERTIES ("hbase.table.name" = "hivehbasek");
>
>
>
> 5. *Create a logical table pokes in Hive*
>
> CREATE TABLE pokes (foo INT, bar STRING);
>
> 6. *HIve error while inserting the data from Hive Poke table to HBASE
> table*
>
> *hive> INSERT OVERWRITE TABLE hive_hbasetable_k SELECT * FROM pokes WHERE
> foo=98;*
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> Starting Job = job_201207250246_0005, Tracking URL > http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201207250246_0005
> Kill Command = /usr/lib/hadoop-0.20/bin/hadoop job  -Dmapred.job.tracker> 0.0.0.0:8021 -kill job_201207250246_0005
> 2012-07-25 04:26:00,198 Stage-0 map = 0%,  reduce = 0%
> 2012-07-25 04:27:00,767 Stage-0 map = 0%,  reduce = 0%
> 2012-07-25 04:27:08,844 Stage-0 map = 100%,  reduce = 100%
> Ended Job = job_201207250246_0005 with errors
>
> *FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.MapRedTask
> *
> Let me know if you need any additonal information.
>
> Thanks,
> Vijay
>
> On Wed, Jul 25, 2012 at 5:30 AM, Bejoy KS <[EMAIL PROTECTED]> wrote:
>
>> **
>> Hi Vijay
>>
>> Can you share more details like
>>
>> The CDH Version/Hive version you are using
>>
>> Steps you followed for hive hbase integration with the values you set
>>
>> The DDL used for hive hbase integration
>>
>> The actual error from failed map reduce task
>>
>> Regards
>> Bejoy KS
>>
>> Sent from handheld, please excuse typos.
>> ------------------------------
>> *From: *vijay shinde <[EMAIL PROTECTED]>
>> *Date: *Wed, 25 Jul 2012 04:45:41 -0400
>> *To: *<[EMAIL PROTECTED]>
>> *ReplyTo: *[EMAIL PROTECTED]
>> *Subject: *HBASE and HIVE Integration
>>
>> I am facing issue while executing HIVE queries on HBASE-HIVE integration.
>> I followed the wiki hbase-hive integration
>> https://cwiki.apache.org/Hive/hbaseintegration.html
>>
>> I have already passed all the required jars for auxpath in hive-site.xml
>> file.
>> I am using Cloudera CDH demo VM.. Any help would be highly appreciated
>>
>> hive> INSERT OVERWRITE TABLE hive_hbasetable_k SELECT * FROM pokes WHERE
>> foo=98;
>> Total MapReduce jobs = 1
>> Launching Job 1 out of 1
>> Number of reduce tasks is set to 0 since there's no reduce operator
>> Starting Job = job_201207250246_0005, Tracking URL >> http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201207250246_0005
>> Kill Command = /usr/lib/hadoop-0.20/bin/hadoop job  -Dmapred.job.tracker>> 0.0.0.0:8021 -kill job_201207250246_0005
>> 2012-07-25 04:26:00,198 Stage-0 map = 0%,  reduce = 0%
>> 2012-07-25 04:27:00,767 Stage-0 map = 0%,  reduce = 0%
>> 2012-07-25 04:27:08,844 Stage-0 map = 100%,  reduce = 100%
>> Ended Job = job_201207250246_0005 with errors
>> FAILED: Execution Error, return code 2 from
>> org.apache.hadoop.hive.ql.exec.MapRedTask
>> hive>
>>
>>
>
--
Swarnim