-Re: hive hbase storage handler fail
Sanjay Subramanian 2013-03-27, 22:18
If you can run your hive insert data script with debug option u may get
/usr/lib/hive/bin/hive -hiveconf hive.root.logger=INFO,console -e "insert
into dest select * from some_table_same_structure_as_dest limit 10;"
I created a small demo usecase and this is failing for me as well
The error I get is
Unable to retrieve URL for Hadoop Task logs. port out of range:999999
13/03/27 14:02:32 ERROR exec.Task: Unable to retrieve URL for Hadoop Task
logs. port out of range:999999
I am using ClouderaManager 4.1.2 Hadoop, Yarn, HDFS, Oozie, Hive and Hue
On 3/27/13 1:25 PM, "Jason Shih" <[EMAIL PROTECTED]> wrote:
>I try inserting data into hive table storing by hbase storage handler but
>fail with the following exception end of mapreduce stage info.
>however, we didn't have problem accessing HbaseStorageHandler if force
>accessing YARN rather than mapreduce. (hive: 0.9.0, hbase: 0.92.1).
>could expert shed some light how we tweak the settings if would like to
>initiate the mapper tasks to insert data leveraging HBaseStorageHandler.
>hereafter simple hive script tried before:
>CREATE TABLE dest(num string, name string)
>STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name")
>TBLPROPERTIES ("hbase.table.name" = "dest");
>and the exception:
>2013-03-28 03:49:41,107 Stage-0 map = 0%, reduce = 0%, Cumulative CPU
>2013-03-28 03:49:42,125 Stage-0 map = 0%, reduce = 0%, Cumulative CPU
>2013-03-28 03:49:43,143 Stage-0 map = 0%, reduce = 0%, Cumulative CPU
>2013-03-28 03:49:44,153 Stage-0 map = 0%, reduce = 0%
>2013-03-28 03:49:47,184 Stage-0 map = 100%, reduce = 100%
>MapReduce Total cumulative CPU time: 670 msec
>Ended Job = job_201303251402_0005 with errors
>Error during job, obtaining debugging information...
>Examining task ID: task_201303251402_0005_m_000002 (and more) from job
>Exception in thread "Thread-35" java.lang.NullPointerException
> at java.lang.Thread.run(Thread.java:662)
> No encryption was performed by peer.
>FAILED: Execution Error, return code 2 from
>MapReduce Jobs Launched:
>Job 0: Map: 1 Cumulative CPU: 0.67 sec HDFS Read: 0 HDFS Write: 0 FAIL
=====================This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.