Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> no data in external table


+
alxsss@... 2012-10-04, 18:30
+
Ted Yu 2012-10-04, 18:32
Copy link to this message
-
Re: no data in external table
Hi,

In hive shell I did

create external table myextrenaltable (key string, metadata string, inlinks string, outlinks string) stored by 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'

 with serdeproperties ("hbase.columns.mapping" = ":key,mtdt:string,il:string,ol:string")

 tblproperties ("hbase.table.name" = "myextrenaltable");

In tasktracker log I do not see anything relevant to hbase. In jobdetails page I see a few successful jobs. in hive shell I see

Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201210031146_0016, Tracking URL = http://localhost:50030/jobdetails.jsp?jobid=job_201210031146_0016
Kill Command = /home/dev/hadoop-0.20.2/bin/../bin/hadoop job  -Dmapred.job.tracker=localhost:9001 -kill job_201210031146_0016
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
2012-10-04 13:19:06,581 Stage-1 map = 0%,  reduce = 0%
2012-10-04 13:19:12,629 Stage-1 map = 100%,  reduce = 0%
2012-10-04 13:19:15,657 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201210031146_0016
MapReduce Jobs Launched:
Job 0: Map: 1   HDFS Read: 0 HDFS Write: 0 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
OK
Time taken: 17.47 seconds

Thanks in advance.
Alex.

 

-----Original Message-----
From: Ted Yu <[EMAIL PROTECTED]>
To: user <[EMAIL PROTECTED]>
Sent: Thu, Oct 4, 2012 11:33 am
Subject: Re: no data in external table
Can you tell us how you created mapping for the existing table ?

In task log, do you see any connection attempt to HBase ?

Cheers
On Thu, Oct 4, 2012 at 11:30 AM,  <[EMAIL PROTECTED]> wrote:

Hello,

I use hive-0.9.0 with hadoop-0.20.2 and hbase -0.92.1. I have created external table, mapping it to an existing table in hbase. When I do "select * from myextrenaltable" it returns no results, although scan in hbase shows data, and I do not see any errors in jobtracker log.

Any ideas how to debug this issue.

Thanks.
Alex.

 
+
kulkarni.swarnim@...) 2012-10-04, 21:59
+
alxsss@... 2012-10-04, 22:10
+
kulkarni.swarnim@...) 2012-10-04, 22:15
+
alxsss@... 2012-10-05, 23:08
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB