-Re: hive query is very slow,why?
Nitin Pawar 2013-07-19, 09:07
Huang, the number of records are huge and we do not know what your table
definition is or what your cluster capacity is?
there are multiple reasons that query is slow
Can you share all the details on
1) Whats your table definition?
2) Whats the cluster capacity?
3) when you launched query did the cluster have enough capacity to start
your job ?
4) how many mappers were launched and how many are getting executed in
others may ask other questions as well
On Fri, Jul 19, 2013 at 7:38 AM, ch huang <[EMAIL PROTECTED]> wrote:
> the table records are more than 120000000
> On Fri, Jul 19, 2013 at 9:34 AM, Stephen Boesch <[EMAIL PROTECTED]> wrote:
>> one mapper. how big is the table?
>> 2013/7/18 ch huang <[EMAIL PROTECTED]>
>>> i wait long time,no result ,why hive is so slow?
>>> hive> select cookie,url,ip,source,vsid,token,residence,edate from
>>> hb_cookie_history where edate>='1371398400500' and edate<='1371400200500';
>>> Total MapReduce jobs = 1
>>> Launching Job 1 out of 1
>>> Number of reduce tasks is set to 0 since there's no reduce operator
>>> Starting Job = job_1374138311742_0007, Tracking URL >>> http://CH22:8088/proxy/application_1374138311742_0007/<http://ch22:8088/proxy/application_1374138311742_0007/>
>>> Kill Command = /usr/lib/hadoop/bin/hadoop job -kill