Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> How to terminate a running HIve Query? (Executed with JDBC, Hive Server 2)


Copy link to this message
-
Re: How to terminate a running HIve Query? (Executed with JDBC, Hive Server 2)
all it is is a comment on the line above the first statement - and that'll
show up in the jobtracker.  Just as he shows in his example.
On Tue, Jun 25, 2013 at 11:05 AM, Robin Verlangen <[EMAIL PROTECTED]> wrote:

> Hi Christian,
>
> Sounds like a work around, but how do you prefix the job with a certain
> name? Is that possible with a hive query statement?
>
> Best regards,
>
> Robin Verlangen
> *Data Architect*
> *
> *
> W http://www.robinverlangen.nl
> E [EMAIL PROTECTED]
>
> <http://goo.gl/Lt7BC>
> *What is CloudPelican? <http://goo.gl/HkB3D>*
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
>
> On Tue, Jun 25, 2013 at 7:49 PM, Christian Schneider <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Stephen, thanks for the anser.
>>
>> Identifying to the JobId is not that easy. I also tought about this.
>> Our application adds now a unique prefix to all queries. With this we can
>> identify the job.
>>
>> Smht. like this:
>>
>> -- UUID: 3242-414-124-14...
>> SELECT * FROM foobar;
>>
>> Now, our application can filter by Job Names starting with: -- UUID:
>> 3242-414-124-14... to kill the query.
>> But i think this is more a workaround then a reliable, or?
>>
>> Best Regards,
>> Christian.
>>
>>
>> 2013/6/25 Stephen Sprague <[EMAIL PROTECTED]>
>>
>>> Well... if the query created a MR job on your cluster then there's
>>> always:
>>>
>>> 1. use jobtracker to find your job id.
>>> 2. use hadoop job -kill <job_id>  to nuke it.
>>>
>>> you're saying there's no way to interrupt/kill the query from the
>>> client?  That very well may be the case.
>>>
>>>
>>> On Tue, Jun 25, 2013 at 10:22 AM, Christian Schneider <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> I figured out that there are two implementations of the Hive JDBC
>>>> driver in the hive-jdbc-0.10-cdh4.2.0 jar.
>>>>
>>>> 1. org.apache.hadoop.hive.jdbc.HiveStatement
>>>> 2. org.apache.hive.jdbc.HiveStatement
>>>>
>>>> The 1. implements .close() and .cancel() but it will not delete the
>>>> running jobs on the cluster anyway.
>>>>
>>>> Any suggestions?
>>>>
>>>>
>>>> 2013/6/25 Christian Schneider <[EMAIL PROTECTED]>
>>>>
>>>>> Hi,
>>>>> is it possible to kill a running query (including all the hadoop jobs
>>>>> behind)?
>>>>>
>>>>> I think it's not, because the Hive JDBC Driver doesn't implement
>>>>> .close() and .cancel() on the (prepared) statement.
>>>>>
>>>>> This attached code shows the problem.
>>>>>
>>>>> Bevor the statement gets executed, it will spawn a Thread that tries
>>>>> to stop the execution of the query after 10 sec.
>>>>>
>>>>> Are there any other ways to stop the job on the cluster?
>>>>>
>>>>> I could do it over the Job Client, but for that i need the JobId.
>>>>>
>>>>> Thanks a lot.
>>>>>
>>>>>
>>>>> Best Regards,
>>>>>
>>>>> Christian.
>>>>>
>>>>
>>>>
>>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB