Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - Re: Get the job id for a hive query


+
Nitin Pawar 2013-02-28, 14:46
+
Nitin Pawar 2013-02-28, 15:13
Copy link to this message
-
Re: Get the job id for a hive query
Navis류승우 2013-03-01, 07:29
https://issues.apache.org/jira/browse/HIVE-3235 could be what you are
searching for.

2013/3/1 Nitin Pawar <[EMAIL PROTECTED]>

> you can set this property mapred.job.name and this should set the name
> for the job
>
>
> On Thu, Feb 28, 2013 at 8:26 PM, Tim Bittersohl <[EMAIL PROTECTED]>wrote:
>
>> Thanks for the response,****
>>
>> ** **
>>
>> I also found no way to access the job id via java thrift client, all I
>> can get is a query ID by the query planner.****
>>
>> ** **
>>
>> How to set the name of a job where a Hive query is fired with, so I can
>> find it in the job tracker later?****
>>
>> ** **
>>
>> Tim Bittersohl ****
>>
>> Software Engineer ****
>>
>>
>> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>>
>> Innoplexia GmbH
>> Mannheimer Str. 175 ****
>>
>> 69123 Heidelberg
>>
>> Tel.: +49 (0) 6221 7198033
>> Fax: +49 (0) 6221 7198034
>> Web: www.innoplexia.com
>>
>> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
>> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
>> Strauch, Prof. Dr. Herbert Schuster ****
>>
>> ** **
>>
>> *Von:* Nitin Pawar [mailto:[EMAIL PROTECTED]]
>> *Gesendet:* Donnerstag, 28. Februar 2013 15:46
>>
>> *An:* [EMAIL PROTECTED]
>> *Betreff:* Re: Get the job id for a hive query****
>>
>> ** **
>>
>> With thrift Client I don't think you can get the jobID from hadoop (I may
>> very well be wrong in this)****
>>
>> ** **
>>
>> the other way around this was to have a separate name for each job you
>> fire through hive and then directly query jobtracker for the same ****
>>
>> ** **
>>
>> On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <[EMAIL PROTECTED]>
>> wrote:****
>>
>> I use java and there HiveClient of the hive library (Version 0.10.0).****
>>
>>  ****
>>
>> Tim Bittersohl ****
>>
>> Software Engineer ****
>>
>>
>> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>>
>> Innoplexia GmbH
>> Mannheimer Str. 175 ****
>>
>> 69123 Heidelberg
>>
>> Tel.: +49 (0) 6221 7198033
>> Fax: +49 (0) 6221 7198034
>> Web: www.innoplexia.com
>>
>> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
>> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
>> Strauch, Prof. Dr. Herbert Schuster ****
>>
>>  ****
>>
>> *Von:* Nitin Pawar [mailto:[EMAIL PROTECTED]]
>> *Gesendet:* Donnerstag, 28. Februar 2013 12:43
>> *An:* [EMAIL PROTECTED]****
>>
>>
>> *Betreff:* Re: Get the job id for a hive query****
>>
>>  ****
>>
>> how are you running your hive queries? using hive cli or hive jdbc
>> client? ****
>>
>>  ****
>>
>> if you are using hive cli then whenever you fire a query and assuming it
>> is syntactically correct and its not select * from table operation ****
>>
>> hive cli shows  the job ID and an URL which points to the job tracker url
>> for the job it submitted  ****
>>
>>  ****
>>
>> On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <[EMAIL PROTECTED]>
>> wrote:****
>>
>> I’m trying to get the job id of the job created with a Hive query.****
>>
>> At the moment I can get the cluster status from the HiveClient, but I
>> don’ find any job id in there... ****
>>
>>  ****
>>
>> Tim Bittersohl ****
>>
>> Software Engineer ****
>>
>>
>> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>>
>> Innoplexia GmbH
>> Mannheimer Str. 175 ****
>>
>> 69123 Heidelberg
>>
>> Tel.: +49 (0) 6221 7198033
>> Fax: +49 (0) 6221 7198034
>> Web: www.innoplexia.com
>>
>> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
>> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
>> Strauch, Prof. Dr. Herbert Schuster ****
>>
>>  ****
>>
>> *Von:* Harsh J [mailto:[EMAIL PROTECTED]]
>> *Gesendet:* Donnerstag, 28. Februar 2013 09:08
>> *An:* hive request
>> *Betreff:* Re: Get the job id for a hive query****
>>
>>  ****
>>
>> The client logs print the Job ID of the spawned job and a tracking URL.
>> Is that what you're looking for? Its printed for each stage.****
+
Tim Bittersohl 2013-02-27, 17:36
+
Harsh J 2013-02-28, 08:08
+
Todd Wilson 2013-02-27, 19:40
+
Nitin Pawar 2013-02-28, 11:42
+
Nitin Pawar 2013-03-05, 12:25
+
Nitin Pawar 2013-03-05, 11:47