Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Get the job id for a hive query


Copy link to this message
-
Re: Get the job id for a hive query
select statement without where clause is just a hdfs cat command. It will
not run mapreduce for that.

On Tue, Mar 5, 2013 at 5:48 PM, Tim Bittersohl <[EMAIL PROTECTED]> wrote:

> Ok, it works.****
>
> For testing, I fired a create table command and a select without a where
> clause. Both don’t result in MapReduce jobs... with a where clause, there
> is a job created now.****
>
> ** **
>
> Thanks****
>
> ** **
>
> ** **
>
> *Von:* Nitin Pawar [mailto:[EMAIL PROTECTED]]
> *Gesendet:* Dienstag, 5. März 2013 12:48
>
> *An:* [EMAIL PROTECTED]
> *Betreff:* Re: Get the job id for a hive query****
>
> ** **
>
> if the job is submitted to hadoop, it will come up on jobtracker. ****
>
> Unless you are slow on tracking and your job history retaining is 0, each
> hive query submitted to jobtracker will be there on jobhistory ****
>
> ** **
>
> On Tue, Mar 5, 2013 at 4:58 PM, Tim Bittersohl <[EMAIL PROTECTED]> wrote:
> ****
>
> Hi,****
>
>  ****
>
> I do have the following problem monitoring my Hive queries in Hadoop.****
>
>  ****
>
> I create a Sever using the Hive library which connects to an Hadoop
> cluster (file system, job tracker and Hive metastore are set up on this
> cluster). The needed parameters for the Hive server I've set in the
> configuration.****
>
> Commands sent to this server are executed, that works.****
>
> The problem now is that the MapReduce jobs created by Hive don't appear in
> the job tracker's job list. The list itself works, showing me other
> commands I executed not using Hive. (I use the JobClient Java class to get
> the list)****
>
>  ****
>
> Why are the Hive query jobs not in the list? How can I track them in
> Hadoop?****
>
>  ****
>
>  ****
>
> Thanks****
>
>  ****
>
>  ****
>
> *Von:* Nitin Pawar [mailto:[EMAIL PROTECTED]]
> *Gesendet:* Donnerstag, 28. Februar 2013 16:13****
>
>
> *An:* [EMAIL PROTECTED]
> *Betreff:* Re: Get the job id for a hive query****
>
>  ****
>
> you can set this property mapred.job.name and this should set the name
> for the job ****
>
>  ****
>
> On Thu, Feb 28, 2013 at 8:26 PM, Tim Bittersohl <[EMAIL PROTECTED]>
> wrote:****
>
> Thanks for the response,****
>
>  ****
>
> I also found no way to access the job id via java thrift client, all I can
> get is a query ID by the query planner.****
>
>  ****
>
> How to set the name of a job where a Hive query is fired with, so I can
> find it in the job tracker later?****
>
>  ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
>  ****
>
> *Von:* Nitin Pawar [mailto:[EMAIL PROTECTED]]
> *Gesendet:* Donnerstag, 28. Februar 2013 15:46****
>
>
> *An:* [EMAIL PROTECTED]
> *Betreff:* Re: Get the job id for a hive query****
>
>  ****
>
> With thrift Client I don't think you can get the jobID from hadoop (I may
> very well be wrong in this)****
>
>  ****
>
> the other way around this was to have a separate name for each job you
> fire through hive and then directly query jobtracker for the same ****
>
>  ****
>
> On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <[EMAIL PROTECTED]>
> wrote:****
>
> I use java and there HiveClient of the hive library (Version 0.10.0).****
>
>  ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery

Nitin Pawar