Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Show job progress when using JDBC to run HIVE query


Copy link to this message
-
RE: Show job progress when using JDBC to run HIVE query
The jdbc driver uses thrift so if thrift can't then jdbc can't.

This can be surprisingly difficult to do. Hive can split a query into x hadoop jobs and some will run in parallel and some will run in sequence.
I've used oracle in the past (10 and 11) and I could also never find out how long a large job would take, which leads me to suspect it's not a trivial thing to do.
-----Original Message-----
From: MiaoMiao [mailto:[EMAIL PROTECTED]]
Sent: Monday, September 17, 2012 6:17 AM
To: [EMAIL PROTECTED]
Subject: Re: Show job progress when using JDBC to run HIVE query
Not familiar with JDBC, but thrift seems can't.

On Sat, Sep 15, 2012 at 3:17 AM, Haijia Zhou <[EMAIL PROTECTED]> wrote:
> Hi, All
>  I have am writing a Hive client to run a Hive query using Hive JDBC driver.
>  Since the data amount is huge I really would like to see the progress
> when the query is running.
>  Is there anyway I can get the job progress?
> Thanks
> Haijia
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB