|
|
-
Executing queries after setting hive.exec.parallel in hive-site.xml
Chunky Gupta 2012-10-25, 11:14
Hi ,
I have 2 questions regarding the parameter 'hive.exec.parallel' in hive-site.xml in ~/.versions/hive-0.8.1/conf/
1. how do I verify from query log files or from any other way, that a particular query is executing with this parameter set to true. 2. Is it advisable to set this parameter for running queries.
Thanks, Chunky.
+
Chunky Gupta 2012-10-25, 11:14
-
Re: Executing queries after setting hive.exec.parallel in hive-site.xml
Nitin Pawar 2012-10-25, 11:24
this parameter is a query execution optimization approach. hive.exec.parallel if set to true, hive determines that if few stages of your mapreduce job can run independently and if yes then schedules them accordingly.
If you set this value in hive-site.xml and wants to see its set or not, then use "set -v" to see all variables and then grep it out
On Thu, Oct 25, 2012 at 4:44 PM, Chunky Gupta <[EMAIL PROTECTED]> wrote: > Hi , > > I have 2 questions regarding the parameter 'hive.exec.parallel' in > hive-site.xml in ~/.versions/hive-0.8.1/conf/ > > 1. how do I verify from query log files or from any other way, that a > particular query is executing with this parameter set to true. > 2. Is it advisable to set this parameter for running queries. > > Thanks, > Chunky.
-- Nitin Pawar
+
Nitin Pawar 2012-10-25, 11:24
-
Re: Executing queries after setting hive.exec.parallel in hive-site.xml
Bejoy KS 2012-10-25, 12:42
Hi Chunky
This parameter will come into effect only if a query has been parsed to multiple mapreduce jobs and some of them can be executed in parallel. ie all the jobs generated by the query are not linearly dependent and hence needn't be executed sequentially. In all other cases the MR jobs will be executed sequentially and this parameter won't have any effect.
Regards Bejoy KS
Sent from handheld, please excuse typos.
-----Original Message----- From: Chunky Gupta <[EMAIL PROTECTED]> Date: Thu, 25 Oct 2012 16:44:43 To: <[EMAIL PROTECTED]> Reply-To: [EMAIL PROTECTED] Subject: Executing queries after setting hive.exec.parallel in hive-site.xml
Hi ,
I have 2 questions regarding the parameter 'hive.exec.parallel' in hive-site.xml in ~/.versions/hive-0.8.1/conf/
1. how do I verify from query log files or from any other way, that a particular query is executing with this parameter set to true. 2. Is it advisable to set this parameter for running queries.
Thanks, Chunky.
+
Bejoy KS 2012-10-25, 12:42
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext