Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> hive 0.11 on MRv1 Vs. YARN

Austin Chungath 2013-08-20, 09:32
Alan Gates 2013-08-20, 15:55
Copy link to this message
Re: hive 0.11 on MRv1 Vs. YARN
That is such a loaded question. Technically most of the hive API is written
against hadoop 0.20.2. For example, hive does not use
org.apache.hadoop.mapreduce classes it uses org.apache.hadoop.mapred
classes. But the job launching and other optimizations in yarn could mean
something, but mostly it is a question of order of magnitude of things.
Hypothetical example, yarn being able to launch a job 1 second faster may
not matter much if the job runs 10 hours.
On Tue, Aug 20, 2013 at 11:55 AM, Alan Gates <[EMAIL PROTECTED]> wrote:

> Hive 0.11 does run faster on YARN than MR1, but that's due solely to YARN
> being faster than MR1.  Hive 0.11 doesn't take any advantage of YARN.  Lots
> of work is going on to change that so that future versions of Hive will
> take advantage of YARN (see all the work in the Tez branch for example).
> Alan.
> On Aug 20, 2013, at 2:32 AM, Austin Chungath wrote:
> > Hi,
> >
> > Is hive 0.11 faster on YARN?
> > What am I missing out if I am using hive 0.11 on MRv1 ?
> >
> > Thanks a lot :)
> >
> > - Austin
> --
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.