Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> mrv1 vs YARN


Copy link to this message
-
Re: mrv1 vs YARN
Like with most major releases of Hadoop the releases are API compatible,
but not necessarily binary compatible.  That means a job for 1.0 can be
recompiled against 2.0 and it should compile and run similarly to 1.0.  If
it does not feel free to file a JAIR on the incompatibility.  There have
been a few and we have worked to make them backwards compatible.  As far a
binary compatibility is concerned. For the most part you should be able to
run your jobs without recompiling.  There are some people trying to make
it as binary compatible as possible, but it is not a guarantee.

I would expect to have a non-alpha semi-stable release of 2.0 by late June
or early July.  I am not an expert on this and there are lots of things
that could show up and cause those dates to slip.

--Bobby

On 4/21/13 6:45 PM, "Shekhar Gupta" <[EMAIL PROTECTED]> wrote:

>I am sorry Amir. I don't have answers for these questions. Because I don't
>use Hadoop for any real production jobs.
>Mainly I play with the Scheduler and ResourceManager of YARN as part of my
>thesis. So I just run some simple jobs to test the performance of the
>scheduler.
>
>
>On Sun, Apr 21, 2013 at 4:18 PM, Amir Sanjar <[EMAIL PROTECTED]> wrote:
>
>> thanks Shekhar, do you know when we will have an stable release for
>>hadoop
>> 2.0 (not alpha)?
>> Also from you experience, what component of hadoop 2.0.3 are most
>>unstable
>> and are more likely need more attention?
>>
>> Best Regards
>> Amir Sanjar
>>
>> System Management Architect
>> PowerLinux Open Source Hadoop development lead
>> IBM Senior Software Engineer
>> Phone# 512-286-8393
>> Fax#      512-838-8858
>>
>>
>>
>> [image: Inactive hide details for Shekhar Gupta ---04/21/2013 06:06:33
>> PM---As par my experience the MapReduce API is same for both YAR]Shekhar
>> Gupta ---04/21/2013 06:06:33 PM---As par my experience the MapReduce
>>API is
>> same for both YARN and MRv2. Applications compiled again Y
>>
>> From: Shekhar Gupta <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED],
>> Date: 04/21/2013 06:06 PM
>> Subject: Re: mrv1 vs YARN
>> ------------------------------
>>
>>
>>
>> As par my experience the MapReduce API is same for both YARN and MRv2.
>> Applications compiled again YARN should run smoothly on MRv1. Ans the
>>vice
>> versa is also true.
>> And in general YARN is pretty stable now.
>>
>> Regards,
>> Shekhar
>>
>>
>>
>> On Sun, Apr 21, 2013 at 3:45 PM, Amir Sanjar <[EMAIL PROTECTED]>
>>wrote:
>>
>> > Would an application compiled against YARN/MRv2 run transparently on
>> MRv1?
>> > Are there any API differences ?
>> > How stable is YARN/MRV2?
>> >
>> > Best Regards
>> > Amir Sanjar
>> >
>> > System Management Architect
>> > PowerLinux Open Source Hadoop development lead
>> > IBM Senior Software Engineer
>> > Phone# 512-286-8393
>> > Fax#      512-838-8858
>> >
>>
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB