Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> Update on hadoop-0.23


Copy link to this message
-
Re: Update on hadoop-0.23
BTW, Roman I have a recollection of Hadoop performance suite for iTest (aka
BigTop now) which I have put together during the initial development phase of
the framework.

I don't see in BigTop's source tree - has this work ever been committed to
open source along with the iTest? This way if any benchmarking tests for 0.22
(or 0.20.2xx) are getting open we can put them to the same container
conditional on letting them see the light of day by their current copyright
holder.

With regards,
  Cos

Disclaimer: apologies for seemingly off-topic discussion, but this is about
Hadoop performance testing, so bring up BigTop in this frame of reference
looks completely justifiable.

On Fri, Sep 30, 2011 at 11:44AM, Roman Shaposhnik wrote:
> Hi Arun!
>
> On Fri, Sep 30, 2011 at 10:54 AM, Arun C Murthy <[EMAIL PROTECTED]> wrote:
> > I'm all for people working on what they are passionate about, so this isn't to say one shouldn't spend time on 0.22.
> >
> > But, for clarity's sake, as I've done multiple times on both the list and in person to Konstantin etc.,
> > I'll point out (again) that 0.22 will need multiple man-years of development to achieve parity with
> > 0.20.2xx just in terms of bug-fixes and performance.
>
> I apologize if my level of institutional knowledge of these things is
> lacking, but do you have any
> benchmarking results between 0.22 and 0.20.2xx? The reason I'm asking
> is twofold -- I really
> would like to see an objective numbers qualifying the viability of
> 0.22 from the performance stand point,
> but more importantly I would really like to include the benchmarking
> code into Bigtop.
>
> In terms of bugs -- same question. Is there any publicly available
> list of, at least, the critical
> ones that make 0.22 not viable from your point of view?
>
> Thanks,
> Roman.