Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # dev >> [DISCUSSION] Accumulo, another BigTable clone, has shown up on Apache Incubator as a proposal

Copy link to this message
Re: [DISCUSSION] Accumulo, another BigTable clone, has shown up on Apache Incubator as a proposal
Accepting Accumulo into the incubator would be a good encouragement for the
folks at NSA to work more with open source software and engage with the
communities and set a good example for future projects. That, in my mind,
seems to be the strongest reason for letting the project in. However, I
don't see how that helps HBase or ASF in the long run. It is true that it'll
take time and effort to combine the projects right now but that might be a
hit worth taking and having combined development efforts from here on as
compared to having two completely independent project and later on looking
at the merge. I don't see how a merge later on will be any easier than right
now. The decision obviously comes down to how much effort the developers on
both projects are willing to put into it right now or later on.

Having said that, I think the HBase community at large needs to get an
insight into Accumulo's implementation to gauge how different the two
projects are in terms of the implementation details and code. Trying to come
to a conclusion without doing that might not give us the best solution. I'm
excited about the fact that we have an alternate implementation but that's
just the engineer in me. The HBase user in me is worried about the confusion
an almost ditto alternate project will create.

Just my $0.02.


On Fri, Sep 9, 2011 at 1:50 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:

> > From: Duane Moore <[EMAIL PROTECTED]>
> > I will second what Todd and Joey
> > said and reiterate that contributing to open source is not easy for a
> > government contractor, and especially not easy for U.S. government
> > employees.
> This is true as a general statement I'm sure.
> However, my former life was as an engineer in a DARPA shop with a TS
> clearance. During that time I worked on both closed/classified systems and
> projects such as TrustedBSD (http://www.trustedbsd.org/). Choosing to
> develop an internal alternative rather than work with the HBase project was
> a decision of convenience by someone.
> While all appreciate this eventual open sourcing on some level, the outcome
> is hardly optimal, and does not favor in my opinion the existing open source
> community here (HBase) in the short term, and any long term favor is going
> to require work by that community.
> > My personal preference for a long while has been to migrate
> > our Accumulo implementation to HBase, but as with any project there are
> > often non-technical considerations for doing so.
> I can only hope that open source communities in general will apply a
> penalty for taking the easy way out for such non-technical considerations.
> We do not have to act as beggars. Presumably this open sourcing was not done
> out of charity -- I would be quite surprised, maybe shocked. If government
> (or contractors) want to leverage open source communities for some benefit,
> the least we can do is insist on respectful terms.
> Best regards,
>    - Andy
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
> ----- Original Message -----
> > From: Duane Moore <[EMAIL PROTECTED]>
> > Cc:
> > Sent: Tuesday, September 6, 2011 9:21 AM
> > Subject: Re: [DISCUSSION] Accumulo, another BigTable clone, has shown up
> on Apache Incubator as a proposal
> >
> > Hello all,
> >
> > I've been a lurker on the HBase list for a year or so and our company has
> > also been working with the Accumulo implementation during the same time
> > frame.  I'd like to respond to Stack's suggestion to focus on the
> > technical merits of the proposal.  Since I have some info on the pre-open
> > sourced version of Accumulo, I'd like to share some of our evaluation of
> > the software, primarily from a client perspective (vs. implementation
> > details like logging to NFS vs HDFS).
> >
> > First, I share many of the same concerns of folks who were frustrated
> that
> > this project seems to duplicate the effort of the open source