-Re: HBase without compactions?
Andrew Purtell 2013-02-19, 07:12
MapR had a distributed key value store internal to the FS for its
metadata. Eventually they got the idea to put an API on it that mimics the
HBase client API. This is not "removing compactions". I can't say for sure
but feel pretty comfortable stating its an alternate architecture to
BigTable, there was never a need for compactions in the first place but
instead some other tradeoffs. Apples and oranges.
On Monday, February 18, 2013, Michael Segel wrote:
> M7 is supposed to be in open public beta, I think.
> I haven't had time to play with it, but MapR has a lot of nice features
> that can't really be done in HDFS.
> Its basically the benefits of being almost POSIX compliant.
> The reason I mention M7 is that they supposedly get rid of compactions,
> however I havent seen it in action.
> In theory I can see this happening because you have a rw filesystem so why
> would would you need to have a write only file and then compaction where
> the write only files merge?
> I would imagine with some thought and time, HDFS could evolve to this ...
> Its an interesting evolution on MapR's part and you have to give those
> guys credit for doing something cool.
> > On Mon, Feb 18, 2013 at 7:30 PM, Otis Gospodnetic <
> >> Have there been any discussions,attempts, or thoughts about finding a
> >> to avoid compactions?
> > Any ideas on how it would work Otis?
> > Anyone know what m7 does?
> > St.Ack
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)