Hello all at this mailing list,

I'm glad to finally announce an HBase addon that I have been working on.

HAcid is a client library that enables HBase applications to execute ACID transactions with Snapshot Isolation. It's purpose is similar to Google Percolator for Bigtable. The library is open-source under Apache 2 license.

http://staltz.blogspot.fi/2012/10/hacid-multi-row-transactions-in-hbase.html

It might still be rough around the edges, so please let me know about bugs and issues (e.g., in the bitbucket repo). And let me know if HAcid was somehow useful to you.

Thanks,
Andre Medeiros
http://about.me/andrestaltz

Interesting.
So how do you manage the transaction?  On the client or on the cluster?

On Oct 1, 2012, at 6:12 PM, de Souza Medeiros Andre <[EMAIL PROTECTED]> wrote:

> Hello all at this mailing list,
>
> I'm glad to finally announce an HBase addon that I have been working on.
>
> HAcid is a client library that enables HBase applications to execute ACID transactions with Snapshot Isolation. It's purpose is similar to Google Percolator for Bigtable. The library is open-source under Apache 2 license.
>
> http://staltz.blogspot.fi/2012/10/hacid-multi-row-transactions-in-hbase.html
>
> It might still be rough around the edges, so please let me know about bugs and issues (e.g., in the bitbucket repo). And let me know if HAcid was somehow useful to you.
>
> Thanks,
> Andre Medeiros
> http://about.me/andrestaltz

Like Percolator, all transaction management algorithms are on the client-side, while transactional metadata is stored as HBase tables.
________________________________________
From: Michael Segel [[EMAIL PROTECTED]]
Sent: Tuesday, October 02, 2012 02:16
To: [EMAIL PROTECTED]
Subject: Re: HAcid: multi-row transactions in HBase

Interesting.
So how do you manage the transaction?  On the client or on the cluster?

On Oct 1, 2012, at 6:12 PM, de Souza Medeiros Andre <[EMAIL PROTECTED]> wrote:

> Hello all at this mailing list,
>
> I'm glad to finally announce an HBase addon that I have been working on.
>
> HAcid is a client library that enables HBase applications to execute ACID transactions with Snapshot Isolation. It's purpose is similar to Google Percolator for Bigtable. The library is open-source under Apache 2 license.
>
> http://staltz.blogspot.fi/2012/10/hacid-multi-row-transactions-in-hbase.html
>
> It might still be rough around the edges, so please let me know about bugs and issues (e.g., in the bitbucket repo). And let me know if HAcid was somehow useful to you.
>
> Thanks,
> Andre Medeiros
> http://about.me/andrestaltz

Great to know about Acid enablement on Hbase!

Am curious about the kind of usecases this is targeted at, since Hbase, as
we all know, is not really suitable for applications requiring transactional
mult-record acid guarantees for the obvious reasons of latency and other
distributed system issues.

--
View this message in context: http://apache-hbase.679495.n3.nabble.com/HAcid-multi-row-transactions-in-HBase-tp4032466p4032471.html
Sent from the HBase User mailing list archive at Nabble.com.

Interesting stuff Andre.

I noticed you do not deal with scans. I suppose this is because it is hard to do scans touching many rows efficiently with client only code.
This can probably be handled with an HBase Filter on the Scan, which filters as much as it can based on the cache you maintain in the per-table column and then post filter the remaining rows at the client (by inspecting the global TimestampTable).

-- Lars

----- Original Message -----
From: de Souza Medeiros Andre <[EMAIL PROTECTED]>
To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Cc:
Sent: Monday, October 1, 2012 4:12 PM
Subject: HAcid: multi-row transactions in HBase

Hello all at this mailing list,

I'm glad to finally announce an HBase addon that I have been working on.

HAcid is a client library that enables HBase applications to execute ACID transactions with Snapshot Isolation. It's purpose is similar to Google Percolator for Bigtable. The library is open-source under Apache 2 license.

http://staltz.blogspot.fi/2012/10/hacid-multi-row-transactions-in-hbase.html

It might still be rough around the edges, so please let me know about bugs and issues (e.g., in the bitbucket repo). And let me know if HAcid was somehow useful to you.

Thanks,
Andre Medeiros
http://about.me/andrestaltz

Hi Andre,

Thank you for sharing your work.  Have you seen
http://search-hadoop.com/m/yOnkdZ1aGl and can you describe how HAcid
compares?

Thanks,
Otis
--
Search Analytics - http://sematext.com/search-analytics/index.html
Performance Monitoring - http://sematext.com/spm/index.html
On Mon, Oct 1, 2012 at 7:12 PM, de Souza Medeiros Andre
<[EMAIL PROTECTED]> wrote:
> Hello all at this mailing list,
>
> I'm glad to finally announce an HBase addon that I have been working on.
>
> HAcid is a client library that enables HBase applications to execute ACID transactions with Snapshot Isolation. It's purpose is similar to Google Percolator for Bigtable. The library is open-source under Apache 2 license.
>
> http://staltz.blogspot.fi/2012/10/hacid-multi-row-transactions-in-hbase.html
>
> It might still be rough around the edges, so please let me know about bugs and issues (e.g., in the bitbucket repo). And let me know if HAcid was somehow useful to you.
>
> Thanks,
> Andre Medeiros
> http://about.me/andrestaltz

He mentions Omid in his thesis :)

----- Original Message -----
From: Otis Gospodnetic <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Cc:
Sent: Monday, October 1, 2012 5:57 PM
Subject: Re: HAcid: multi-row transactions in HBase

Hi Andre,

Thank you for sharing your work.  Have you seen
http://search-hadoop.com/m/yOnkdZ1aGl and can you describe how HAcid
compares?

Thanks,
Otis
--
Search Analytics - http://sematext.com/search-analytics/index.html
Performance Monitoring - http://sematext.com/spm/index.html
On Mon, Oct 1, 2012 at 7:12 PM, de Souza Medeiros Andre
<[EMAIL PROTECTED]> wrote:
> Hello all at this mailing list,
>
> I'm glad to finally announce an HBase addon that I have been working on.
>
> HAcid is a client library that enables HBase applications to execute ACID transactions with Snapshot Isolation. It's purpose is similar to Google Percolator for Bigtable. The library is open-source under Apache 2 license.
>
> http://staltz.blogspot.fi/2012/10/hacid-multi-row-transactions-in-hbase.html
>
> It might still be rough around the edges, so please let me know about bugs and issues (e.g., in the bitbucket repo). And let me know if HAcid was somehow useful to you.
>
> Thanks,
> Andre Medeiros
> http://about.me/andrestaltz

Hi Lars,

That's an interesting observation, I haven't thought before about scans in HAcid. Your suggestion for a solution is really close to what I would do: implement HAcidScan as a HBase Scan that filters according to the cache column.

Thanks, I will add this feature to the to do list.

-- Andre Medeiros

________________________________________
From: lars hofhansl [[EMAIL PROTECTED]]
Sent: Tuesday, October 02, 2012 03:53
To: [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Subject: Re: HAcid: multi-row transactions in HBase

Interesting stuff Andre.

I noticed you do not deal with scans. I suppose this is because it is hard to do scans touching many rows efficiently with client only code.
This can probably be handled with an HBase Filter on the Scan, which filters as much as it can based on the cache you maintain in the per-table column and then post filter the remaining rows at the client (by inspecting the global TimestampTable).

-- Lars

----- Original Message -----
From: de Souza Medeiros Andre <[EMAIL PROTECTED]>
To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Cc:
Sent: Monday, October 1, 2012 4:12 PM
Subject: HAcid: multi-row transactions in HBase

Hello all at this mailing list,

I'm glad to finally announce an HBase addon that I have been working on.

HAcid is a client library that enables HBase applications to execute ACID transactions with Snapshot Isolation. It's purpose is similar to Google Percolator for Bigtable. The library is open-source under Apache 2 license.

http://staltz.blogspot.fi/2012/10/hacid-multi-row-transactions-in-hbase.html

It might still be rough around the edges, so please let me know about bugs and issues (e.g., in the bitbucket repo). And let me know if HAcid was somehow useful to you.

Thanks,
Andre Medeiros
http://about.me/andrestaltz