Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - Limited cross row transactions


+
lars hofhansl 2012-01-17, 21:27
+
Lars George 2012-01-17, 21:31
+
Mikael Sitruk 2012-01-17, 21:49
+
Jesse Yates 2012-01-17, 21:33
+
Ted Yu 2012-01-17, 21:36
Copy link to this message
-
Re: Limited cross row transactions
Lars George 2012-01-17, 21:41
Hi Ted,

Wouldn't Omid (https://github.com/yahoo/omid) help there? Or is that too broad? Just curious.

Lars

On Jan 17, 2012, at 4:36 PM, Ted Yu wrote:

> Can we collect use case for 'limited cross row transactions' first ?
>
> I have been thinking about (unlimited) multi-row transaction support in
> HBase. It may not be a one-man task. But we should definitely implement it
> someday.
>
> Cheers
>
> On Tue, Jan 17, 2012 at 1:27 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>
>> I just committed HBASE-5203 (together with HBASE-3584 this implements
>> atomic row operations).
>> Although a relatively small patch it lays the groundwork for heterogeneous
>> operations in a single WALEdit.
>>
>> The interesting part is that even though the code enforced the atomic
>> operation to be a for single row, this is not required.
>> It is enough if all involved KVs reside in the same region.
>>
>> I am not saying that we should add any high level concept to HBase (such
>> as the EntityGroups of Megastore).
>>
>> But, with a slight addition to the API (allowing a grouping of multiple
>> row operations) client applications have all the building blocks to do
>> limited cross row atomic operations.
>> The client application would be responsible for either correctly
>> pre-splitting the table, or a custom balancer has to be provided.
>>
>> The operation would fail if the regionserver determines that it would need
>> data from multiple region servers.
>>
>> I think this needs at least minimal support from HBase and cannot
>> (efficiently or without adding more moving parts) by a client API only.
>>
>>
>> Comments? Is this worth pursuing? If so, I'll file a jira and provide a
>> patch.
>>
>> Thanks.
>>
>>
>> -- Lars
>>
>>

+
Ted Yu 2012-01-17, 21:49
+
Ted Yu 2012-01-17, 21:52
+
Mikael Sitruk 2012-01-17, 22:13
+
Ted Yu 2012-01-17, 22:22
+
Mikael Sitruk 2012-01-17, 23:07
+
lars hofhansl 2012-01-18, 00:48
+
Ted Yu 2012-01-18, 00:57
+
Matt Corgan 2012-01-18, 01:15
+
lars hofhansl 2012-01-18, 05:17
+
lars hofhansl 2012-01-18, 01:52
+
lars hofhansl 2012-01-18, 05:45
+
Mikael Sitruk 2012-01-18, 08:01
+
lars hofhansl 2012-01-19, 01:02
+
Ted Yu 2012-01-19, 02:51
+
lars hofhansl 2012-01-19, 03:03
+
Todd Lipcon 2012-01-19, 03:22
+
lars hofhansl 2012-01-19, 05:17
+
Ted Yu 2012-01-19, 03:28
+
lars hofhansl 2012-02-11, 22:34
+
Jesse Yates 2012-01-17, 22:13
+
lars hofhansl 2012-01-17, 22:55
+
lars hofhansl 2012-01-17, 22:54
+
Stack 2012-01-17, 22:23
+
lars hofhansl 2012-01-17, 22:59
+
Lars H 2012-01-18, 01:09