Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # dev >> Can there be a doMiniBatchDelete in HRegion?


+
Anoop Sam John 2012-06-20, 09:49
+
yuzhihong@... 2012-06-20, 13:01
Copy link to this message
-
RE: Can there be a doMiniBatchDelete in HRegion?
Sure Ted. I will test and inform the result.

-Anoop-
________________________________________
From: [EMAIL PROTECTED] [[EMAIL PROTECTED]]
Sent: Wednesday, June 20, 2012 6:31 PM
To: [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Subject: Re: Can there be a doMiniBatchDelete in HRegion?

I think you can issue large number of deletes on the same region and observe whether the proposed new method gives us performance boost.

Thanks

On Jun 20, 2012, at 2:49 AM, Anoop Sam John <[EMAIL PROTECTED]> wrote:

> Hi Devs
>
>              There is a batch put support in the HRegion level. When the put(List<Put>) happens from client, Puts corresponding to one region might get grouped together and handled as a batch.[Depending on the availability of rowlocks..   code in HRegion#doMiniBatchPut] For this batch there will be single write and sync into the HLog file.
>
>
>
> A similar kind of delete operation, I am not able to see in HRegion. The HTable#delete(List<Delete>) groups the Deletes for the same RS and make one n/w call only. But within the RS, there will be N number of delete calls on the region one by one. This will include N number of HLog write and sync. If this also can be grouped can we get better performance for the multi row delete.  Is there any problem in doing this batch delete? I am not sure any JIRA is already present for this.
>
>
>
> Note : Hregion#mutateRowsWithLock().. we do batch operations of Puts and Deletes(also)
>
>
>
> -Anoop-
+
Anoop Sam John 2012-06-25, 13:50
+
Ted Yu 2012-06-25, 13:56
+
Ted Yu 2012-06-25, 16:11
+
Ted Yu 2012-06-27, 21:13