Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # dev >> how to clean all data in hbase table without truncate


Copy link to this message
-
Re: how to clean all data in hbase table without truncate
let me post my draft patch, and feel free to nuke it. but there's a lot of
boring stuff code that you can use (all the observer interfaces to add & co)

Matteo

On Tue, Aug 6, 2013 at 10:56 AM, liushaohui <[EMAIL PROTECTED]> wrote:

> Thanks, Jean-Marc.
>
> There is  truncate_preserve in HBASE-5525. But it drops the acls info.
>
> I will try to impl truncate_preserver_acl by add a new api in hmaster.
>
> HBASE-8332 discussed this problem, too. But no implement.
>
>
>
> On 08/05/2013 08:03 PM, Jean-Marc Spaggiari wrote:
>
>> truncate_preserve (from shell) will still do the disable, but it will not
>> drop the regions split. Can you try and see if it keep he ACLs too? If
>> not,
>> might be a good idea to do something like "truncate_preserve_acl" too...
>>
>> JM
>>
>> 2013/8/5 liushaohui <[EMAIL PROTECTED]>
>>
>>  hi all:
>>>
>>>      In our shared secure hbase cluster,  users often wants to clean all
>>> tested data in their tables.  Currently, hbase supports the
>>>
>>> truncate method , but its impl is based on disable table-> delete table
>>> ->
>>> create table.
>>>
>>> There are two drawbacks in this impl.
>>>
>>> 1, Region split info. Truncate creates a new table with just a region. It
>>> loses the region split info, which is not suitable for pre-split tables.
>>>
>>> 2, Table ACLs.  In the deletion of table, the tables' acls will be
>>> deleted
>>> too. So every truncate need to be operated by hbase admin.
>>>
>>>
>>> Is there any other effective method to clean all data of a table?
>>>
>>> What about implement a real truncate method in hmaster which keeps region
>>> split info and table acls?
>>>
>>> Thanks
>>>
>>>
>>> - liushaohui
>>>
>>>
>>>
>>>
>>>
>>>
>