Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - HBase Column Family TTL and cell deletions


+
Ashish Nigam 2013-04-03, 18:34
+
Ted Yu 2013-04-03, 18:48
+
Ashish Nigam 2013-04-03, 19:03
+
Ashish Nigam 2013-04-03, 22:19
+
lars hofhansl 2013-04-04, 03:07
+
Ian Varley 2013-04-03, 23:22
Copy link to this message
-
Re: HBase Column Family TTL and cell deletions
Andrew Purtell 2013-04-03, 23:56
TTL is in seconds.

When we put this in I couldn't envision any valid use case for sub-second
expiration.
On Wed, Apr 3, 2013 at 4:22 PM, Ian Varley <[EMAIL PROTECTED]> wrote:

> I don't know if it's right (haven't checked source just now) but according
> to this:
>
> http://hbase.apache.org/book/ttl.html
>
> Column family TTL is in seconds, not milliseconds. Could that be the
> problem?
>
> (If not, we should fix that page in the ref guide.)
>
> On Apr 3, 2013, at 5:19 PM, Ashish Nigam wrote:
>
> Any thoughts?
>
> Here's one cell that should have been deleted ( I am putting HBase get
> repines in shell)
>
> hbase(main):001:0> get 'service_counters','3141',{COLUMN =>
> 'stats-hourly:2013032014-C-U-4092276'}
> 13/04/03 21:57:17 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> COLUMN                                                            CELL
>
>
>
>
> stats-hourly:2013032014-C-U-4092276
> timestamp=1364928886015, value=\x00\x00\x00\x00\x00\x00\x00\x06
>
>
>
> 1 row(s) in 0.1040 seconds
>
>
> On Wed, Apr 3, 2013 at 12:03 PM, Ashish Nigam <[EMAIL PROTECTED]
> <mailto:[EMAIL PROTECTED]>>wrote:
>
> minVersion is set to 0
> Here's detailed info on this CF -
>
> {NAME => 'stats-hourly', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER =>
> 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'LZO',
> MIN_VERSIONS => '0', TTL => '604800', KEEP_DELETED_CELLS => 'false',
> BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true',
> BLOCKCACHE => 'true'}
>
> HBase version is 0.94.2-cdh4.2.0,
>
>
>
> On Wed, Apr 3, 2013 at 11:48 AM, Ted Yu <[EMAIL PROTECTED]<mailto:
> [EMAIL PROTECTED]>> wrote:
>
> Is it possible that minVersions was set for your column family ?
>
> What version of HBase are you using ?
>
> Thanks
>
>
> On Wed, Apr 3, 2013 at 11:34 AM, Ashish Nigam <[EMAIL PROTECTED]
> <mailto:[EMAIL PROTECTED]>
> wrote:
>
> Hi,
> I have a table "service_counters" that has service id as row id.
> There is a column family "stats-hourly" that stores counters related to
> that service per hour.
> I have set TTL to be 7 days for the column family.
>
> {NAME => 'service_counters', FAMILIES => [{NAME => 'stats-hourly',
> COMPRESSION => 'LZO', TTL => '604800'}]}
>
> Now the problem is that I still see columns that are more than 7 days
> old.
> I have also run major compactions but I still see old rows.
> Any pointers as to why these columns are not being deleted?
>
> Thanks
> Ashish
>
>
>
>
>
>
--
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
+
Ashish Nigam 2013-04-04, 00:53