-Ageoff filter not running on old tablets [SEC=UNOFFICIAL]
Dickson, Matt MR 2013-11-06, 22:07
We have data ingested in a date partitioned table, ie splits are created for each day in the form yyyymmdd-nnn where n is a random number appended to ensure the data is spread across the cluster. On the table we have added an ageoff filter with scan, minc and majc scopes and we load the table using bulk ingest. Because older splits have no new data going into them it appears no major compactions occur so the ageoff filter is not removing old data. I suspect the way to force a majc is to merge old tablets is this correct?
Thanks in advance,