-Performing intra row scans
kiran 2013-09-03, 10:28
We have a row where there are a million entries inserted as columns per
day. The qualifier structure "prefix-reversetimestamp".
I am performing a day wise slice of the columns using Columnrangefilter.
When I tried to fetch columns that span within 3 days from the current
time. There was no problem at all.
When, I tried to increase the number of days to morethan 3, then my entire
cluster stops accepting new requests.
Is it the case of region hot swapping due to my schema design?
Is it a good to have million columns under a single row and growing each
It is a production cluster, so I can't afford this outage.
Please suggest me the workaround to handle this.
Hbase version: 0.94.1
My sample code:
Scan scan = new Scan(rowBytes, rowBytes);
byte startPrefix = prefix + "-" + (Long.Max_value -
byte endPrefix = prefix + "-" + (Long.Max_value -
(currenttimeroundedtoday - 7 days));
ColumnRangeFilger crf = new ColumnRangeFilter(startPrefix, true, endPrefix,
-----Even a correct decision is wrong when it is taken late