Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # dev >> Re: 【region compaction check key-bound or not】


Copy link to this message
-
Re: 【region compaction check key-bound or not】
Thanks,Sergey.
These days, I want to move a table from one hbase cluster to another hbase
cluster, and there are the same table's schema.
So I want to move a region's storefile to another table's region
corresponding directory, and the key bound of regions are overlapped.
For example:
Cluster   |  Table | Region's key bound
cluster1  |  dat    |  [1ffff,2ffff]
cluster2  |  dat    |  [2bfff,31fff]

In my opinion , if region files in cluster2 are move into cluster1's
regions, and make compaction(Minor && Major) upon the first region, it will
prune the improper key in (2ffff,31fff].
However I found hbase compaction cannot support that.

Any idea would be thankful.
2013/7/11 Sergey Shelukhin <[EMAIL PROTECTED]>

> You should not have to manually take care of region bounds in normal
> circumstances (unless you are reading the file from coprocessor in some
> special way, or something like that). Please tell us if you are seeing any
> strange behavior :)
> See HalfStoreFileReader for the code that is used to read the referenced
> file and constrains the keys.
>
> On Wed, Jul 10, 2013 at 4:25 AM, Bing Jiang <[EMAIL PROTECTED]
> >wrote:
>
> > Hi,all
> >
> > If Region process splits, it will make a reference.After executing child
> > region makes a compaction that absorbs all the reference. And I have a
> > question that how to make differences when executes scanner.
> > As we know that Compaction uses the scanner as well, so whether to set
> the
> > startKey and endKey of child region's bound, in order to guarantee that
> the
> > storefile in child region will not contain outlier keys? I cannot find
> code
> > to prove it, BTW, we use 0.94.3.
> >
> > Thanks.
> >
> > --
> > Bing Jiang
> > weibo: http://weibo.com/jiangbinglover
> > BLOG: http://blog.sina.com.cn/jiangbinglover
> > National Research Center for Intelligent Computing Systems
> > Institute of Computing technology
> > Graduate University of Chinese Academy of Science
> >
>

--
Bing Jiang
Tel:(86)134-2619-1361
weibo: http://weibo.com/jiangbinglover
BLOG: http://blog.sina.com.cn/jiangbinglover
National Research Center for Intelligent Computing Systems
Institute of Computing technology
Graduate University of Chinese Academy of Science