Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: prefix salt key hotspot.   Results from 1 to 10 from 25 (0.908s).
Did you mean:
SpellChecker(?): prefix sat key hotspot 
Relaxer(?): salt key hotspot  prefix key hotspot  prefix salt key 
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Prefix salting pattern - HBase - [mail # user]
...You may be missing the point. The primary reason for the salt prefix pattern is to avoid hotspotting when inserting time series data AND at the same time provide a way to perform range...
... scans. http://blog.sematext.com/2012/04/09/hbasewd-avoid-regionserver-hotspotting-despite-writing-records-with-sequential-keys/ The data being inserted will be a constant stream of time...
[+ show more]
   Author: Software Dev, 2014-05-18, 16:40
Re: Adding a new region server or splitting an old region in a Hash-partitioned HBase Data Store - HBase - [mail # user]
...://blog.sematext.com/2012/04/09/hbasewd-avoid-regionserver-hotspotting-despite-writing-records-with-sequential-keys/  And some older discussions by experts on this topic: http://search-hadoop.com/?q=prefix+salt+key+hotspot...
   Author: Shahab Yunus, 2013-06-27, 15:11
Re: Rowkey hashing to avoid hotspotting - HBase - [mail # user]
... hot data (like in example above: with keys prefixed with model, the whole several regions containing data of same model may have data that is frequently accessed). In this case HBase...
...You might be right, when reading load concentrated on single/several RS they will not act as dead as when it is hotspotting during writing. I think I referred more to "uneven read load...
[+ show more]
   Author: Alex Baranau, 2012-07-17, 18:49
RES: Rowkey hashing to avoid hotspotting - HBase - [mail # user]
... r anymore. 2 - Salting, by prefixing your current rowkey with a pinch of hash. Notice  that the hash portion must be your rowkey prefix to ensure a kind of balanc ed distribution over...
...Hi Anand,  As usual, the answer is that 'it depends'  :)  I think that the main question here is: why are you afraid that this setup  would lead to region server hotspotting? Is because you...
[+ show more]
   Author: Cristofer Weber, 2012-07-16, 19:00
Re: HBase Region/Table Hotspotting - HBase - [mail # user]
... of the key (but then you loose the ability to do range scan across keys).  If you still need to scan rows according to their sort order you can "salt" (as some call it) the key by prefix...
...The most common cause for hotspotting is inserting rows with monotonically increasing row keys. In that case only the last region will get the writes and no amount of splitting will fix...
[+ show more]
   Author: lars hofhansl, 2013-02-11, 05:14
Timestamp as a key good practice? - HBase - [mail # user]
....  With this schema, I can find the files by ID very quickly and I can find the files which need to be updated pretty quickly too. But it's hotspotting one region.  1) Hotspotting. 2) Salting. 3) Key field...
... until the timestamp reach a certain value and move to the next region (hotspotting).  I have a table with a uniq key, a file path and a "last update" field. I can easily find back the file...
[+ show more]
   Author: Jean-Marc Spaggiari, 2012-06-13, 16:16
Consider individual RSs performance when writing records with random keys? - HBase - [mail # user]
.../timeseries data. If simplified, the idea is to add random prefix to the row key so that writes end up on different region servers (avoiding single RS hotspot).  2. When writing data to HBase with salted...
...Hi,  1. Not sure if you've seen HBaseWD (https://github.com/sematext/HBaseWD) project. It implements the "salt keys with prefix" approach when writing monotonically increasing row key...
[+ show more]
   Author: Alex Baranau, 2012-05-17, 14:23
Re: Is there a problem with having 4000 tables in a cluster? - HBase - [mail # user]
...So you should salt the keys in the reduce phase but u donot salt the keys in HBase. That basically means that reducers do not see the keys in sorted order but they do see all the values...
... for a specific key together.  So the Hash essentially is a trick that stays within the mapreduce does not make it into HBase. This prevents you from hotspotting a region and since the Hash is not being...
[+ show more]
   Author: Varun Sharma, 2013-09-24, 23:22
RE: Region hot spotting - HBase - [mail # user]
... is pretty much useful.  But still there too it says if you dont pre split you need to wait for the salting to help you from hotspotting till the region gets splitted.  Mohammad just pointing...
.../04/09/hbasewd-avoid-regionserver-hotspotting-d espite-writing-records-with-sequential-keys/ gets from     The information contained in this electronic message (email) and any attachments to this email...
[+ show more]
   Author: Ajay Bhosle, 2012-11-21, 11:46
Search results for prefix key hotspot :
Re: Rowkey hashing to avoid hotspotting - HBase - [mail # user]
... hot data (like in example above: with keys prefixed with model, the whole several regions containing data of same model may have data that is frequently accessed). In this case HBase...
...You might be right, when reading load concentrated on single/several RS they will not act as dead as when it is hotspotting during writing. I think I referred more to "uneven read load...
[+ show more]
   Author: Alex Baranau, 2012-07-17, 18:49
RES: Rowkey hashing to avoid hotspotting - HBase - [mail # user]
... r anymore. 2 - Salting, by prefixing your current rowkey with a pinch of hash. Notice  that the hash portion must be your rowkey prefix to ensure a kind of balanc ed distribution over...
...Hi Anand,  As usual, the answer is that 'it depends'  :)  I think that the main question here is: why are you afraid that this setup  would lead to region server hotspotting? Is because you...
[+ show more]
   Author: Cristofer Weber, 2012-07-16, 19:00
Re: HBase Region/Table Hotspotting - HBase - [mail # user]
... of the key (but then you loose the ability to do range scan across keys).  If you still need to scan rows according to their sort order you can "salt" (as some call it) the key by prefix...
...The most common cause for hotspotting is inserting rows with monotonically increasing row keys. In that case only the last region will get the writes and no amount of splitting will fix...
[+ show more]
   Author: lars hofhansl, 2013-02-11, 05:14
[expand - 1 more] - Re: Prefix salting pattern - HBase - [mail # user]
...You may be missing the point. The primary reason for the salt prefix pattern is to avoid hotspotting when inserting time series data AND at the same time provide a way to perform range...
... scans. http://blog.sematext.com/2012/04/09/hbasewd-avoid-regionserver-hotspotting-despite-writing-records-with-sequential-keys/ The data being inserted will be a constant stream of time...
[+ show more]
   Author: Software Dev, 2014-05-18, 16:40
Re: Adding a new region server or splitting an old region in a Hash-partitioned HBase Data Store - HBase - [mail # user]
...://blog.sematext.com/2012/04/09/hbasewd-avoid-regionserver-hotspotting-despite-writing-records-with-sequential-keys/  And some older discussions by experts on this topic: http://search-hadoop.com/?q=prefix+salt+key+hotspot...
   Author: Shahab Yunus, 2013-06-27, 15:11
Re: Splitting an existing table with new keys. - HBase - [mail # user]
...So the situation here is that we are trying to bulk load data in to atable. But each load of data has such range of keys that it will go to aspecific continuous chunk of the region servers.I...
   Author: Shahab Yunus, 2014-08-19, 20:30
Timestamp as a key good practice? - HBase - [mail # user]
....  With this schema, I can find the files by ID very quickly and I can find the files which need to be updated pretty quickly too. But it's hotspotting one region.  1) Hotspotting. 2) Salting. 3) Key field...
... until the timestamp reach a certain value and move to the next region (hotspotting).  I have a table with a uniq key, a file path and a "last update" field. I can easily find back the file...
[+ show more]
   Author: Jean-Marc Spaggiari, 2012-06-13, 16:16
Consider individual RSs performance when writing records with random keys? - HBase - [mail # user]
.../timeseries data. If simplified, the idea is to add random prefix to the row key so that writes end up on different region servers (avoiding single RS hotspot).  2. When writing data to HBase with salted...
...Hi,  1. Not sure if you've seen HBaseWD (https://github.com/sematext/HBaseWD) project. It implements the "salt keys with prefix" approach when writing monotonically increasing row key...
[+ show more]
   Author: Alex Baranau, 2012-05-17, 14:23
Re: Help with row and column design - HBase - [mail # user]
...Any improvements in the row key design?If i always know we will be querying by country could/should I prefixthe row key with the country to help with hotspotting?FR/2014042901FR/2014042902.....
   Author: Software Dev, 2014-04-30, 03:09
Re: Key formats and very low cardinality leading fields - HBase - [mail # user]
...Uhm...   This isn't very good.  In terms of inserting, you will hit a single or small subset of regions.    This may not be that bad if you have enough data and the rows ...
   Author: Michael Segel, 2012-09-05, 03:04
Sort:
project
HBase (9)
type
mail # user (9)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (1)
last 9 months (9)
author
Alex Baranau (2)
Ajay Bhosle (1)
Cristofer Weber (1)
Jean-Marc Spaggiari (1)
Shahab Yunus (1)
Software Dev (1)
Varun Sharma (1)
lars hofhansl (1)