| clear query|facets|time |
Search criteria: .
Results from 21 to 30 from
977 (0.44s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Poor HBase map-reduce scan performance - HBase - [mail # user]
|
|
...The blockbuffers are not reused, but that by itself should not be a problem as they are all the same size (at least I have never identified that as one in my profiling sessions). My of...
|
|
|
Author: lars hofhansl,
2013-05-05, 01:33
|
|
|
Re: Downfall Parody - HBase - [mail # dev]
|
|
...Thanks. That is pretty funny! :) Unfortunately I always have to turn off the sound for these parodies since I speak German. Doesn't quite work if you understand what he's saying. &nbs...
|
|
|
Author: lars hofhansl,
2013-05-05, 01:30
|
|
|
Re: Poor HBase map-reduce scan performance - HBase - [mail # user]
|
|
...Interesting. If you can try 0.94.7 (but it'll probably not have changed that much from 0.94.4) Do you have enabled one of the block encoders (FAST_DIFF, etc)? If so, try without. They...
|
|
|
Author: lars hofhansl,
2013-05-03, 00:46
|
|
|
Re: Poor HBase map-reduce scan performance - HBase - [mail # user]
|
|
...Hmm... Did you actually use exactly version 0.94.4, or the latest 0.94.7. I would be very curious to see profiling data. From: Bryan Keller To: "[EMAIL PROTECTED]" ...
|
|
|
Author: lars hofhansl,
2013-05-02, 04:41
|
|
|
Re: Poor HBase map-reduce scan performance - HBase - [mail # user]
|
|
...If you can, try 0.94.4+; it should significantly reduce the amount of bytes copied around in RAM during scanning, especially if you have wide rows and/or large key portions. That in turns ma...
|
|
|
Author: lars hofhansl,
2013-05-01, 06:21
|
|
|
Re: Schema Design Question - HBase - [mail # user]
|
|
...Same here. HBase is generally good at honing in to a small (maybe 10-100m rows) continuous subset of an essentially unlimited dataset. If all you ever do is scanning _everything_ and then th...
|
|
|
Author: lars hofhansl,
2013-05-01, 05:35
|
|
|
Re: Read access pattern - HBase - [mail # user]
|
|
...I do not want to be rude or anything... But how often we need to have this discussion? When you salt your rowkeys with say 10 salt values then for each read you need to fork of 10 read...
|
|
|
Author: lars hofhansl,
2013-05-01, 05:12
|
|
|
Re: Poor HBase map-reduce scan performance - HBase - [mail # user]
|
|
...Your average row is 35k so scanner caching would not make a huge difference, although I would have expected some improvements by setting it to 10 or 50 since you have a wide 10ge pipe. ...
|
|
|
Author: lars hofhansl,
2013-05-01, 05:01
|
|
|
Re: Multi-CheckAnd... - HBase - [mail # user]
|
|
...It's not far fetched to add a checkAndMutate method/rpc to HBase. Put, Delete, Increment (in trunk), and Append extend Mutation, so it would not be too hard to add. Could you file a jira and...
|
|
|
Author: lars hofhansl,
2013-04-28, 03:34
|
|
|
Re: HBase - prioritizing writes over reads? - HBase - [mail # user]
|
|
...I would also add that if you need an "always available" store (as in you want A and P of CAP [1], and can sacrifice C), you might be better served with one of the DynamoDB inspired architect...
|
|
|
Author: lars hofhansl,
2013-04-26, 00:18
|
|
|
|
