| clear query|facets|time |
Search criteria: .
Results from 51 to 60 from
81 (0.313s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Using Scans in parallel - HBase - [mail # user]
|
|
...BTW, a map reduce job can scan the table in 6m (both column families), including some processing. So that is the fastest approach. On Oct 9, 2011, at 8:03 PM, Bryan Keller wrote:...
|
|
|
Author: Bryan Keller,
2011-10-10, 03:21
|
|
|
Re: Using Scans in parallel - HBase - [mail # user]
|
|
...Sure. 2 region servers with 5 disks each. Table has 2 column families and 113 regions total for 2m rows. I'm scanning just one of the families. Performance with the 8 parallel sc...
|
|
|
Author: Bryan Keller,
2011-10-10, 03:03
|
|
|
Re: Using Scans in parallel - HBase - [mail # user]
|
|
...This is 100% reproducible for me, so I doubt it is related to random number generation. On Oct 9, 2011, at 2:53 PM, lars hofhansl wrote: from a Random number generator. the...
|
|
|
Author: Bryan Keller,
2011-10-10, 00:49
|
|
|
Re: Using Scans in parallel - HBase - [mail # user]
|
|
...This is just scanning (reads). I'll need to do more testing to find a cause, hopefully it is something with my test. On Oct 9, 2011, at 1:13 PM, lars hofhansl wrote: files ...
|
|
|
Author: Bryan Keller,
2011-10-09, 21:40
|
|
|
Re: Using Scans in parallel - HBase - [mail # user]
|
|
...On further thought, it seems this might be a serious issue, as two unrelated processes within an application may be scanning the same table at the same time. On Oct 9, 2011...
|
|
|
Author: Bryan Keller,
2011-10-09, 18:03
|
|
|
Re: Using Scans in parallel - HBase - [mail # user]
|
|
...I was not able to get consistent results using multiple scanners in parallel on a table. I implemented a counter test that used 8 scanners in parallel on a table with 2m rows wit...
|
|
|
Author: Bryan Keller,
2011-10-09, 17:59
|
|
|
Re: Speculative execution and TableOutputFormat - HBase - [mail # user]
|
|
...Ah that is a very interesting solution Leif, this seems optimal to me. I am going to try this and I'll report back. On Sep 12, 2011, at 9:09 AM, Leif Wickland wrote: asking...
|
|
|
Author: Bryan Keller,
2011-09-12, 16:51
|
|
|
Re: Speculative execution and TableOutputFormat - HBase - [mail # user]
|
|
...Thanks for pointing that out in the book. I suppose a similar problem could occur even with speculative execution turned off. If a task is using HBase as sink, and it runs halfwa...
|
|
|
Author: Bryan Keller,
2011-09-10, 23:41
|
|
|
Speculative execution and TableOutputFormat - HBase - [mail # user]
|
|
...I believe there is a problem with Hadoop's speculative execution (which is on by default), and HBase's TableOutputFormat. If I understand correctly, speculative execution can lau...
|
|
|
Author: Bryan Keller,
2011-09-10, 20:22
|
|
|
Re: zk connection leak with TableInput/OutputFormat (CDH3b4, 0.90.1) - HBase - [mail # user]
|
|
...I opened a bug for this. https://issues.apache.org/jira/browse/HBASE-3792 On Apr 16, 2011, at 4:56 AM, Bryan Keller wrote: object, and it never cleans it up. When running a Mappe...
|
|
|
Author: Bryan Keller,
2011-04-16, 12:11
|
|
|
|
