Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Parallel scans


Copy link to this message
-
Re: Parallel scans
I think you could do it manually by looking up all the different
regions and starting a separate scan for each region. Not quite as
handy as the built-in multi get, but essentially the same.

Of course, that leaves the question of processing-- If you're
processing it in a single-threaded environment, HBase is unlikely to
be the bottleneck. If your sending each scan to multiple processors,
this could be a significant speedup.

--Tom

On Mon, Jul 30, 2012 at 11:34 PM, Bertrand Dechoux <[EMAIL PROTECTED]> wrote:
> Hi,
>
> Are you talking about as coprocessor or MapReduce input? If it is the first
> then it is up to you (the client). If it is the latter I am not sure that
> -if scans were changed to be parallel (assuming they are sequential now)-
> the whole job would be noticeably faster. But I am interested in an answer
> too.
>
> Regards
>
> Bertrand
>
> On Tue, Jul 31, 2012 at 2:56 AM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:
>
>> Is there a way to execute multiple scans in parallel like get?
>>
>
>
>
> --
> Bertrand Dechoux
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB