Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Coprocessor execution


+
raghavendhra rahul 2012-03-20, 06:06
+
Stack 2012-03-20, 18:32
+
raghavendhra rahul 2012-03-21, 05:19
+
shixing 2012-03-21, 07:09
+
raghavendhra rahul 2012-03-21, 08:48
Copy link to this message
-
Re: Coprocessor execution
Hello,

Any info about specific numbers (number of regions vs response time,
etc) will help.

Btw, for rowcount, you should use FirstKeyOnlyFilter.
And in your code, you should add a callback to sum individual Region
side results (though that is not related to response time, but with
your rowcount final result).
Thanks,
Himanshu

On Wed, Mar 21, 2012 at 2:48 AM, raghavendhra rahul
<[EMAIL PROTECTED]> wrote:
> This is my coprocessor end point
>
> public class RowcountEndpoint extends BaseEndpointCoprocessor implements
>        RowcountProtocol {
>
>    @Override
>    public long getRowcount() throws IOException {
>        Scan scan = new Scan();
>        scan.setCaching(100);
>        scan.setCacheBlocks(false);
>        RegionCoprocessorEnvironment env > (RegionCoprocessorEnvironment)getEnvironment();
>        InternalScanner scanner = env.getRegion().getScanner(scan);
>        long result = 0;
>        try{
>            List<KeyValue> val = new ArrayList<KeyValue>();
>            boolean done = false;
>            do{
>                val.clear();
>                done = scanner.next(val);
>                result+=1;
>            }while(done);
>        }
>        finally{
>            scanner.close();
>        }
>        return result;
>    }
> }
>
>
> This is my client
>
> public class RowClient {
>    public Map<byte[], Long> getcount(String name) throws Throwable {
>
>        Configuration conf = HBaseConfiguration.create();
>        HTable table = new HTable(conf, name);
>        Map<byte[], Long> res;
>        try {
>            res = table.coprocessorExec(RowcountProtocol.class, null, null,
>                    new Batch.Call<RowcountProtocol, Long>() {
>                        @Override
>                        public Long call(RowcountProtocol counter)
>                                throws IOException {
>                            return counter.getRowcount();
>                        }
>                    });
>        } finally {
>
>        }
>        return res;
>    }
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB