Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Coprocessor Aggregation supposed to be ~20x slower than Scans?


+
anil gupta 2012-05-14, 19:02
+
Stack 2012-05-14, 19:08
Copy link to this message
-
Re: Coprocessor Aggregation supposed to be ~20x slower than Scans?
HI Stack,

I'll look into Gary Helming post and try to do profiling of coprocessor and
share the results.

Thanks,
Anil Gupta

On Mon, May 14, 2012 at 12:08 PM, Stack <[EMAIL PROTECTED]> wrote:

> On Mon, May 14, 2012 at 12:02 PM, anil gupta <[EMAIL PROTECTED]>
> wrote:
> > I loaded around 70 thousand 1-2KB records in HBase. For scans, with my
> > custom filter i am able to get 97 rows in 500 milliseconds and for doing
> > sum, max, min(in built aggregations of HBase) on the same custom filter
> its
> > taking 11000 milliseconds. Does this mean that coprocessors aggregation
> is
> > supposed to be around ~20x slower than scans? Am i missing any trick over
> > here?
> >
>
> That seems like a high tax to pay for running CPs.  Can you dig in on
> where the time is being spent?  (See another recent note on this list
> or on dev where Gary Helmling talks about how he did basic profiling
> of CPs).
> St.Ack
>

--
Thanks & Regards,
Anil Gupta
+
Ted Yu 2012-05-14, 19:55
+
anil gupta 2012-05-14, 20:47
+
Ted Yu 2012-05-14, 20:58
+
anil gupta 2012-05-14, 22:31
+
Ted Yu 2012-05-14, 23:00
+
anil gupta 2012-05-15, 17:34
+
Ted Yu 2012-05-15, 17:47
+
Ted Yu 2012-05-15, 18:46
+
anil gupta 2012-05-15, 19:09
+
Ted Yu 2012-05-15, 20:37
+
anil gupta 2012-05-15, 23:58
+
Ted Yu 2012-05-16, 00:07
+
anil gupta 2012-05-16, 00:30
+
Ted Yu 2012-05-16, 00:34
+
Jimmy Xiang 2012-05-16, 17:28
+
Anil Gupta 2012-05-16, 18:15
+
anil gupta 2012-05-15, 18:04