Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - Coprocessor Aggregation supposed to be ~20x slower than Scans?


+
anil gupta 2012-05-14, 19:02
+
Stack 2012-05-14, 19:08
+
anil gupta 2012-05-14, 19:31
+
Ted Yu 2012-05-14, 19:55
+
anil gupta 2012-05-14, 20:47
+
Ted Yu 2012-05-14, 20:58
+
anil gupta 2012-05-14, 22:31
+
Ted Yu 2012-05-14, 23:00
+
anil gupta 2012-05-15, 17:34
+
Ted Yu 2012-05-15, 17:47
+
Ted Yu 2012-05-15, 18:46
+
anil gupta 2012-05-15, 19:09
+
Ted Yu 2012-05-15, 20:37
+
anil gupta 2012-05-15, 23:58
+
Ted Yu 2012-05-16, 00:07
+
anil gupta 2012-05-16, 00:30
+
Ted Yu 2012-05-16, 00:34
+
Jimmy Xiang 2012-05-16, 17:28
Copy link to this message
-
Re: Coprocessor Aggregation supposed to be ~20x slower than Scans?
Anil Gupta 2012-05-16, 18:15
Thanks, Jimmy

Best Regards,
Anil

On May 16, 2012, at 10:28 AM, Jimmy Xiang <[EMAIL PROTECTED]> wrote:

> Yes, it is fixed in CDH4.  It will be in the coming release.
>
> Thanks,
> Jimmy
>
> On Tue, May 15, 2012 at 5:34 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
>> Hopefully this gets fixed in
>>
>> https://repository.cloudera.com/artifactory/public/org/apache/hbase/hbase/0.92.0-cdh4b2-SNAPSHOT/
>>
>> A developer from Cloudera would be able to better help you.
>>
>> On Tue, May 15, 2012 at 5:30 PM, anil gupta <[EMAIL PROTECTED]> wrote:
>>
>>> Hi Ted,
>>>
>>> I looked into hbase-0.92.0-cdh4b1-20120206.193413-23-sources.jar and it
>>> also doesn't have it.
>>>
>>> On Tue, May 15, 2012 at 5:07 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>>>
>>>> Why did you need to decompile ?
>>>> Here is the source code:
>>>>
>>>>
>>>>
>>>
>> https://repository.cloudera.com/artifactory/public/org/apache/hbase/hbase/0.92.0-cdh4b1-SNAPSHOT/
>>>>
>>>> On Tue, May 15, 2012 at 4:58 PM, anil gupta <[EMAIL PROTECTED]>
>>> wrote:
>>>>
>>>>> Hi Ted,
>>>>>
>>>>> I decompiled the hbase-0.92.0-cdh4b1.jar using JD-GUI and in
>>>>> validateParameter method i don't find that condition.
>>>>>
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>> On Tue, May 15, 2012 at 1:37 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>>>>>
>>>>>> I checked the code in Apache HBase 0.92 and trunk. I see the
>>> following
>>>>> line
>>>>>> in validateParameters():
>>>>>>           !Bytes.equals(scan.getStopRow(),
>>>> HConstants.EMPTY_END_ROW))) {
>>>>>>
>>>>>> Can you confirm that the bug is in cdh4b1 only ?
>>>>>>
>>>>>> Sorry for not doing the validation earlier.
>>>>>>
>>>>>> On Tue, May 15, 2012 at 12:09 PM, anil gupta <
>> [EMAIL PROTECTED]>
>>>>>> wrote:
>>>>>>
>>>>>>> Oh i c.. Now if i look closely at your gmail id then i can see
>> your
>>>>>> name. I
>>>>>>> was totally confused.
>>>>>>>
>>>>>>> So, you want to force the user to specify stopRow if the filter
>> is
>>>> not
>>>>>>> used? What if the user just wants to scan the table from startRow
>>>> till
>>>>>> the
>>>>>>> end of table? In your solution user will have explicitly set the
>>>>> stopRow
>>>>>> as
>>>>>>> HConstants.EMPTY_END_ROW. Do we really want to force this?
>>>>>>>
>>>>>>> As per your solution the code would look like this:
>>>>>>>     if(scan.hasFilter())
>>>>>>>     {  if (scan == null || (Bytes.equals(scan.getStartRow(),
>>>>>>> scan.getStopRow()) && !Bytes.equals(scan.getStartRow(),
>>>>>>> HConstants.EMPTY_START_ROW)) ||
>>> (Bytes.compareTo(scan.getStartRow(),
>>>>>>> scan.getStopRow()) > 0 &&
>>>>>>>            !Bytes.equals(scan.getStopRow(),
>>>> HConstants.EMPTY_END_ROW)
>>>>>> )) {
>>>>>>>     throw new IOException(
>>>>>>>         "Agg client Exception: Startrow should be smaller than
>>>>>> Stoprow");
>>>>>>>   } else if (scan.getFamilyMap().size() != 1) {
>>>>>>>     throw new IOException("There must be only one family.");
>>>>>>>   }
>>>>>>>     }
>>>>>>>     else
>>>>>>>     {  if (scan == null || (Bytes.equals(scan.getStartRow(),
>>>>>>> scan.getStopRow()) && !Bytes.equals(scan.getStartRow(),
>>>>>>> HConstants.EMPTY_START_ROW)) ||
>> Bytes.compareTo(scan.getStartRow(),
>>>>>>> scan.getStopRow()) > 0) {
>>>>>>>         throw new IOException(
>>>>>>>              "Agg client Exception: Startrow should be smaller
>>> than
>>>>>>> Stoprow");
>>>>>>>       } else if (scan.getFamilyMap().size() != 1) {
>>>>>>>         throw new IOException("There must be only one family.");
>>>>>>>       }
>>>>>>>     }
>>>>>>>
>>>>>>> Let me know your thoughts.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Anil
>>>>>>>
>>>>>>>
>>>>>>> On Tue, May 15, 2012 at 11:46 AM, Ted Yu <[EMAIL PROTECTED]>
>>>> wrote:
>>>>>>>
>>>>>>>> Anil:
>>>>>>>> I am having trouble accessing JIRA.
>>>>>>>>
>>>>>>>> Ted Yu and Zhihong Yu are the same person :-)
>>>>>>>>
>>>>>>>> I think it would be good to remind user of aggregation client
>> to
>>>>> narrow
>>>>>>>> range of scan. That's why I proposed adding check of
+
anil gupta 2012-05-15, 18:04