Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - FTS performance


+
Jilal Oussama 2013-11-22, 15:25
+
Asaf Mesika 2013-11-22, 15:36
+
Jean-Marc Spaggiari 2013-11-22, 16:13
+
Asaf Mesika 2013-11-22, 16:28
+
Jilal Oussama 2013-11-22, 16:50
+
Vladimir Rodionov 2013-11-22, 19:03
+
Oussama Jilal 2013-11-22, 21:28
Copy link to this message
-
Re: FTS performance
Jean-Marc Spaggiari 2013-11-22, 21:34
But even so. For FTS you will most probably want to benefit from
parallelism to be able to scale.
2013/11/22 Oussama Jilal <[EMAIL PROTECTED]>

> I am only loading the keys (using FirstKeyOnlyFilter and KeyOnlyFilter),
> not the entire rows.
>
>
> On 11/22/2013 07:03 PM, Vladimir Rodionov wrote:
>
>> Loading 100M rows over network from HBase server to HBase client is not a
>> right approach
>> for someone looking for speed.
>>
>> Best regards,
>> Vladimir Rodionov
>> Principal Platform Engineer
>> Carrier IQ, www.carrieriq.com
>> e-mail: [EMAIL PROTECTED]
>>
>> ________________________________________
>> From: Jilal Oussama [[EMAIL PROTECTED]]
>> Sent: Friday, November 22, 2013 8:50 AM
>> To: Mailing List Apache HBase
>> Subject: Re: FTS performance
>>
>> What I have been avoiding all along ... MR & CoProcessors ... thanks all
>>
>>
>> 2013/11/22 Asaf Mesika <[EMAIL PROTECTED]>
>>
>>  You're right, just in bear mind response time won't match an online query
>>> if this is what you are aiming at.
>>>
>>> On Friday, November 22, 2013, Jean-Marc Spaggiari wrote:
>>>
>>>  You can also simply do a MR job without any coprocessors nor Phoenix
>>>> required....
>>>>
>>>>
>>>> 2013/11/22 Asaf Mesika <[EMAIL PROTECTED] <javascript:;>>
>>>>
>>>>  The best way is to go parallel with coprocessors. Try Phoenix which
>>>>> has this built in or write your own.
>>>>>
>>>>> On Friday, November 22, 2013, Jilal Oussama wrote:
>>>>>
>>>>>  Hi all,
>>>>>>
>>>>>> I am looking for some performance suggestions.
>>>>>>
>>>>>> I would like to get all the keys of table (wich contains ~100 million
>>>>>> rows).
>>>>>>
>>>>>> Currently, I am doing a FTS with FirstKeyOnlyFilter and KeyOnlyFilter
>>>>>>
>>>>> using
>>>>>
>>>>>> Thrift from a python script, and I find it very slow ...
>>>>>>
>>>>>> Any suggestions whould be appreciable.
>>>>>>
>>>>>> HBase : 0.94.13
>>>>>> Hadoop : 1.2.1
>>>>>>
>>>>>> Thanks in advance.
>>>>>>
>>>>>>  Confidentiality Notice:  The information contained in this message,
>> including any attachments hereto, may be confidential and is intended to be
>> read only by the individual or entity to whom this message is addressed. If
>> the reader of this message is not the intended recipient or an agent or
>> designee of the intended recipient, please note that any review, use,
>> disclosure or distribution of this message or its attachments, in any form,
>> is strictly prohibited.  If you have received this message in error, please
>> immediately notify the sender and/or [EMAIL PROTECTED] and
>> delete or destroy any copy of this message and its attachments.
>>
>
>
+
Oussama Jilal 2013-11-22, 22:09
+
Haosong Huang 2013-11-23, 03:45
+
Oussama Jilal 2013-11-23, 11:55