Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - How to improve the write performance?


Copy link to this message
-
Re: How to improve the write performance?
Asaf Mesika 2013-11-28, 19:33
Start by installing ganglia or graphite and figure our which part is slower
in HBase

On Wednesday, November 27, 2013, jingych wrote:

>  Thanks for reply!
>
> I'm running with single thread.
>
> Actually I want to know: How really fast that HBase write can be with each
> thread?
>
> And how to optimize it?
>
> Config BLOCKSIZE/WriteBuffer ...?
>
> I'm a newbie.
> Thanks for help!
>
> ------------------------------
>
> jingych
>
>  *From:* Asaf Mesika <javascript:_e({}, 'cvml', '[EMAIL PROTECTED]');>
> *Date:* 2013-11-26 19:20
> *To:* [EMAIL PROTECTED] <javascript:_e({}, 'cvml',
> '[EMAIL PROTECTED]');>; jingych <javascript:_e({}, 'cvml',
> '[EMAIL PROTECTED]');>
> *Subject:* Re: How to improve the write performance?
>  How many client threads?
>
>
> On Tuesday, November 26, 2013, jingych wrote:
>
>> Hi, All!
>>
>> Recently, I just test the Client write performance with HBase Java API.
>>
>> I think the performance X-factor is :
>>
>> 1) client buffer size;
>> 2) server memstore size;
>>
>> But when i did the test, I have the result is :
>>
>> 1) As the client buffer size increase with 2M, 4M, 8M, 16M, 32M, and the
>> write speed is 320.4 331.4 336.4 343.2 371.7
>> (kb/s), it's 14columns into 1 column family.
>>
>> 2) As the server memstore size increased, the write speed is the same
>> almost.
>>
>> This confuse me!
>>
>> I want to know:
>> 1) What is the key factor influence with the client write performance?
>> 2) How to improve the write performance?
>>
>> Thanks!
>>
>> Best wishes!
>>
>>
>>
>>
>> jingych
>> 2013-11-26
>>
>> ---------------------------------------------------------------------------------------------------
>> Confidentiality Notice: The information contained in this e-mail and any
>> accompanying attachment(s)
>> is intended only for the use of the intended recipient and may be
>> confidential and/or privileged of
>> Neusoft Corporation, its subsidiaries and/or its affiliates. If any
>> reader of this communication is
>> not the intended recipient, unauthorized use, forwarding, printing,
>>  storing, disclosure or copying
>> is strictly prohibited, and may be unlawful.If you have received this
>> communication in error,please
>> immediately notify the sender by return e-mail, and delete the original
>> message and all copies from
>> your system. Thank you.
>>
>> ---------------------------------------------------------------------------------------------------
>>
>
> ---------------------------------------------------------------------------------------------------
> Confidentiality Notice: The information contained in this e-mail and any
> accompanying attachment(s)
> is intended only for the use of the intended recipient and may be
> confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader
> of this communication is
> not the intended recipient, unauthorized use, forwarding, printing,
> storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this
> communication in error,please
> immediately notify the sender by return e-mail, and delete the original
> message and all copies from
> your system. Thank you.
>
> ---------------------------------------------------------------------------------------------------
>