Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> How to improve the write performance?


Copy link to this message
-
Re: How to improve the write performance?
Start by installing ganglia or graphite and figure our which part is slower
in HBase

On Wednesday, November 27, 2013, jingych wrote:

>  Thanks for reply!
>
> I'm running with single thread.
>
> Actually I want to know: How really fast that HBase write can be with each
> thread?
>
> And how to optimize it?
>
> Config BLOCKSIZE/WriteBuffer ...?
>
> I'm a newbie.
> Thanks for help!
>
> ------------------------------
>
> jingych
>
>  *From:* Asaf Mesika <javascript:_e({}, 'cvml', '[EMAIL PROTECTED]');>
> *Date:* 2013-11-26 19:20
> *To:* [EMAIL PROTECTED] <javascript:_e({}, 'cvml',
> '[EMAIL PROTECTED]');>; jingych <javascript:_e({}, 'cvml',
> '[EMAIL PROTECTED]');>
> *Subject:* Re: How to improve the write performance?
>  How many client threads?
>
>
> On Tuesday, November 26, 2013, jingych wrote:
>
>> Hi, All!
>>
>> Recently, I just test the Client write performance with HBase Java API.
>>
>> I think the performance X-factor is :
>>
>> 1) client buffer size;
>> 2) server memstore size;
>>
>> But when i did the test, I have the result is :
>>
>> 1) As the client buffer size increase with 2M, 4M, 8M, 16M, 32M, and the
>> write speed is 320.4 331.4 336.4 343.2 371.7
>> (kb/s), it's 14columns into 1 column family.
>>
>> 2) As the server memstore size increased, the write speed is the same
>> almost.
>>
>> This confuse me!
>>
>> I want to know:
>> 1) What is the key factor influence with the client write performance?
>> 2) How to improve the write performance?
>>
>> Thanks!
>>
>> Best wishes!
>>
>>
>>
>>
>> jingych
>> 2013-11-26
>>
>> ---------------------------------------------------------------------------------------------------
>> Confidentiality Notice: The information contained in this e-mail and any
>> accompanying attachment(s)
>> is intended only for the use of the intended recipient and may be
>> confidential and/or privileged of
>> Neusoft Corporation, its subsidiaries and/or its affiliates. If any
>> reader of this communication is
>> not the intended recipient, unauthorized use, forwarding, printing,
>>  storing, disclosure or copying
>> is strictly prohibited, and may be unlawful.If you have received this
>> communication in error,please
>> immediately notify the sender by return e-mail, and delete the original
>> message and all copies from
>> your system. Thank you.
>>
>> ---------------------------------------------------------------------------------------------------
>>
>
> ---------------------------------------------------------------------------------------------------
> Confidentiality Notice: The information contained in this e-mail and any
> accompanying attachment(s)
> is intended only for the use of the intended recipient and may be
> confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader
> of this communication is
> not the intended recipient, unauthorized use, forwarding, printing,
> storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this
> communication in error,please
> immediately notify the sender by return e-mail, and delete the original
> message and all copies from
> your system. Thank you.
>
> ---------------------------------------------------------------------------------------------------
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB