Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # user >> Throttle major compaction.

Denis 2013-02-28, 13:27
Copy link to this message
Re: Throttle major compaction.
Can you open a ticket for this?  We could post the iterator as a patch
to that ticket.  Then people could use that patch.

On Thu, Feb 28, 2013 at 8:27 AM, Denis <[EMAIL PROTECTED]> wrote:
> Hi.
> Major compaction loads hard disks very hard, even with
> tserver.compaction.major.concurrent.max=1
> Besides nice peaks on the Load Average and IOstat graps during major
> compaction, such high load also badly affects query performance and
> latency.
> HBase and Cassandra both have settings to throttle major compaction
> (Cassandra's default is 16 Mb/s which is about 1/3 of the peek values
> I see during Accumulo's major compaction)
> But it looks like Accumulo does not have such setting and I have not
> found relevant questions in the bugtracker and maillist archive.
> How do you deal with the major compaction and its performance effects?
Denis 2013-02-28, 15:03
Keith Turner 2013-02-28, 15:16
Keith Turner 2013-02-28, 14:26