Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # user >> High Ingest on a single server [SEC=UNOFFICIAL]


Copy link to this message
-
RE: High Ingest on a single server [SEC=UNOFFICIAL]
Try restarting the master. A few releases had a big where it would get
stuck.

Sent from my phone, please pardon the typos and brevity.
On Sep 1, 2013 6:12 PM, "Dickson, Matt MR" <[EMAIL PROTECTED]>
wrote:

> **
>
> *UNOFFICIAL*
> Thanks Eric.
>
> The tablet of concern has 2000 tablets while all others have 1000 so it
> looks like the balancers aren't evening out the tablets per node as
> expected.
>
> Is there a way to force the balancer to run or rectify this situation by
> moving tablets to alternate nodes?
>
>
>
>
>  ------------------------------
> *From:* Eric Newton [mailto:[EMAIL PROTECTED]]
> *Sent:* Thursday, 29 August 2013 23:23
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: High Ingest on a single server [SEC=UNOFFICIAL]
>
>  The balancers that ship with accumulo attempt to keep an equal number of
> tablets on each server.  An empty tablet, will be balanced with the same
> weight as a 50G tablet.
>
> You can write a new balancer to take advantage of the properties of the
> tablets, and any expected hotspots you have.
>
>
>
> On Thu, Aug 29, 2013 at 1:39 AM, Dickson, Matt MR <
> [EMAIL PROTECTED]> wrote:
>
>> **
>>
>> *UNOFFICIAL*
>> We are seeing a single server that has less entries than all the other
>> nodes in the cluster.  Accumulo now appears to be directing higher ingest
>> tablets to this node and its now getting 7 times the ingest entries than
>> all other nodes and is slowing or load.  Does Accumulo attempt to balance
>> disk usage across the nodes for a table by moving tablets and that is why
>> we are seeing this node ingesting more?
>>
>> If not, is it possible to make accumulo rebalance the ingest across all
>> servers during a load?
>>
>> Matt
>>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB