-Re: Consumer pauses when running many threads
Jun Rao 2013-08-01, 15:13
Have you looked at
On Thu, Aug 1, 2013 at 7:30 AM, Sybrandy, Casey <
[EMAIL PROTECTED]> wrote:
> We're seeing an issue running 0.7.0 where one or more of our consumers are
> pausing after about an hour when we have a lot of threads configured. Our
> setup is as follows:
> * 4 brokers configured for 32 threads and 32 partitions on each
> * 2 consumers each processing 40 streams (24 and 16).
> * Zookeeper server is a CDH version that's at least 3.3.4.
> We were also seeing this with 3 consumers running 18 threads each. As you
> can tell, the hardware is quite beefy and the brokers are described as
> being "bored."
> Outside of upgrading to 0.7.2, which we are planning on doing but can't
> yet, what else can we look into to try to resolve this or at least
> determine what's happening?