Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Re: ZK Exceptions


Copy link to this message
-
Re: ZK Exceptions
I see these errors too, and agree, it would be nice not to have them in the
logs.  It occurs anytime zk temporarily goes away (or one node of zk gets
rolled, etc.), which is normal, anytime we do a rolling update to our zk
cluster.

It would be nice to only see these errors in the logs if the connection
failure reaches a certain threshold, like it can't connect after a
configurable delay, etc.

Jason
On Tue, Apr 16, 2013 at 11:18 AM, Neha Narkhede <[EMAIL PROTECTED]>wrote:

> These errors suggest that you maybe hitting the maxConnections limit
> on your zookeeper cluster. This limits the # of concurrent connections
> to zookeeper from a single host. These errors have nothing to do with
> the max.message.size limit on Kafka.
>
> Thanks,
> Neha
>
> On Tue, Apr 16, 2013 at 11:14 AM, Drew Daugherty
> <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > I had a question about the max.message.size parameter.  Does this apply
> to the size of the messages after or before compression?
> >
> > Also, I am using the async producer in kafka 0.7.2 and am seeing the
> following spam in my logs when zookeeper fails:
> >
> > 2013-04-16 12:08:43,608 [Thread-10-SendThread(10.3.0.31:2181)] INFO
>  org.apache.zookeeper.ClientCnxn - Opening socket connection to server
> 10.3.0.30/10.3.0.30:2181
> > 2013-04-16 12:08:43,618 [Thread-10-SendThread(10.3.0.30:2181)] WARN
>  org.apache.zookeeper.ClientCnxn - Session 0x3e10ca5f060024 for server
> null, unexpected error, closing socket connection and attempting reconnect
> > java.net.ConnectException: Connection refused
> >         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> >         at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
> >         at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
> > 2013-04-16 12:08:43,708 [Thread-9-SendThread(10.3.0.31:2181)] INFO
>  org.apache.zookeeper.ClientCnxn - Opening socket connection to server
> 10.3.0.30/10.3.0.30:2181
> > 2013-04-16 12:08:43,708 [Thread-9-SendThread(10.3.0.30:2181)] WARN
>  org.apache.zookeeper.ClientCnxn - Session 0x3e10ca5f060023 for server
> null, unexpected error, closing socket connection and attempting reconnect
> > java.net.ConnectException: Connection refused
> >         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> >         at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
> >         at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
> > 2013-04-16 12:08:43,798 [Thread-9-SendThread(10.3.0.31:2181)] INFO
>  org.apache.zookeeper.ClientCnxn - Opening socket connection to server
> 10.3.0.32/10.3.0.32:2181
> > 2013-04-16 12:08:43,808 [Thread-9-SendThread(10.3.0.32:2181)] WARN
>  org.apache.zookeeper.ClientCnxn - Session 0x13e10ca621a0002 for server
> null, unexpected error, closing socket connection and attempting reconnect
> > java.net.ConnectException: Connection refused
> >         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> >         at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
> >         at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
> > 2013-04-16 12:08:44,298 [Thread-10-SendThread(10.3.0.31:2181)] INFO
>  org.apache.zookeeper.ClientCnxn - Opening socket connection to server
> 10.3.0.32/10.3.0.32:2181
> > 2013-04-16 12:08:44,308 [Thread-10-SendThread(10.3.0.32:2181)] WARN
>  org.apache.zookeeper.ClientCnxn - Session 0x23e10ca5f0b0004 for server
> null, unexpected error, closing socket connection and attempting reconnect
> >
> > Is there any setting like a connection retry interval I can use to
> mitigate having a ton of these messages dumped into the log?
> >
> > -drew
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB