Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Re: ZK Exceptions


Copy link to this message
-
Re: ZK Exceptions
These errors suggest that you maybe hitting the maxConnections limit
on your zookeeper cluster. This limits the # of concurrent connections
to zookeeper from a single host. These errors have nothing to do with
the max.message.size limit on Kafka.

Thanks,
Neha

On Tue, Apr 16, 2013 at 11:14 AM, Drew Daugherty
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> I had a question about the max.message.size parameter.  Does this apply to the size of the messages after or before compression?
>
> Also, I am using the async producer in kafka 0.7.2 and am seeing the following spam in my logs when zookeeper fails:
>
> 2013-04-16 12:08:43,608 [Thread-10-SendThread(10.3.0.31:2181)] INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.3.0.30/10.3.0.30:2181
> 2013-04-16 12:08:43,618 [Thread-10-SendThread(10.3.0.30:2181)] WARN  org.apache.zookeeper.ClientCnxn - Session 0x3e10ca5f060024 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
> 2013-04-16 12:08:43,708 [Thread-9-SendThread(10.3.0.31:2181)] INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.3.0.30/10.3.0.30:2181
> 2013-04-16 12:08:43,708 [Thread-9-SendThread(10.3.0.30:2181)] WARN  org.apache.zookeeper.ClientCnxn - Session 0x3e10ca5f060023 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
> 2013-04-16 12:08:43,798 [Thread-9-SendThread(10.3.0.31:2181)] INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.3.0.32/10.3.0.32:2181
> 2013-04-16 12:08:43,808 [Thread-9-SendThread(10.3.0.32:2181)] WARN  org.apache.zookeeper.ClientCnxn - Session 0x13e10ca621a0002 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
> 2013-04-16 12:08:44,298 [Thread-10-SendThread(10.3.0.31:2181)] INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.3.0.32/10.3.0.32:2181
> 2013-04-16 12:08:44,308 [Thread-10-SendThread(10.3.0.32:2181)] WARN  org.apache.zookeeper.ClientCnxn - Session 0x23e10ca5f0b0004 for server null, unexpected error, closing socket connection and attempting reconnect
>
> Is there any setting like a connection retry interval I can use to mitigate having a ton of these messages dumped into the log?
>
> -drew

 
+
Jason Rosenberg 2013-04-16, 19:40