Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Re: ZK Exceptions


Copy link to this message
-
Re: ZK Exceptions
These errors suggest that you maybe hitting the maxConnections limit
on your zookeeper cluster. This limits the # of concurrent connections
to zookeeper from a single host. These errors have nothing to do with
the max.message.size limit on Kafka.

Thanks,
Neha

On Tue, Apr 16, 2013 at 11:14 AM, Drew Daugherty
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> I had a question about the max.message.size parameter.  Does this apply to the size of the messages after or before compression?
>
> Also, I am using the async producer in kafka 0.7.2 and am seeing the following spam in my logs when zookeeper fails:
>
> 2013-04-16 12:08:43,608 [Thread-10-SendThread(10.3.0.31:2181)] INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.3.0.30/10.3.0.30:2181
> 2013-04-16 12:08:43,618 [Thread-10-SendThread(10.3.0.30:2181)] WARN  org.apache.zookeeper.ClientCnxn - Session 0x3e10ca5f060024 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
> 2013-04-16 12:08:43,708 [Thread-9-SendThread(10.3.0.31:2181)] INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.3.0.30/10.3.0.30:2181
> 2013-04-16 12:08:43,708 [Thread-9-SendThread(10.3.0.30:2181)] WARN  org.apache.zookeeper.ClientCnxn - Session 0x3e10ca5f060023 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
> 2013-04-16 12:08:43,798 [Thread-9-SendThread(10.3.0.31:2181)] INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.3.0.32/10.3.0.32:2181
> 2013-04-16 12:08:43,808 [Thread-9-SendThread(10.3.0.32:2181)] WARN  org.apache.zookeeper.ClientCnxn - Session 0x13e10ca621a0002 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)
> 2013-04-16 12:08:44,298 [Thread-10-SendThread(10.3.0.31:2181)] INFO  org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.3.0.32/10.3.0.32:2181
> 2013-04-16 12:08:44,308 [Thread-10-SendThread(10.3.0.32:2181)] WARN  org.apache.zookeeper.ClientCnxn - Session 0x23e10ca5f0b0004 for server null, unexpected error, closing socket connection and attempting reconnect
>
> Is there any setting like a connection retry interval I can use to mitigate having a ton of these messages dumped into the log?
>
> -drew

 
+
Jason Rosenberg 2013-04-16, 19:40
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB