-
Re: chatty error: Exception causing close of session 0x0 due to java.io.IOException: Len error 1835955314Ted Dunning 2012-01-18, 02:19
I think that Pat is right:
1835955314 = 6D6E7472 = 'mntr'
On Wed, Jan 18, 2012 at 2:00 AM, Patrick Hunt <[EMAIL PROTECTED]> wrote:
> Hi Alexius, it looks like localhost (127.0.0.1) is making a socket
> connection and then sending a request with a supposed size of 1.8GB.
> (the first 4 bytes of each zk request are the length)
>
> It's likely that this is a "4letterword" attempt gone wrong (or some
> other host incorrectly pinging this port). Which application are you
> pointing at the ZK server's client port? Could this be an invalid
> monitoring request? (say someone trying to do a "stat" but spelling it
> wrong?)
>
> Patrick
>
> On Tue, Jan 17, 2012 at 5:00 PM, Alexius Ludeman <[EMAIL PROTECTED]>
> wrote:
> > hi,
> >
> > I am getting the error from all 5 zookeeperd, "Exception causing close of
> > session 0x0 due to java.io.IOException: Len error 1835955314" every
> > microsecond(?).
> >
> > I have a 5 node cluster on ubuntu maverick in aws. I've backported
> > zookeeperd and now am running 3.3.4+dfsg1-1. My apps are
> > using zookeeper-3.3.3.jar, but within the next 3-4 weeks I will be
> > upgrading to zookeeper-3.3.4.jar. This problem also existed with
> > zookeeperd on 3.3.3, in hopes of upgrading would solve my problem.
> >
> > I have stopped the whole world, rm -rf /var/lib/zookeeper and restarted
> > without any change to this log message. I have several other
> environments
> > without this error showing, same versions of client and server but only 3
> > zookeeperd, and much fewer clients.
> >
> > Our use of zookeeper is: appName is a key and the value is a server:port.
> > After the app reads in its required appName(s), it puts watches on these
> > appNames looking for changes. So we have a bunch of apps with many
> > watches. The client count is below.
> >
> > I would be grateful if anyone has some insight on how to debug further.
> >
> > thanks
> > lex
> >
> > zookeeper-0.p2:/var/log/zookeeper/zookeeper.log:
> >
> > 2012-01-17 22:23:59,097 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@251][] - Accepted socket
> > connection from /127.0.0.1:38653
> > 2012-01-17 22:23:59,097 - INFO [Thread-2309197:NIOServerCnxn@1435][] -
> > Closed socket connection for client /127.0.0.1:38652 (no session
> > established for client)
> > 2012-01-17 22:23:59,097 - WARN [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@639][] - Exception causing close of
> > session 0x0 due to java.io.IOException: Len error 1835955314
> > 2012-01-17 22:23:59,097 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1435][] - Closed socket connection
> for
> > client /127.0.0.1:38653 (no session established for client)
> > 2012-01-17 22:23:59,098 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@251][] - Accepted socket
> > connection from /127.0.0.1:38654
> > 2012-01-17 22:23:59,098 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1237][] - Processing stat command
> from /
> > 127.0.0.1:38654
> > 2012-01-17 22:23:59,098 - INFO
> > [Thread-2309198:NIOServerCnxn$StatCommand@1153][] - Stat command output
> > 2012-01-17 22:23:59,098 - INFO [Thread-2309198:NIOServerCnxn@1435][] -
> > Closed socket connection for client /127.0.0.1:38654 (no session
> > established for client)
> > 2012-01-17 22:23:59,098 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@251][] - Accepted socket
> > connection from /127.0.0.1:38655
> > 2012-01-17 22:23:59,099 - WARN [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@639][] - Exception causing close of
> > session 0x0 due to java.io.IOException: Len error 1835955314
> > 2012-01-17 22:23:59,099 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1435][] - Closed socket connection
> for
> > client /127.0.0.1:38655 (no session established for client)
> > 2012-01-17 22:23:59,099 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@251][] - Accepted socket
1835955314 = 6D6E7472 = 'mntr'
On Wed, Jan 18, 2012 at 2:00 AM, Patrick Hunt <[EMAIL PROTECTED]> wrote:
> Hi Alexius, it looks like localhost (127.0.0.1) is making a socket
> connection and then sending a request with a supposed size of 1.8GB.
> (the first 4 bytes of each zk request are the length)
>
> It's likely that this is a "4letterword" attempt gone wrong (or some
> other host incorrectly pinging this port). Which application are you
> pointing at the ZK server's client port? Could this be an invalid
> monitoring request? (say someone trying to do a "stat" but spelling it
> wrong?)
>
> Patrick
>
> On Tue, Jan 17, 2012 at 5:00 PM, Alexius Ludeman <[EMAIL PROTECTED]>
> wrote:
> > hi,
> >
> > I am getting the error from all 5 zookeeperd, "Exception causing close of
> > session 0x0 due to java.io.IOException: Len error 1835955314" every
> > microsecond(?).
> >
> > I have a 5 node cluster on ubuntu maverick in aws. I've backported
> > zookeeperd and now am running 3.3.4+dfsg1-1. My apps are
> > using zookeeper-3.3.3.jar, but within the next 3-4 weeks I will be
> > upgrading to zookeeper-3.3.4.jar. This problem also existed with
> > zookeeperd on 3.3.3, in hopes of upgrading would solve my problem.
> >
> > I have stopped the whole world, rm -rf /var/lib/zookeeper and restarted
> > without any change to this log message. I have several other
> environments
> > without this error showing, same versions of client and server but only 3
> > zookeeperd, and much fewer clients.
> >
> > Our use of zookeeper is: appName is a key and the value is a server:port.
> > After the app reads in its required appName(s), it puts watches on these
> > appNames looking for changes. So we have a bunch of apps with many
> > watches. The client count is below.
> >
> > I would be grateful if anyone has some insight on how to debug further.
> >
> > thanks
> > lex
> >
> > zookeeper-0.p2:/var/log/zookeeper/zookeeper.log:
> >
> > 2012-01-17 22:23:59,097 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@251][] - Accepted socket
> > connection from /127.0.0.1:38653
> > 2012-01-17 22:23:59,097 - INFO [Thread-2309197:NIOServerCnxn@1435][] -
> > Closed socket connection for client /127.0.0.1:38652 (no session
> > established for client)
> > 2012-01-17 22:23:59,097 - WARN [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@639][] - Exception causing close of
> > session 0x0 due to java.io.IOException: Len error 1835955314
> > 2012-01-17 22:23:59,097 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1435][] - Closed socket connection
> for
> > client /127.0.0.1:38653 (no session established for client)
> > 2012-01-17 22:23:59,098 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@251][] - Accepted socket
> > connection from /127.0.0.1:38654
> > 2012-01-17 22:23:59,098 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1237][] - Processing stat command
> from /
> > 127.0.0.1:38654
> > 2012-01-17 22:23:59,098 - INFO
> > [Thread-2309198:NIOServerCnxn$StatCommand@1153][] - Stat command output
> > 2012-01-17 22:23:59,098 - INFO [Thread-2309198:NIOServerCnxn@1435][] -
> > Closed socket connection for client /127.0.0.1:38654 (no session
> > established for client)
> > 2012-01-17 22:23:59,098 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@251][] - Accepted socket
> > connection from /127.0.0.1:38655
> > 2012-01-17 22:23:59,099 - WARN [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@639][] - Exception causing close of
> > session 0x0 due to java.io.IOException: Len error 1835955314
> > 2012-01-17 22:23:59,099 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1435][] - Closed socket connection
> for
> > client /127.0.0.1:38655 (no session established for client)
> > 2012-01-17 22:23:59,099 - INFO [NIOServerCxn.Factory:
> > 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@251][] - Accepted socket
