Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Zookeeper >> mail # dev >> ephemeral node not deleted after client session closed


Copy link to this message
-
Re: ephemeral node not deleted after client session closed
To answer the remaining client-side questions -

>>  Do you have multiple threads sharing a session?
No

>> Q: what are you clients doing? It's weird that a create would come
from the client after the session has been closed.

Here are the client side logs. It seems like the client session kept timing
out.

2011/11/08 11:46:13.423 INFO [ClientCnxn]
[main-SendThread(app27.stg:12913)] [kafka] Client session timed out, have
not heard from server in 4000ms for sessionid 0x43220b966ee3930, closing
socket connection and attempting reconnect
2011/11/08 11:46:13.523 INFO [ZkClient] [main-EventThread] [kafka]
zookeeper state changed (Disconnected)2011/11/08 11:46:13.562 INFO
[ClientCnxn] [main-SendThread(app27.stg:12913)] [kafka] Opening socket
connection to server esv4-app30.stg/172.18.98.90:129
132011/11/08 11:46:13.563 INFO [ClientCnxn]
[main-SendThread(app30.stg:12913)] [kafka] Socket connection established to
esv4-app30.stg/172.18.98.90:12913,
 initiating session2011/11/08 11:46:14.173 INFO [ClientCnxn]
[main-SendThread(app30.stg:12913)] [kafka] Unable to reconnect to ZooKeeper
service, session 0x43220b966ee3930
 has expired, closing socket connection2011/11/08 11:46:14.195 INFO
[ZkClient] [main-EventThread] [kafka] zookeeper state changed (Expired)
2011/11/08 11:46:14.195 INFO [ZooKeeper] [main-EventThread] [kafka]
Initiating client connection,
connectString=app27.stg:12913,esv4-app28.stg:12913,esv4-app29.stg:12913,esv4-app30.stg:12913/kafka-tracking
sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@679a9d19
2011/11/08 11:46:14.263 INFO [ClientCnxn] [main-SendThread()] [kafka]
Opening socket connection to server
app28.stg/172.18.98.101:129132011/11/0811:46:14.263 INFO
[KafkaZooKeeper]
[ZkClient-EventThread-495-esv4-app27.stg:12913,esv4-app28.stg:12913,esv4-app29.stg:12913,esv4-app30.stg:12913/k
afka-tracking] [kafka] re-registering broker info in ZK for broker
5282011/11/08 11:46:14.263 INFO [ClientCnxn] [main-EventThread] [kafka]
EventThread shut down
2011/11/08 11:46:14.263 INFO [KafkaZooKeeper]
[ZkClient-EventThread-495-app27.stg:12913,esv4-app28.stg:12913,esv4-app29.stg:12913,esv4-app30.stg:12913/kafka-tracking]
[kafka] Registering broker /brokers/ids/528
2011/11/08 11:46:14.264 INFO [ClientCnxn]
[main-SendThread(app28.stg:12913)] [kafka] Socket connection established to
esv4-app28.stg/172.18.98.101:12913, initiating session
2011/11/08 11:46:15.764 INFO [ClientCnxn]
[main-SendThread(app28.stg:12913)] [kafka] Client session timed out, have
not heard from server in 1500ms for sessionid 0x0, closing socket
connection and attempting reconnect
2011/11/08 11:46:16.448 INFO [ClientCnxn]
[main-SendThread(app28.stg:12913)] [kafka] Opening socket connection to
server esv4-app29.stg/172.18.98.89:12913
2011/11/08 11:46:16.448 INFO [ClientCnxn]
[main-SendThread(app29.stg:12913)] [kafka] Socket connection established to
esv4-app29.stg/172.18.98.89:12913, initiating session
2011/11/08 11:46:17.948 INFO [ClientCnxn]
[main-SendThread(app29.stg:12913)] [kafka] Client session timed out, have
not heard from server in 1500ms for sessionid 0x0, closing socket
connection and attempting reconnect
2011/11/08 11:46:18.168 INFO [ClientCnxn]
[main-SendThread(app29.stg:12913)] [kafka] Opening socket connection to
server esv4-app30.stg/172.18.98.90:12913
2011/11/08 11:46:18.169 INFO [ClientCnxn]
[main-SendThread(app30.stg:12913)] [kafka] Socket connection established to
esv4-app30.stg/172.18.98.90:12913, initiating session
2011/11/08 11:46:19.669 INFO [ClientCnxn]
[main-SendThread(app30.stg:12913)] [kafka] Client session timed out, have
not heard from server in 1500ms for sessionid 0x0, closing socket
connection and attempting reconnect
2011/11/08 11:46:20.042 INFO [ClientCnxn]
[main-SendThread(app30.stg:12913)] [kafka] Opening socket connection to
server esv4-app27.stg/172.18.98.88:12913
2011/11/08 11:46:20.042 INFO [ClientCnxn]
[main-SendThread(app27.stg:12913)] [kafka] Socket connection established to
esv4-app27.stg/172.18.98.88:12913, initiating session
2011/11/08 11:46:21.543 INFO [ClientCnxn]
[main-SendThread(app27.stg:12913)] [kafka] Client session timed out, have
not heard from server in 1501ms for sessionid 0x0, closing socket
connection and attempting reconnect
2011/11/08 11:46:21.841 INFO [ClientCnxn]
[main-SendThread(app27.stg:12913)] [kafka] Opening socket connection to
server esv4-app28.stg/172.18.98.101:12913
2011/11/08 11:46:21.842 INFO [ClientCnxn]
[main-SendThread(app28.stg:12913)] [kafka] Socket connection established to
esv4-app28.stg/172.18.98.101:12913, initiating session
2011/11/08 11:46:23.343 INFO [ClientCnxn]
[main-SendThread(app28.stg:12913)] [kafka] Client session timed out, have
not heard from server in 1501ms for sessionid 0x0, closing socket
connection and attempting reconnect
2011/11/08 11:46:23.984 INFO [ClientCnxn]
[main-SendThread(app28.stg:12913)] [kafka] Opening socket connection to
server esv4-app29.stg/172.18.98.89:12913
2011/11/08 11:46:23.985 INFO [ClientCnxn]
[main-SendThread(app29.stg:12913)] [kafka] Socket connection established to
esv4-app29.stg/172.18.98.89:12913, initiating session
2011/11/08 11:46:25.486 INFO [ClientCnxn]
[main-SendThread(app29.stg:12913)] [kafka] Client session timed out, have
not heard from server in 1501ms for sessionid 0x0, closing socket
connection and attempting reconnect
2011/11/08 11:46:25.637 INFO [ClientCnxn]
[main-SendThread(app29.stg:12913)] [kafka] Opening socket connection to
server esv4-app30.stg/172.18.98.90:12913
2011/11/08 11:46:25.637 INFO [ClientCnxn]
[main-SendThread(app30.stg:12913)] [kafka] Socket connection established to
esv4-app30.stg/172.18.98.90:12913, initiating session
2011/11/08 11:46:26.065 INFO [ClientCnxn]
[main-SendThread(app30.stg:12913)] [kafka] Session establishment complete
on server esv4-app30.stg/172.18.98.90:12913, sessionid = 0x43220b966ee394a,
negotiated timeout = 6000
2011/11/08 11:46:26.066 INFO [ZkClient] [main-EventThread] [kafka]
zookeeper state changed (SyncConnected)

I will attach our conversat
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB