Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - ZooKeeper connect/disconnect pattern


Copy link to this message
-
Re: ZooKeeper connect/disconnect pattern
Tom Amon 2014-03-27, 22:07
**** From the controller log ****
[2014-03-25 12:22:39,487] INFO [ControllerEpochListener on 2]: Initialized
controller epoch to

11 and zk version 10 (kafka.controller.ControllerEpochListener)

[2014-03-25 12:22:39,519] INFO [Controller 2]: Controller starting up
(kafka.controller.KafkaCo

ntroller)

[2014-03-25 12:22:39,777] INFO [Controller 2]: Controller startup complete
(kafka.controller.Ka

fkaController)

[2014-03-25 19:47:59,198] INFO [ControllerEpochListener on 2]: Initialized
controller epoch to

11 and zk version 10 (kafka.controller.ControllerEpochListener)

[2014-03-25 19:47:59,230] INFO [Controller 2]: Controller starting up
(kafka.controller.KafkaCo

ntroller)

[2014-03-25 19:47:59,379] INFO [Controller 2]: Controller startup complete
(kafka.controller.Ka

fkaController)

[2014-03-25 21:39:50,115] INFO [ControllerEpochListener on 2]: Initialized
controller epoch to

12 and zk version 11 (kafka.controller.ControllerEpochListener)

[2014-03-25 21:59:18,020] INFO [Controller 2]: Broker 2 starting become
controller state transi

tion (kafka.controller.KafkaController)

[2014-03-25 21:59:18,032] INFO [Controller 2]: Controller 2 incremented
epoch to 13 (kafka.controller.KafkaController)

[2014-03-25 21:59:21,888] INFO [Controller-2-to-broker-2-send-thread],
Starting  (kafka.controller.RequestSendThread)

[2014-03-25 21:59:21,895] INFO [Controller-2-to-broker-3-send-thread],
Starting  (kafka.controller.RequestSendThread)

[2014-03-25 21:59:21,895] INFO [Controller-2-to-broker-4-send-thread],
Starting  (kafka.controller.RequestSendThread)

[2014-03-25 21:59:21,895] INFO [Controller-2-to-broker-5-send-thread],
Starting  (kafka.controller.RequestSendThread)

[2014-03-25 21:59:21,898] INFO [Controller 2]: Currently active brokers in
the cluster: Set(2,3, 4, 5) (kafka.controller.KafkaController)

[2014-03-25 21:59:21,899] INFO [Controller 2]: Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController)

[2014-03-25 21:59:21,899] INFO [Controller 2]: Current list of topics in
the cluster: Set(optimizer-error-topic, optimizer-default-topic,
metrics-tracker-audit) (kafka.controller.KafkaController)

**** From the root log ****

[2014-03-25 12:21:58,848] INFO Client session timed out, have not heard
from server in 4001ms f
or sessionid 0x54441e4dae0350a, closing socket connection and attempting
reconnect (org.apache.zookeeper.ClientCnxn)
[2014-03-25 12:21:58,948] INFO zookeeper state changed (Disconnected)
(org.I0Itec.zkclient.ZkClient)
[2014-03-25 12:21:59,136] INFO Opening socket connection to server
slc5b01c-e48f.stratus.slc.com/10.120.104.37:2181(org.apache.zookeeper.ClientCnxn)
[2014-03-25 12:21:59,136] ERROR Unable to open socket to
slc5b01c-e48f.stratus.slc.com/10.
120.104.37:2181 (org.apache.zookeeper.ClientCnxn)
[2014-03-25 12:21:59,137] WARN Session 0x54441e4dae0350a for server null,
unexpected error, closing socket connection and attempting reconnect
(org.apache.zookeeper.ClientCnxn)
java.net.SocketException: Network is unreachable
        at sun.nio.ch.Net.connect(Native Method)
        at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:525)
        at
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1068)
        at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[2014-03-25 12:21:59,450] INFO Opening socket connection to server
slc5b01c-ef64.stratus.slc.com/10.120.108.36:2181(org.apache.zookeeper.ClientCnxn)
[2014-03-25 12:21:59,450] ERROR Unable to open socket to
slc5b01c-ef64.stratus.slc.com/10.
120.108.36:2181 (org.apache.zookeeper.ClientCnxn)
[2014-03-25 12:21:59,450] WARN Session 0x54441e4dae0350a for server null,
unexpected error, closing socket connection and attempting reconnect
(org.apache.zookeeper.ClientCnxn)
java.net.SocketException: Network is unreachable
        at sun.nio.ch.Net.connect(Native Method)
        at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:525)
        at
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1068)
        at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[2014-03-25 12:21:59,827] INFO Opening socket connection to server
slc5b01c-4593.stratus.slc.com/10.120.132.36:2181(org.apache.zookeeper.ClientCnxn)
[2014-03-25 12:21:59,828] ERROR Unable to open socket to
slc5b01c-4593.stratus.slc.com/10.
120.132.36:2181 (org.apache.zookeeper.ClientCnxn)
[2014-03-25 12:21:59,828] WARN Session 0x54441e4dae0350a for server null,
unexpected error, closing socket connection and attempting reconnect
(org.apache.zookeeper.ClientCnxn)
java.net.SocketException: Network is unreachable
        at sun.nio.ch.Net.connect(Native Method)
        at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:525)
        at
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1068)
        at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[2014-03-25 12:22:38,950] INFO Starting ZkClient event thread.
(org.I0Itec.zkclient.ZkEventThre
ad)
[2014-03-25 12:22:39,071] INFO Client
environment:zookeeper.version=3.3.6-1366786, built on 07/29/2012 06:22 GMT
(org.apache.zookeeper.ZooKeeper)
[2014-03-25 12:22:39,071] INFO Client environment:host.name=
slc5b01c-7285.stratus.slc.com
(org.apache.zookeeper.ZooKeeper)
[2014-03-25 12:22:39,071] INFO Client environment:java.version=1.6.0_20
(org.apache.zookeeper.ZooKeeper)
[2014-03-25 12:22:39,071] INFO Client environment:java.vendor=Sun
Microsystems Inc. (org.apache.zookeeper.ZooKeeper)
[2014-03-25 12:22:39,071] INFO Client
environment:java.home=/usr/lib/jvm/java-1.6.0-openjdk-1.6
.0.0.x86_64/jre (org.apache.zookeeper.ZooKeeper)
[2014-03-25 12:22:39,071] INFO Client
environment:java.class.path=:/usr/local/kafka-0.8/bin/../
core/target/scala-2.8.0/*.jar:/usr/local/kafka-0.8/bin/../perf/target/scala-2.8.0/kafka*.jar:/u
sr/local/kafka-0.8/bin/../libs/jopt-simple-3.2.jar:/usr/local/kafka-0.8/bin/../libs/log4j-1.2.1
5.jar:/usr/local/kafka-0.8/bin/../libs/