Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Can't start Kafka server with 0.8.0.


Copy link to this message
-
Can't start Kafka server with 0.8.0.
Jason Huang 2013-01-07, 19:57
Hello,

I am trying out Kafka 0.8 using only one broker and I am unable to
start the server.

With the instruction from this link -
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+0.8+Quick+Start,
I was able to download and install 0.8.  Since I only have one
machine, I did the following configuration change:

(1) Comment out the JMX_PORT setting in the script bin/kafka-server-start.sh
(2) Keep config/server.properties as:
brokerid=0
port=9092
log.dir=/tmp/kafka-logs

Then I was able to start zookeeper as: bin/zookeeper-server-start.sh
config/zookeeper.properties

However, when I started broker as: bin/kafka-server-start.sh
config/server.properties, I got the following error (sorry for the
long paste):

2013-01-07 14:47:24,251] INFO [Kafka Server 0], starting
(kafka.server.KafkaServer)
[2013-01-07 14:47:24,276] INFO [Log Manager on Broker 0] Starting log
cleaner every 60000 ms (kafka.log.LogManager)
[2013-01-07 14:47:24,283] INFO [Log Manager on Broker 0] Starting log
flusher every 1000 ms with the following overrides Map()
(kafka.log.LogManager)
[2013-01-07 14:47:24,306] INFO Awaiting socket connections on
0.0.0.0:9092. (kafka.network.Acceptor)
[2013-01-07 14:47:24,307] INFO [Socket Server on Broker 0], started
(kafka.network.SocketServer)
[2013-01-07 14:47:24,313] INFO connecting to ZK: localhost:2181
(kafka.server.KafkaZooKeeper)
[2013-01-07 14:47:24,321] INFO Starting ZkClient event thread.
(org.I0Itec.zkclient.ZkEventThread)
[2013-01-07 14:47:24,327] INFO Client
environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47
GMT (org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client
environment:host.name=kafka.icare.com (org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client
environment:java.version=1.6.0_24 (org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client environment:java.vendor=Sun
Microsystems Inc. (org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client
environment:java.home=/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client
environment:java.class.path=:./bin/../project/boot/scala-2.8.0/lib/scala-compiler.jar:./bin/../project/boot/scala-2.8.0/lib/scala-library.jar:./bin/../core/target/scala_2.8.0/kafka-0.8.0.jar:./bin/../core/target/scala_2.8.0/kafka-0.8.0-test.jar:./bin/../core/lib/metrics-annotation-3.0.0-c0c8be71.jar:./bin/../core/lib/metrics-core-3.0.0-c0c8be71.jar:./bin/../core/lib/zkclient-20120522.jar:./bin/../perf/target/scala_2.8.0/kafka-perf-0.8.0.jar:./bin/../core/lib_managed/scala_2.8.0/compile/jopt-simple-3.2.jar:./bin/../core/lib_managed/scala_2.8.0/compile/log4j-1.2.15.jar:./bin/../core/lib_managed/scala_2.8.0/compile/slf4j-api-1.7.2.jar:./bin/../core/lib_managed/scala_2.8.0/compile/slf4j-simple-1.7.2.jar:./bin/../core/lib_managed/scala_2.8.0/compile/snappy-java-1.0.4.1.jar:./bin/../core/lib_managed/scala_2.8.0/compile/zookeeper-3.3.4.jar
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client
environment:java.library.path=/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/amd64:/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client environment:java.io.tmpdir=/tmp
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client environment:java.compiler=<NA>
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client environment:os.name=Linux
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client environment:os.arch=amd64
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client
environment:os.version=2.6.32-279.14.1.el6.x86_64
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client environment:user.name=root
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,327] INFO Client environment:user.home=/root
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,328] INFO Client
environment:user.dir=/opt/kafka-0.8.0 (org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,328] INFO Initiating client connection,
connectString=localhost:2181 sessionTimeout=6000
watcher=org.I0Itec.zkclient.ZkClient@bdee400
(org.apache.zookeeper.ZooKeeper)
[2013-01-07 14:47:24,338] INFO Opening socket connection to server
localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
[2013-01-07 14:47:24,341] INFO Socket connection established to
localhost/127.0.0.1:2181, initiating session
(org.apache.zookeeper.ClientCnxn)
[2013-01-07 14:47:24,410] INFO Session establishment complete on
server localhost/127.0.0.1:2181, sessionid = 0x13c168d69920000,
negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2013-01-07 14:47:24,412] INFO zookeeper state changed (SyncConnected)
(org.I0Itec.zkclient.ZkClient)
[2013-01-07 14:47:24,430] INFO Registered broker 0 at path
/brokers/ids/0 with address kafka.icare.com:9092.
(kafka.utils.ZkUtils$)
[2013-01-07 14:47:24,431] INFO [Kafka Server 0], Connecting to ZK:
localhost:2181 (kafka.server.KafkaServer)
[2013-01-07 14:47:24,473] INFO [ControllerEpochListener on 0]:
Initialized controller epoch to 1579 and zk version 1578
(kafka.controller.ControllerEpochListener)
[2013-01-07 14:47:24,516] INFO Will not load MX4J, mx4j-tools.jar is
not in the classpath (kafka.utils.Mx4jLoader$)
[2013-01-07 14:47:24,517] INFO [Controller 0]: Controller starting up
(kafka.controller.KafkaController)
[2013-01-07 14:47:24,524] INFO 0 successfully elected as leader
(kafka.server.ZookeeperLeaderElector)
[2013-01-07 14:47:24,525] INFO [Controller 0]: Broker 0 starting
become controller state transition (kafka.controller.KafkaController)
[2013-01-07 14:47:24,530] INFO Conditional update of zkPath
/controllerEpoch with value 1580 and expected version 1578 succeeded,
returning the new version: 1579 (kafka.utils.ZkUtils$)
[2013-01-07 14:47:24,531]