Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - How to create the initial zookeeper chroot path for zk.connect?


+
Ryan Chan 2013-04-17, 16:30
+
Neha Narkhede 2013-04-17, 17:30
+
Ryan Chan 2013-04-18, 03:03
+
Neha Narkhede 2013-04-18, 21:32
Copy link to this message
-
Re: How to create the initial zookeeper chroot path for zk.connect?
Ryan Chan 2013-04-19, 05:47
Yes, using the latest Kafka 0.7.2, just tried to reproduce again

1. Install a single node Kafka, three nodes zookeeper instances

    kafka1
    zookeeper1
    zookeeper2
    zookeeper3

2. Using a simple Kafka config, able to start without error in the log

    brokerid=1
    log.dir=/data/kafka
    zk.connect=zookeeper1:2181,zookeeper2:2181,zookeeper3:2181

3. Now, create a path in zookeeper1

    zkCli.sh -server zookeeper1:2181

        ls /
        [consumers, brokers, zookeeper]
        create /testkafka ''
        ls /
        [testkafka, consumers, brokers, zookeeper]

Quit & Done.

4. Verify from zookeeper2

    zkCli.sh -server zookeeper2:2181
        ls /
        [testkafka, consumers, brokers, zookeeper]

Seems ok

4. Update kafka config and restart
zk.connect=zookeeper1:2181/testkafka,zookeeper2:2181/testkafka,zookeeper3:2181/testkafka

Restart and have the error

[2013-04-19 05:35:14,846] FATAL Fatal error during KafkaServerStable
startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
java.lang.IllegalArgumentException: Path length must be > 0
at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:48)
at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:35)
..
Any idea?
On Fri, Apr 19, 2013 at 5:32 AM, Neha Narkhede <[EMAIL PROTECTED]>wrote:

> That is odd. Is it reproducible ?
>
> On Wed, Apr 17, 2013 at 8:03 PM, Ryan Chan <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > Yes, I can see the new path exists by using the command "ls /"
> >
> >
> >
> > On Thu, Apr 18, 2013 at 1:29 AM, Neha Narkhede <[EMAIL PROTECTED]
> >wrote:
> >
> >> After creating the path, did you get a chance to confirm that it got
> >> created correctly ?
> >>
> >> Thanks,
> >> Neha
> >>
> >> On Wed, Apr 17, 2013 at 9:30 AM, Ryan Chan <[EMAIL PROTECTED]>
> wrote:
> >> > Sorry as I am new to Kafka/ZK, but the instruction seems not clear..
> >> >
> >> > In the config, it was said that we can use a chroot-ed ZK (
> >> > http://kafka.apache.org/configuration.html), e.g.
> localhost:2181/kafka
> >> >
> >> > But when I start the Kafka using the setting, it was showing..
> >> >
> >> > java.lang.IllegalArgumentException: Path length must be > 0
> >> > at
> org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:48)
> >> > at
> org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:35)
> >> > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:626)
> >> > at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
> >> > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
> >> > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
> >> > at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
> >> > at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
> >> > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:213)
> >> > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:223)
> >> > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:223)
> >> > at kafka.utils.ZkUtils$.createParentPath(ZkUtils.scala:47)
> >> > at kafka.utils.ZkUtils$.createEphemeralPath(ZkUtils.scala:59)
> >> > at
> >> kafka.utils.ZkUtils$.createEphemeralPathExpectConflict(ZkUtils.scala:71)
> >> > at
> >> kafka.server.KafkaZooKeeper.registerBrokerInZk(KafkaZooKeeper.scala:54)
> >> > at kafka.log.LogManager.startup(LogManager.scala:130)
> >> > at kafka.server.KafkaServer.startup(KafkaServer.scala:81)
> >> > at
> >> kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:34)
> >> > at kafka.Kafka$.main(Kafka.scala:47)
> >> > at kafka.Kafka.main(Kafka.scala)
> >> >
> >> > In an old post (
> >> >
> >>
> http://mail-archives.apache.org/mod_mbox/incubator-kafka-users/201205.mbox/%3CCAK152briB=M-OaeaQtCz+[EMAIL PROTECTED]%3E
> >> )
> >> > it was saying I need to create the path first, so I use zkCli.sh to
> >> connect
> >> > to the ZK, and run the command
> >> >
> >> >>> create /kafka ''
> >> >
> >
 
+
Jonathan Creasy 2013-04-19, 05:51
+
Neha Narkhede 2013-04-19, 16:08
+
Ryan Chan 2013-04-20, 03:55
+
Neha Narkhede 2013-04-20, 05:03
+
Ryan Chan 2013-04-20, 09:24
+
Neha Narkhede 2013-04-20, 16:03
+
Scott Clasen 2013-04-20, 18:30
+
Ryan Chan 2013-04-21, 08:34
+
Scott Clasen 2013-04-21, 15:11
+
Ryan Chan 2013-04-22, 13:46
+
Jason Rosenberg 2013-05-08, 23:31
+
Jason Rosenberg 2013-05-08, 23:38
+
Jun Rao 2013-05-09, 04:28