Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - How to create the initial zookeeper chroot path for zk.connect?


+
Ryan Chan 2013-04-17, 16:30
+
Neha Narkhede 2013-04-17, 17:30
+
Ryan Chan 2013-04-18, 03:03
+
Neha Narkhede 2013-04-18, 21:32
+
Ryan Chan 2013-04-19, 05:47
Copy link to this message
-
Re: How to create the initial zookeeper chroot path for zk.connect?
Jonathan Creasy 2013-04-19, 05:51
I made the patch to create the chroot and it doesn't handle multiple zk
addresses.

We fixed it but I guess that patch didn't get submitted. I will make a
ticket here to get that done.
On Apr 18, 2013 10:47 PM, "Ryan Chan" <[EMAIL PROTECTED]> wrote:

> Yes, using the latest Kafka 0.7.2, just tried to reproduce again
>
> 1. Install a single node Kafka, three nodes zookeeper instances
>
>     kafka1
>     zookeeper1
>     zookeeper2
>     zookeeper3
>
> 2. Using a simple Kafka config, able to start without error in the log
>
>     brokerid=1
>     log.dir=/data/kafka
>     zk.connect=zookeeper1:2181,zookeeper2:2181,zookeeper3:2181
>
> 3. Now, create a path in zookeeper1
>
>     zkCli.sh -server zookeeper1:2181
>
>         ls /
>         [consumers, brokers, zookeeper]
>         create /testkafka ''
>         ls /
>         [testkafka, consumers, brokers, zookeeper]
>
> Quit & Done.
>
> 4. Verify from zookeeper2
>
>     zkCli.sh -server zookeeper2:2181
>         ls /
>         [testkafka, consumers, brokers, zookeeper]
>
> Seems ok
>
> 4. Update kafka config and restart
>
>
>
> zk.connect=zookeeper1:2181/testkafka,zookeeper2:2181/testkafka,zookeeper3:2181/testkafka
>
> Restart and have the error
>
> [2013-04-19 05:35:14,846] FATAL Fatal error during KafkaServerStable
> startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> java.lang.IllegalArgumentException: Path length must be > 0
> at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:48)
> at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:35)
> ..
>
>
> Any idea?
>
>
>
>
> On Fri, Apr 19, 2013 at 5:32 AM, Neha Narkhede <[EMAIL PROTECTED]
> >wrote:
>
> > That is odd. Is it reproducible ?
> >
> > On Wed, Apr 17, 2013 at 8:03 PM, Ryan Chan <[EMAIL PROTECTED]>
> wrote:
> > > Hi,
> > >
> > > Yes, I can see the new path exists by using the command "ls /"
> > >
> > >
> > >
> > > On Thu, Apr 18, 2013 at 1:29 AM, Neha Narkhede <
> [EMAIL PROTECTED]
> > >wrote:
> > >
> > >> After creating the path, did you get a chance to confirm that it got
> > >> created correctly ?
> > >>
> > >> Thanks,
> > >> Neha
> > >>
> > >> On Wed, Apr 17, 2013 at 9:30 AM, Ryan Chan <[EMAIL PROTECTED]>
> > wrote:
> > >> > Sorry as I am new to Kafka/ZK, but the instruction seems not clear..
> > >> >
> > >> > In the config, it was said that we can use a chroot-ed ZK (
> > >> > http://kafka.apache.org/configuration.html), e.g.
> > localhost:2181/kafka
> > >> >
> > >> > But when I start the Kafka using the setting, it was showing..
> > >> >
> > >> > java.lang.IllegalArgumentException: Path length must be > 0
> > >> > at
> > org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:48)
> > >> > at
> > org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:35)
> > >> > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:626)
> > >> > at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
> > >> > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
> > >> > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
> > >> > at
> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
> > >> > at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
> > >> > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:213)
> > >> > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:223)
> > >> > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:223)
> > >> > at kafka.utils.ZkUtils$.createParentPath(ZkUtils.scala:47)
> > >> > at kafka.utils.ZkUtils$.createEphemeralPath(ZkUtils.scala:59)
> > >> > at
> > >>
> kafka.utils.ZkUtils$.createEphemeralPathExpectConflict(ZkUtils.scala:71)
> > >> > at
> > >>
> kafka.server.KafkaZooKeeper.registerBrokerInZk(KafkaZooKeeper.scala:54)
> > >> > at kafka.log.LogManager.startup(LogManager.scala:130)
> > >> > at kafka.server.KafkaServer.startup(KafkaServer.scala:81)
> > >> > at
> > >>
> kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:34)

 
+
Neha Narkhede 2013-04-19, 16:08
+
Ryan Chan 2013-04-20, 03:55
+
Neha Narkhede 2013-04-20, 05:03
+
Ryan Chan 2013-04-20, 09:24
+
Neha Narkhede 2013-04-20, 16:03
+
Scott Clasen 2013-04-20, 18:30
+
Ryan Chan 2013-04-21, 08:34
+
Scott Clasen 2013-04-21, 15:11
+
Ryan Chan 2013-04-22, 13:46
+
Jason Rosenberg 2013-05-08, 23:31
+
Jason Rosenberg 2013-05-08, 23:38
+
Jun Rao 2013-05-09, 04:28