Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - clean up kafka environmet


+
Oleg Ruchovets 2013-07-23, 14:47
+
Jun Rao 2013-07-23, 15:14
+
Oleg Ruchovets 2013-07-23, 15:45
+
Oleg Ruchovets 2013-07-23, 16:35
+
Neha Narkhede 2013-07-23, 16:36
+
Neha Narkhede 2013-07-23, 16:39
Copy link to this message
-
Re: clean up kafka environmet
Oleg Ruchovets 2013-07-23, 16:54
Ok , got it , so the problem actually came from zookeeper. Can someone
pointing me how can I clean up zookeeper to get rid of these messages.

Thanks
Oleg.
On Tue, Jul 23, 2013 at 12:38 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:

> These info messages show up when Kafka tries to create new consumer groups.
> While trying to create the children of /consumers/[group], if the parent
> path doesn't exist, the zookeeper server logs these messages. Kafka
> internally handles these cases correctly by first creating the parent node.
>
> Thanks,
> Neha
>
>
> On Tue, Jul 23, 2013 at 9:36 AM, Neha Narkhede <[EMAIL PROTECTED]
> >wrote:
>
> > If the console producer/consumer works fine, it would be safe to assume
> > the broker is up.
> >
> > Thanks,
> > Neha
> >
> >
> > On Tue, Jul 23, 2013 at 8:44 AM, Oleg Ruchovets <[EMAIL PROTECTED]
> >wrote:
> >
> >> Hi Jun ,
> >>
> >>    I made such tests:
> >>       *bin/kafka-console-producer.sh --zookeeper localhost:2181 --topic
> >> test
> >> *
> >>
> >>         This is a message
> >>         This is another message
> >>
> >>   *> bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic
> >> test --from-beginning*
> >>
> >>         This is a message
> >>         This is another message
> >>
> >>
> >> and it works fine.
> >>
> >> Is there any other tests should I do to be sure that kafka broker works
> >> fine?
> >>
> >>
> >> Thanks
> >>
> >> Oleg.
> >>
> >>
> >>
> >>
> >>
> >>
> >> On Tue, Jul 23, 2013 at 11:14 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> >>
> >> > Those exception are ok since they are at the info level. Is the broker
> >> > running ok otherwise?
> >> >
> >> > Thanks,
> >> >
> >> > Jun
> >> >
> >> >
> >> > On Tue, Jul 23, 2013 at 7:46 AM, Oleg Ruchovets <[EMAIL PROTECTED]
> >> > >wrote:
> >> >
> >> > > Hi All.
> >> > >
> >> > >    I have on one machine kafka installation. I needed to move it to
> >> > another
> >> > > machine and I copied  a kafka folder to that machine.
> >> > >
> >> > > when I started kafka in new machine I got such output:
> >> > >
> >> > > [2013-07-23 17:03:29,858] INFO Got user-level KeeperException when
> >> > > processing sessionid:0x1400bd6e2960000 type:create cxid:0x1
> >> > > zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
> >> > Path:/brokers/ids
> >> > > Error:KeeperErrorCode = NoNode for /brokers/ids
> >> > > (org.apache.zookeeper.server.PrepRequestProcessor)
> >> > > [2013-07-23 17:03:29,872] INFO Got user-level KeeperException when
> >> > > processing sessionid:0x1400bd6e2960000 type:create cxid:0x2
> >> > > zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
> >> Path:/brokers
> >> > > Error:KeeperErrorCode = NoNode for /brokers
> >> > > (org.apache.zookeeper.server.PrepRequestProcessor)
> >> > > [2013-07-23 17:03:29,886] INFO Registering broker /brokers/ids/0
> >> > succeeded
> >> > > with
> >> > id:0,creatorId:172.31.202.2-1374588209838,host:172.31.202.2,port:9092
> >> > > (kafka.server.KafkaZooKeeper)
> >> > > [2013-07-23 17:03:29,907] INFO Starting log flusher every 1000 ms
> with
> >> > the
> >> > > following overrides Map() (kafka.log.LogManager)
> >> > > [2013-07-23 17:03:29,909] INFO Kafka server started.
> >> > > (kafka.server.KafkaServer)
> >> > > [2013-07-23 17:15:35,903] INFO Accepted socket connection from
> >> > > /0:0:0:0:0:0:0:1:45710 (org.apache.zookeeper.server.NIOServerCnxn)
> >> > > [2013-07-23 17:15:35,906] INFO Client attempting to establish new
> >> session
> >> > > at /0:0:0:0:0:0:0:1:45710
> (org.apache.zookeeper.server.NIOServerCnxn)
> >> > > [2013-07-23 17:15:35,909] INFO Established session 0x1400bd6e2960001
> >> with
> >> > > negotiated timeout 6000 for client /0:0:0:0:0:0:0:1:45710
> >> > > (org.apache.zookeeper.server.NIOServerCnxn)
> >> > > [2013-07-23 17:35:19,019] INFO Created log for 'topic1'-0
> >> > > (kafka.log.LogManager)
> >> > > [2013-07-23 17:35:19,023] INFO Begin registering broker topic
> >> > > /brokers/topics/topic1/0 with 1 partitions
> >> (kafka.server.KafkaZooKeeper)

 
+
Oleg Ruchovets 2013-07-23, 17:27