Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> clean up kafka environmet


Copy link to this message
-
Re: clean up kafka environmet
Ok , got it , so the problem actually came from zookeeper. Can someone
pointing me how can I clean up zookeeper to get rid of these messages.

Thanks
Oleg.
On Tue, Jul 23, 2013 at 12:38 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:

> These info messages show up when Kafka tries to create new consumer groups.
> While trying to create the children of /consumers/[group], if the parent
> path doesn't exist, the zookeeper server logs these messages. Kafka
> internally handles these cases correctly by first creating the parent node.
>
> Thanks,
> Neha
>
>
> On Tue, Jul 23, 2013 at 9:36 AM, Neha Narkhede <[EMAIL PROTECTED]
> >wrote:
>
> > If the console producer/consumer works fine, it would be safe to assume
> > the broker is up.
> >
> > Thanks,
> > Neha
> >
> >
> > On Tue, Jul 23, 2013 at 8:44 AM, Oleg Ruchovets <[EMAIL PROTECTED]
> >wrote:
> >
> >> Hi Jun ,
> >>
> >>    I made such tests:
> >>       *bin/kafka-console-producer.sh --zookeeper localhost:2181 --topic
> >> test
> >> *
> >>
> >>         This is a message
> >>         This is another message
> >>
> >>   *> bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic
> >> test --from-beginning*
> >>
> >>         This is a message
> >>         This is another message
> >>
> >>
> >> and it works fine.
> >>
> >> Is there any other tests should I do to be sure that kafka broker works
> >> fine?
> >>
> >>
> >> Thanks
> >>
> >> Oleg.
> >>
> >>
> >>
> >>
> >>
> >>
> >> On Tue, Jul 23, 2013 at 11:14 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> >>
> >> > Those exception are ok since they are at the info level. Is the broker
> >> > running ok otherwise?
> >> >
> >> > Thanks,
> >> >
> >> > Jun
> >> >
> >> >
> >> > On Tue, Jul 23, 2013 at 7:46 AM, Oleg Ruchovets <[EMAIL PROTECTED]
> >> > >wrote:
> >> >
> >> > > Hi All.
> >> > >
> >> > >    I have on one machine kafka installation. I needed to move it to
> >> > another
> >> > > machine and I copied  a kafka folder to that machine.
> >> > >
> >> > > when I started kafka in new machine I got such output:
> >> > >
> >> > > [2013-07-23 17:03:29,858] INFO Got user-level KeeperException when
> >> > > processing sessionid:0x1400bd6e2960000 type:create cxid:0x1
> >> > > zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
> >> > Path:/brokers/ids
> >> > > Error:KeeperErrorCode = NoNode for /brokers/ids
> >> > > (org.apache.zookeeper.server.PrepRequestProcessor)
> >> > > [2013-07-23 17:03:29,872] INFO Got user-level KeeperException when
> >> > > processing sessionid:0x1400bd6e2960000 type:create cxid:0x2
> >> > > zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
> >> Path:/brokers
> >> > > Error:KeeperErrorCode = NoNode for /brokers
> >> > > (org.apache.zookeeper.server.PrepRequestProcessor)
> >> > > [2013-07-23 17:03:29,886] INFO Registering broker /brokers/ids/0
> >> > succeeded
> >> > > with
> >> > id:0,creatorId:172.31.202.2-1374588209838,host:172.31.202.2,port:9092
> >> > > (kafka.server.KafkaZooKeeper)
> >> > > [2013-07-23 17:03:29,907] INFO Starting log flusher every 1000 ms
> with
> >> > the
> >> > > following overrides Map() (kafka.log.LogManager)
> >> > > [2013-07-23 17:03:29,909] INFO Kafka server started.
> >> > > (kafka.server.KafkaServer)
> >> > > [2013-07-23 17:15:35,903] INFO Accepted socket connection from
> >> > > /0:0:0:0:0:0:0:1:45710 (org.apache.zookeeper.server.NIOServerCnxn)
> >> > > [2013-07-23 17:15:35,906] INFO Client attempting to establish new
> >> session
> >> > > at /0:0:0:0:0:0:0:1:45710
> (org.apache.zookeeper.server.NIOServerCnxn)
> >> > > [2013-07-23 17:15:35,909] INFO Established session 0x1400bd6e2960001
> >> with
> >> > > negotiated timeout 6000 for client /0:0:0:0:0:0:0:1:45710
> >> > > (org.apache.zookeeper.server.NIOServerCnxn)
> >> > > [2013-07-23 17:35:19,019] INFO Created log for 'topic1'-0
> >> > > (kafka.log.LogManager)
> >> > > [2013-07-23 17:35:19,023] INFO Begin registering broker topic
> >> > > /brokers/topics/topic1/0 with 1 partitions
> >> (kafka.server.KafkaZooKeeper)

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB