Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> clean up kafka environmet


Copy link to this message
-
Re: clean up kafka environmet
I think I found the answer:

http://mail-archives.apache.org/mod_mbox/incubator-kafka-users/201204.mbox/%3CCAFbh0Q3BxaAkyBq1_yUHhUkkhxX4RBQZPAA2pkR4U9+[EMAIL PROTECTED]%3E

As describe in the link above it should append only one time and after
parent was created the there are any exceptions occurred and that is
exactly how it happens in my situation.

Thanks
Oleg.
On Tue, Jul 23, 2013 at 12:54 PM, Oleg Ruchovets <[EMAIL PROTECTED]>wrote:

> Ok , got it , so the problem actually came from zookeeper. Can someone
> pointing me how can I clean up zookeeper to get rid of these messages.
>
> Thanks
> Oleg.
>
>
> On Tue, Jul 23, 2013 at 12:38 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:
>
>> These info messages show up when Kafka tries to create new consumer
>> groups.
>> While trying to create the children of /consumers/[group], if the parent
>> path doesn't exist, the zookeeper server logs these messages. Kafka
>> internally handles these cases correctly by first creating the parent
>> node.
>>
>> Thanks,
>> Neha
>>
>>
>> On Tue, Jul 23, 2013 at 9:36 AM, Neha Narkhede <[EMAIL PROTECTED]
>> >wrote:
>>
>> > If the console producer/consumer works fine, it would be safe to assume
>> > the broker is up.
>> >
>> > Thanks,
>> > Neha
>> >
>> >
>> > On Tue, Jul 23, 2013 at 8:44 AM, Oleg Ruchovets <[EMAIL PROTECTED]
>> >wrote:
>> >
>> >> Hi Jun ,
>> >>
>> >>    I made such tests:
>> >>       *bin/kafka-console-producer.sh --zookeeper localhost:2181 --topic
>> >> test
>> >> *
>> >>
>> >>         This is a message
>> >>         This is another message
>> >>
>> >>   *> bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic
>> >> test --from-beginning*
>> >>
>> >>         This is a message
>> >>         This is another message
>> >>
>> >>
>> >> and it works fine.
>> >>
>> >> Is there any other tests should I do to be sure that kafka broker works
>> >> fine?
>> >>
>> >>
>> >> Thanks
>> >>
>> >> Oleg.
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> On Tue, Jul 23, 2013 at 11:14 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
>> >>
>> >> > Those exception are ok since they are at the info level. Is the
>> broker
>> >> > running ok otherwise?
>> >> >
>> >> > Thanks,
>> >> >
>> >> > Jun
>> >> >
>> >> >
>> >> > On Tue, Jul 23, 2013 at 7:46 AM, Oleg Ruchovets <
>> [EMAIL PROTECTED]
>> >> > >wrote:
>> >> >
>> >> > > Hi All.
>> >> > >
>> >> > >    I have on one machine kafka installation. I needed to move it to
>> >> > another
>> >> > > machine and I copied  a kafka folder to that machine.
>> >> > >
>> >> > > when I started kafka in new machine I got such output:
>> >> > >
>> >> > > [2013-07-23 17:03:29,858] INFO Got user-level KeeperException when
>> >> > > processing sessionid:0x1400bd6e2960000 type:create cxid:0x1
>> >> > > zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
>> >> > Path:/brokers/ids
>> >> > > Error:KeeperErrorCode = NoNode for /brokers/ids
>> >> > > (org.apache.zookeeper.server.PrepRequestProcessor)
>> >> > > [2013-07-23 17:03:29,872] INFO Got user-level KeeperException when
>> >> > > processing sessionid:0x1400bd6e2960000 type:create cxid:0x2
>> >> > > zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
>> >> Path:/brokers
>> >> > > Error:KeeperErrorCode = NoNode for /brokers
>> >> > > (org.apache.zookeeper.server.PrepRequestProcessor)
>> >> > > [2013-07-23 17:03:29,886] INFO Registering broker /brokers/ids/0
>> >> > succeeded
>> >> > > with
>> >> > id:0,creatorId:172.31.202.2-1374588209838,host:172.31.202.2,port:9092
>> >> > > (kafka.server.KafkaZooKeeper)
>> >> > > [2013-07-23 17:03:29,907] INFO Starting log flusher every 1000 ms
>> with
>> >> > the
>> >> > > following overrides Map() (kafka.log.LogManager)
>> >> > > [2013-07-23 17:03:29,909] INFO Kafka server started.
>> >> > > (kafka.server.KafkaServer)
>> >> > > [2013-07-23 17:15:35,903] INFO Accepted socket connection from
>> >> > > /0:0:0:0:0:0:0:1:45710 (org.apache.zookeeper.server.NIOServerCnxn)
>> >> > > [2013-07-23 17:15:35,906] INFO Client attempting to establish new

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB