Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Re: Is the information at https://cwiki.apache.org/confluence/display/KAFKA/Operations up to date ?


+
Jun Rao 2013-04-19, 04:28
+
Eric Sites 2013-04-19, 04:37
Copy link to this message
-
Re: Is the information at https://cwiki.apache.org/confluence/display/KAFKA/Operations up to date ?
The reason is the console consumer deletes the previous state information
from zookeeper when given the from-beginning option. So effectively only
the 2nd consumer instance is alive. You can run ConsumerShell instead.

Thanks,
Neha

On Thursday, April 18, 2013, Eric Sites wrote:

> Jun,
>
> I have been trying to test 0.8 using two consumers on the same group ID.
>
> When I start the second consumer the first stops receiving messages.
>
> Can you help?
>
> Single Kafka server, single topic, 3 partitions, single Zookeeper.
>
> 1 console consumer running in one session.
>
> 1 console consumer running in another session.
>
> sudo /opt/kafka/bin/kafka-list-topic.sh --zookeeper localhost:2181
> topic: Files    partition: 0    leader: 0       replicas: 0     isr: 0
> topic: Files    partition: 1    leader: 0       replicas: 0     isr: 0
> topic: Files    partition: 2    leader: 0       replicas: 0     isr: 0
>
> # Start the producer, and type some test messages
> sudo /opt/kafka/bin/kafka-console-producer.sh --broker-list localhost:9092
> --topic Files
>
> # Start first consumer
> sudo /opt/kafka/bin/kafka-console-consumer.sh --zookeeper localhost:2181
> --topic Files --from-beginning --group 1
>
> # Start the second consumer, type some more messages on the producer and
> only this consumer get the messages
> sudo /opt/kafka/bin/kafka-console-consumer.sh --zookeeper localhost:2181
> --topic Files --from-beginning --group 1
>
>
>
>
> Thanks,
> Eric
>
> On 4/19/13 12:28 AM, "Jun Rao" <[EMAIL PROTECTED] <javascript:;>> wrote:
>
> >We have been testing 0.8 at LinkedIn for some time. We plan to release an
> >0.8 beta version next week.
> >
> >Thanks,
> >
> >Jun
> >
> >
> >On Thu, Apr 18, 2013 at 12:29 PM, Itai Frenkel <[EMAIL PROTECTED]<javascript:;>
> >
> >wrote:
> >
> >> Hello,
> >>
> >> We're considering to use Kafka, and would like to know the Java/
> >> Scala/Kafka version combination in which it is being used in production.
> >> The wiki "Operations" page states that "We are running Kafka 0.7 right
> >>now
> >> but may move to trunk as we fix bugs."
> >>
> >> While I read here that 0.8 was scheduled to be in production in LinkedIn
> >> about a month ago.
> >>
> >>
> >>
> http://search-hadoop.com/m/4TaT4gjlc12/kafka+production+version&subj=Re+W
> >>hich+version+to+choose+gt+0+8+or+0+72
> >>
> >> Regards,
> >> Itai
> >>
>
>

 
+
Eric Sites 2013-04-19, 16:08
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB