Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Producer/Consumer questions 0.7


Copy link to this message
-
Re: Producer/Consumer questions 0.7
On Thu, Aug 29, 2013 at 11:11 AM, Mark <[EMAIL PROTECTED]> wrote:

> Also, are the consumer offsets store in Kafka or Zookeeper?
>

Zookeeper.
>
> On Aug 29, 2013, at 11:09 AM, Mark <[EMAIL PROTECTED]> wrote:
>
> > 1) Should a producer be aware of which broker to write to or is this
> somehow managed by Kafka itself. For example, If I have 2 brokers with a
> configured partition size of 1 will my messages be written in a round-robin
> type of fashion to each broker or is this completed dependent on which
> broker the consume connects to?
> >
> > 2) Similar question goes for a writing to a topic that has multiple
> partitions. Are the writes randomly load-balanced between partitions or is
> this something the client needs to do?
> >
> > 3) If I have 1 topic with 1 partition and 2 brokers how does consuming
> messages work. For example, if my consumer connects to broker 1 how does it
> consume messages written to broker 2?
> >
> > Thanks
> >
>
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB