Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> zokeeper.connect no longer available on producer?

Nicolae Marasoiu 2013-09-27, 14:16
Copy link to this message
Re: zokeeper.connect no longer available on producer?
Yes, the zk option is no longer available in the producer in 0.8 to
simplify the logic in the client. Load balancing in the producer is still
supported though.

I am not sure what you mean by "blocking async" producer. The producer has
an async mode, but then the send() calls are not blocking. The expected
behavior is that if all brokers are down, all sends will fail. However,
when the brokers are up again, sends will succeed again. There is no need
to close the producer in between. Is that not what you are seeing?


On Fri, Sep 27, 2013 at 7:15 AM, Nicolae Marasoiu <[EMAIL PROTECTED]>wrote:

> Hi,
> We have a blocking async producer.
> We noticed:
>  1.  when the metadata brokers are down, the client no longer attempts to
> reconnect to any of them.
>  2.  zookeeper.connect is no longer recognized as a valid configuration,
> hinting that in fact the zookeeper balancing is no longer supported on
> producing?
> The net effect is that producer.close() immediately returns while kafka
> cluster is down. Our expectation is to remain waiting until some nodes go
> up and try to send the data.
> I know that in 0.7.x this was the behaviour, based on zookeeper
> whitelisting, balancing and watching.
> Please advice,
> Nicu Marasoiu, Adobe

Nicolae Marasoiu 2013-09-27, 15:13
Jun Rao 2013-09-27, 15:31