Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - How to register newly created kafka broker to the producer immeditely


+
Bae, Jae Hyeon 2012-11-02, 22:15
+
Jun Rao 2012-11-05, 17:24
+
Bae, Jae Hyeon 2012-11-08, 17:37
Copy link to this message
-
Re: How to register newly created kafka broker to the producer immeditely
Jun Rao 2012-11-08, 17:57
Manually create the log directory on the broker and restart broker will
work too.

Thanks,

Jun

On Thu, Nov 8, 2012 at 9:37 AM, Bae, Jae Hyeon <[EMAIL PROTECTED]> wrote:

> Thanks a lot Jun
>
> What if I can't touch producer side?
>
> On Mon, Nov 5, 2012 at 9:24 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> > This is a known bug in 0.7. See the discussion in
> >
> > http://apache.markmail.org/thread/c7tdalfketpusqkg
> >
> >
> > This issue will be addressed in 0.8. For now, you have to manually create
> > the topic on the new brokers (e.g., by sending some data to the new
> > broker directly).
> >
> > Thanks,
> >
> > Jun
> >
> > On Fri, Nov 2, 2012 at 3:15 PM, Bae, Jae Hyeon <[EMAIL PROTECTED]>
> wrote:
> >
> >> Hi
> >>
> >> In the case that I like to add more kafka brokers to distribute the
> >> traffic, I am seeing producer cannot recognize the newly created
> >> brokers. When I look at the code, the producer can update its broker
> >> partition info only when brokerInfoOpt is empty.
> >>
> >> So, how can I make new brokers to be registered in the produce right
> >> away? In other words, how can I make new brokers to register in all
> >> topics and updateInfo in producer side?
> >>
> >> Thank you
> >> Best, Jae
> >>
>