Hey, so before we even start on this release is there anything else we want
to-do before and to get infront of what we know we have seen before in the
last two releases?

I think there is one 0.7.1 ticket for the last release which is still on my
plate in regards to some documentation.

Happy to-do this release too, not a problem.  Learning from the last it
seems even before I tag to send this note out.

Also looking forward to-do the 0.8 release unless someone else wants to-do
it I am happy to volunteer.

I am going to be rolling 0.7.2 into production in the next day or so off of
the tag I create and then send email so between now and then send
thoughts/issues/comments/etc.

/*
Joe Stein
http://www.linkedin.com/in/charmalloc
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
*/

Joe,

I just committed KAFKA-379 to trunk. I am not aware of any other blocker
issues for 0.7. We should be able to do the 0.7.2 release now. Thanks again
for helping out on the release.

Jun

On Mon, Sep 17, 2012 at 7:13 PM, Joe Stein <[EMAIL PROTECTED]> wrote:

> Hey, so before we even start on this release is there anything else we want
> to-do before and to get infront of what we know we have seen before in the
> last two releases?
>
> I think there is one 0.7.1 ticket for the last release which is still on my
> plate in regards to some documentation.
>
> Happy to-do this release too, not a problem.  Learning from the last it
> seems even before I tag to send this note out.
>
> Also looking forward to-do the 0.8 release unless someone else wants to-do
> it I am happy to volunteer.
>
> I am going to be rolling 0.7.2 into production in the next day or so off of
> the tag I create and then send email so between now and then send
> thoughts/issues/comments/etc.
>
> /*
> Joe Stein
> http://www.linkedin.com/in/charmalloc
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> */
>

Any chance of merging this one in?
https://issues.apache.org/jira/browse/KAFKA-419
The PHP library currently in trunk won't work with Kafka 0.6 or 0.7+.

Summary of changes:
http://www.alberton.info/kafka_07_php_client_library.html

Thanks,
Lorenzo

On Tue, Sep 18, 2012 at 6:09 AM, Jun Rao <[EMAIL PROTECTED]> wrote:

> Joe,
>
> I just committed KAFKA-379 to trunk. I am not aware of any other blocker
> issues for 0.7. We should be able to do the 0.7.2 release now. Thanks again
> for helping out on the release.
>
> Jun
>
> On Mon, Sep 17, 2012 at 7:13 PM, Joe Stein <[EMAIL PROTECTED]> wrote:
>
> > Hey, so before we even start on this release is there anything else we
> want
> > to-do before and to get infront of what we know we have seen before in
> the
> > last two releases?
> >
> > I think there is one 0.7.1 ticket for the last release which is still on
> my
> > plate in regards to some documentation.
> >
> > Happy to-do this release too, not a problem.  Learning from the last it
> > seems even before I tag to send this note out.
> >
> > Also looking forward to-do the 0.8 release unless someone else wants
> to-do
> > it I am happy to volunteer.
> >
> > I am going to be rolling 0.7.2 into production in the next day or so off
> of
> > the tag I create and then send email so between now and then send
> > thoughts/issues/comments/etc.
> >
> > /*
> > Joe Stein
> > http://www.linkedin.com/in/charmalloc
> > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > */
> >
>

Lorenzo,

Thanks for bringing this up. So far, the non-java client support for Kafka
is not very good. One of the main problems is that the current set of
committers don't have the knowledge to cover all those languages that
people want to port. This makes it very hard for code review, release, as
well as support.

I'd like to propose the following going forward. In Apache svn, we only
support a java/scala and a C client (potentially can be used to build
clients in many other languages). We will commit to maintaining those
clients as we release new versions. For all other languages, the client
implementation can be hosted somewhere else (like github). We can link
those implementations to our wiki. However, the owner of those clients are
responsible for maintenance and support. This way, other non-java clients
can probably be supported better than the current model. Does this make
sense?

Thanks,

Jun
On Tue, Sep 18, 2012 at 2:19 AM, Lorenzo Alberton <[EMAIL PROTECTED]>wrote:

> Any chance of merging this one in?
> https://issues.apache.org/jira/browse/KAFKA-419
> The PHP library currently in trunk won't work with Kafka 0.6 or 0.7+.
>
> Summary of changes:
> http://www.alberton.info/kafka_07_php_client_library.html
>
> Thanks,
> Lorenzo
>
> On Tue, Sep 18, 2012 at 6:09 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
>
> > Joe,
> >
> > I just committed KAFKA-379 to trunk. I am not aware of any other blocker
> > issues for 0.7. We should be able to do the 0.7.2 release now. Thanks
> again
> > for helping out on the release.
> >
> > Jun
> >
> > On Mon, Sep 17, 2012 at 7:13 PM, Joe Stein <[EMAIL PROTECTED]> wrote:
> >
> > > Hey, so before we even start on this release is there anything else we
> > want
> > > to-do before and to get infront of what we know we have seen before in
> > the
> > > last two releases?
> > >
> > > I think there is one 0.7.1 ticket for the last release which is still
> on
> > my
> > > plate in regards to some documentation.
> > >
> > > Happy to-do this release too, not a problem.  Learning from the last it
> > > seems even before I tag to send this note out.
> > >
> > > Also looking forward to-do the 0.8 release unless someone else wants
> > to-do
> > > it I am happy to volunteer.
> > >
> > > I am going to be rolling 0.7.2 into production in the next day or so
> off
> > of
> > > the tag I create and then send email so between now and then send
> > > thoughts/issues/comments/etc.
> > >
> > > /*
> > > Joe Stein
> > > http://www.linkedin.com/in/charmalloc
> > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > */
> > >
> >
>

sounds good to me.

Thanks,
Lorenzo

On Tue, Sep 18, 2012 at 5:13 PM, Jun Rao <[EMAIL PROTECTED]> wrote:

> Lorenzo,
>
> Thanks for bringing this up. So far, the non-java client support for Kafka
> is not very good. One of the main problems is that the current set of
> committers don't have the knowledge to cover all those languages that
> people want to port. This makes it very hard for code review, release, as
> well as support.
>
> I'd like to propose the following going forward. In Apache svn, we only
> support a java/scala and a C client (potentially can be used to build
> clients in many other languages). We will commit to maintaining those
> clients as we release new versions. For all other languages, the client
> implementation can be hosted somewhere else (like github). We can link
> those implementations to our wiki. However, the owner of those clients are
> responsible for maintenance and support. This way, other non-java clients
> can probably be supported better than the current model. Does this make
> sense?
>
> Thanks,
>
> Jun
>
>
> On Tue, Sep 18, 2012 at 2:19 AM, Lorenzo Alberton <[EMAIL PROTECTED]
> >wrote:
>
> > Any chance of merging this one in?
> > https://issues.apache.org/jira/browse/KAFKA-419
> > The PHP library currently in trunk won't work with Kafka 0.6 or 0.7+.
> >
> > Summary of changes:
> > http://www.alberton.info/kafka_07_php_client_library.html
> >
> > Thanks,
> > Lorenzo
> >
> > On Tue, Sep 18, 2012 at 6:09 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> >
> > > Joe,
> > >
> > > I just committed KAFKA-379 to trunk. I am not aware of any other
> blocker
> > > issues for 0.7. We should be able to do the 0.7.2 release now. Thanks
> > again
> > > for helping out on the release.
> > >
> > > Jun
> > >
> > > On Mon, Sep 17, 2012 at 7:13 PM, Joe Stein <[EMAIL PROTECTED]> wrote:
> > >
> > > > Hey, so before we even start on this release is there anything else
> we
> > > want
> > > > to-do before and to get infront of what we know we have seen before
> in
> > > the
> > > > last two releases?
> > > >
> > > > I think there is one 0.7.1 ticket for the last release which is still
> > on
> > > my
> > > > plate in regards to some documentation.
> > > >
> > > > Happy to-do this release too, not a problem.  Learning from the last
> it
> > > > seems even before I tag to send this note out.
> > > >
> > > > Also looking forward to-do the 0.8 release unless someone else wants
> > > to-do
> > > > it I am happy to volunteer.
> > > >
> > > > I am going to be rolling 0.7.2 into production in the next day or so
> > off
> > > of
> > > > the tag I create and then send email so between now and then send
> > > > thoughts/issues/comments/etc.
> > > >
> > > > /*
> > > > Joe Stein
> > > > http://www.linkedin.com/in/charmalloc
> > > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > > */
> > > >
> > >
> >
>

2012/9/18 Jun Rao <[EMAIL PROTECTED]>
>
>
> I'd like to propose the following going forward. In Apache svn, we only
> support a java/scala and a C client (potentially can be used to build
>

You do mean a C++ client (kafka/clients/cpp), right? Or my search skills
have gone drastically south.
> those implementations to our wiki. However, the owner of those clients are
> responsible for maintenance and support. This way, other non-java clients
> can probably be supported better than the current model. Does this make
> sense?
>

Sounds like a plan.
Will you draft such a page on the wiki, creating a placeholder for the
available 3rd party client implementations for maintainers to fill in, or
should I?

Regards,
Magnus

>
> Thanks,
>
> Jun
>
>
> On Tue, Sep 18, 2012 at 2:19 AM, Lorenzo Alberton <[EMAIL PROTECTED]
> >wrote:
>
> > Any chance of merging this one in?
> > https://issues.apache.org/jira/browse/KAFKA-419
> > The PHP library currently in trunk won't work with Kafka 0.6 or 0.7+.
> >
> > Summary of changes:
> > http://www.alberton.info/kafka_07_php_client_library.html
> >
> > Thanks,
> > Lorenzo
> >
> > On Tue, Sep 18, 2012 at 6:09 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> >
> > > Joe,
> > >
> > > I just committed KAFKA-379 to trunk. I am not aware of any other
> blocker
> > > issues for 0.7. We should be able to do the 0.7.2 release now. Thanks
> > again
> > > for helping out on the release.
> > >
> > > Jun
> > >
> > > On Mon, Sep 17, 2012 at 7:13 PM, Joe Stein <[EMAIL PROTECTED]> wrote:
> > >
> > > > Hey, so before we even start on this release is there anything else
> we
> > > want
> > > > to-do before and to get infront of what we know we have seen before
> in
> > > the
> > > > last two releases?
> > > >
> > > > I think there is one 0.7.1 ticket for the last release which is still
> > on
> > > my
> > > > plate in regards to some documentation.
> > > >
> > > > Happy to-do this release too, not a problem.  Learning from the last
> it
> > > > seems even before I tag to send this note out.
> > > >
> > > > Also looking forward to-do the 0.8 release unless someone else wants
> > > to-do
> > > > it I am happy to volunteer.
> > > >
> > > > I am going to be rolling 0.7.2 into production in the next day or so
> > off
> > > of
> > > > the tag I create and then send email so between now and then send
> > > > thoughts/issues/comments/etc.
> > > >
> > > > /*
> > > > Joe Stein
> > > > http://www.linkedin.com/in/charmalloc
> > > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > > */
> > > >
> > >
> >
>

The c++ client in kafka/clients/cpp is another one we contributed, and
probably only works with the 0.05 release.
Please send me a link to the new wiki page when created, I'll update it
with the packages we maintain.

Thanks,

--
Lorenzo Alberton
Chief Tech Architect
DataSift, Inc.

@lorenzoalberton
On Wed, Sep 19, 2012 at 8:09 AM, Magnus Edenhill <[EMAIL PROTECTED]> wrote:

> 2012/9/18 Jun Rao <[EMAIL PROTECTED]>
> >
> >
> > I'd like to propose the following going forward. In Apache svn, we only
> > support a java/scala and a C client (potentially can be used to build
> >
>
> You do mean a C++ client (kafka/clients/cpp), right? Or my search skills
> have gone drastically south.
>
> > those implementations to our wiki. However, the owner of those clients
> are
> > responsible for maintenance and support. This way, other non-java clients
> > can probably be supported better than the current model. Does this make
> > sense?
> >
>
> Sounds like a plan.
> Will you draft such a page on the wiki, creating a placeholder for the
> available 3rd party client implementations for maintainers to fill in, or
> should I?
>
> Regards,
> Magnus
>
>
>
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Tue, Sep 18, 2012 at 2:19 AM, Lorenzo Alberton <[EMAIL PROTECTED]
> > >wrote:
> >
> > > Any chance of merging this one in?
> > > https://issues.apache.org/jira/browse/KAFKA-419
> > > The PHP library currently in trunk won't work with Kafka 0.6 or 0.7+.
> > >
> > > Summary of changes:
> > > http://www.alberton.info/kafka_07_php_client_library.html
> > >
> > > Thanks,
> > > Lorenzo
> > >
> > > On Tue, Sep 18, 2012 at 6:09 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> > >
> > > > Joe,
> > > >
> > > > I just committed KAFKA-379 to trunk. I am not aware of any other
> > blocker
> > > > issues for 0.7. We should be able to do the 0.7.2 release now. Thanks
> > > again
> > > > for helping out on the release.
> > > >
> > > > Jun
> > > >
> > > > On Mon, Sep 17, 2012 at 7:13 PM, Joe Stein <[EMAIL PROTECTED]>
> wrote:
> > > >
> > > > > Hey, so before we even start on this release is there anything else
> > we
> > > > want
> > > > > to-do before and to get infront of what we know we have seen before
> > in
> > > > the
> > > > > last two releases?
> > > > >
> > > > > I think there is one 0.7.1 ticket for the last release which is
> still
> > > on
> > > > my
> > > > > plate in regards to some documentation.
> > > > >
> > > > > Happy to-do this release too, not a problem.  Learning from the
> last
> > it
> > > > > seems even before I tag to send this note out.
> > > > >
> > > > > Also looking forward to-do the 0.8 release unless someone else
> wants
> > > > to-do
> > > > > it I am happy to volunteer.
> > > > >
> > > > > I am going to be rolling 0.7.2 into production in the next day or
> so
> > > off
> > > > of
> > > > > the tag I create and then send email so between now and then send
> > > > > thoughts/issues/comments/etc.
> > > > >
> > > > > /*
> > > > > Joe Stein
> > > > > http://www.linkedin.com/in/charmalloc
> > > > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > > > */
> > > > >
> > > >
> > >
> >
>

Well, in 0.8, there is significant wire protocol change. So we have to
almost do a complete new one. It can be a C version or a C++ version. Does
it matter much?

Thanks,

Jun

On Wed, Sep 19, 2012 at 12:09 AM, Magnus Edenhill <[EMAIL PROTECTED]>wrote:

> 2012/9/18 Jun Rao <[EMAIL PROTECTED]>
> >
> >
> > I'd like to propose the following going forward. In Apache svn, we only
> > support a java/scala and a C client (potentially can be used to build
> >
>
> You do mean a C++ client (kafka/clients/cpp), right? Or my search skills
> have gone drastically south.
>
>
> > those implementations to our wiki. However, the owner of those clients
> are
> > responsible for maintenance and support. This way, other non-java clients
> > can probably be supported better than the current model. Does this make
> > sense?
> >
>
> Sounds like a plan.
> Will you draft such a page on the wiki, creating a placeholder for the
> available 3rd party client implementations for maintainers to fill in, or
> should I?
>
> Regards,
> Magnus
>
>
>
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Tue, Sep 18, 2012 at 2:19 AM, Lorenzo Alberton <[EMAIL PROTECTED]
> > >wrote:
> >
> > > Any chance of merging this one in?
> > > https://issues.apache.org/jira/browse/KAFKA-419
> > > The PHP library currently in trunk won't work with Kafka 0.6 or 0.7+.
> > >
> > > Summary of changes:
> > > http://www.alberton.info/kafka_07_php_client_library.html
> > >
> > > Thanks,
> > > Lorenzo
> > >
> > > On Tue, Sep 18, 2012 at 6:09 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> > >
> > > > Joe,
> > > >
> > > > I just committed KAFKA-379 to trunk. I am not aware of any other
> > blocker
> > > > issues for 0.7. We should be able to do the 0.7.2 release now. Thanks
> > > again
> > > > for helping out on the release.
> > > >
> > > > Jun
> > > >
> > > > On Mon, Sep 17, 2012 at 7:13 PM, Joe Stein <[EMAIL PROTECTED]>
> wrote:
> > > >
> > > > > Hey, so before we even start on this release is there anything else
> > we
> > > > want
> > > > > to-do before and to get infront of what we know we have seen before
> > in
> > > > the
> > > > > last two releases?
> > > > >
> > > > > I think there is one 0.7.1 ticket for the last release which is
> still
> > > on
> > > > my
> > > > > plate in regards to some documentation.
> > > > >
> > > > > Happy to-do this release too, not a problem.  Learning from the
> last
> > it
> > > > > seems even before I tag to send this note out.
> > > > >
> > > > > Also looking forward to-do the 0.8 release unless someone else
> wants
> > > > to-do
> > > > > it I am happy to volunteer.
> > > > >
> > > > > I am going to be rolling 0.7.2 into production in the next day or
> so
> > > off
> > > > of
> > > > > the tag I create and then send email so between now and then send
> > > > > thoughts/issues/comments/etc.
> > > > >
> > > > > /*
> > > > > Joe Stein
> > > > > http://www.linkedin.com/in/charmalloc
> > > > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > > > */
> > > > >
> > > >
> > >
> >
>

I created the following wiki as the place holder for non-java clients. Feel
free to add links there.

https://cwiki.apache.org/confluence/display/KAFKA/Kafka+non-java+clients

Thanks,

Jun
On Wed, Sep 19, 2012 at 12:09 AM, Magnus Edenhill <[EMAIL PROTECTED]>wrote:

> 2012/9/18 Jun Rao <[EMAIL PROTECTED]>
> >
> >
> > I'd like to propose the following going forward. In Apache svn, we only
> > support a java/scala and a C client (potentially can be used to build
> >
>
> You do mean a C++ client (kafka/clients/cpp), right? Or my search skills
> have gone drastically south.
>
>
> > those implementations to our wiki. However, the owner of those clients
> are
> > responsible for maintenance and support. This way, other non-java clients
> > can probably be supported better than the current model. Does this make
> > sense?
> >
>
> Sounds like a plan.
> Will you draft such a page on the wiki, creating a placeholder for the
> available 3rd party client implementations for maintainers to fill in, or
> should I?
>
> Regards,
> Magnus
>
>
>
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Tue, Sep 18, 2012 at 2:19 AM, Lorenzo Alberton <[EMAIL PROTECTED]
> > >wrote:
> >
> > > Any chance of merging this one in?
> > > https://issues.apache.org/jira/browse/KAFKA-419
> > > The PHP library currently in trunk won't work with Kafka 0.6 or 0.7+.
> > >
> > > Summary of changes:
> > > http://www.alberton.info/kafka_07_php_client_library.html
> > >
> > > Thanks,
> > > Lorenzo
> > >
> > > On Tue, Sep 18, 2012 at 6:09 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> > >
> > > > Joe,
> > > >
> > > > I just committed KAFKA-379 to trunk. I am not aware of any other
> > blocker
> > > > issues for 0.7. We should be able to do the 0.7.2 release now. Thanks
> > > again
> > > > for helping out on the release.
> > > >
> > > > Jun
> > > >
> > > > On Mon, Sep 17, 2012 at 7:13 PM, Joe Stein <[EMAIL PROTECTED]>
> wrote:
> > > >
> > > > > Hey, so before we even start on this release is there anything else
> > we
> > > > want
> > > > > to-do before and to get infront of what we know we have seen before
> > in
> > > > the
> > > > > last two releases?
> > > > >
> > > > > I think there is one 0.7.1 ticket for the last release which is
> still
> > > on
> > > > my
> > > > > plate in regards to some documentation.
> > > > >
> > > > > Happy to-do this release too, not a problem.  Learning from the
> last
> > it
> > > > > seems even before I tag to send this note out.
> > > > >
> > > > > Also looking forward to-do the 0.8 release unless someone else
> wants
> > > > to-do
> > > > > it I am happy to volunteer.
> > > > >
> > > > > I am going to be rolling 0.7.2 into production in the next day or
> so
> > > off
> > > > of
> > > > > the tag I create and then send email so between now and then send
> > > > > thoughts/issues/comments/etc.
> > > > >
> > > > > /*
> > > > > Joe Stein
> > > > > http://www.linkedin.com/in/charmalloc
> > > > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > > > */
> > > > >
> > > >
> > >
> >
>