|
Jun Rao
2012-01-04, 18:11
Joe Stein
2012-01-04, 18:19
Jun Rao
2012-01-04, 18:20
Jun Rao
2012-01-05, 19:11
Alan D. Cabrera
2012-01-06, 00:58
Jun Rao
2012-01-06, 01:22
Joe Stein
2012-01-06, 14:38
Jun Rao
2012-01-06, 16:31
Jun Rao
2012-01-06, 17:34
David Ormsbee
2012-01-06, 17:43
Joe Stein
2012-01-06, 18:08
Andrew Psaltis
2012-01-06, 18:52
Jun Rao
2012-01-06, 18:55
Prashanth Menon
2012-01-16, 19:42
Jun Rao
2012-01-16, 21:23
|
-
skype meeting on replication roadmapJun Rao 2012-01-04, 18:11
Hi,
We'd like have a meeting discussing the roadmap for replication (our 0.8 release) and how people can contribute. How about a Skype meeting at 2pm Jan 6 (Friday)? If you are interested, please send me your Skype id. Thanks, Jun
-
Re: skype meeting on replication roadmapJoe Stein 2012-01-04, 18:19
2pm what timezone? :) PST?
On Wed, Jan 4, 2012 at 1:11 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > Hi, > > We'd like have a meeting discussing the roadmap for replication (our 0.8 > release) and how people can contribute. How about a Skype meeting at 2pm > Jan 6 (Friday)? If you are interested, please send me your Skype id. > > Thanks, > > Jun > -- /* Joe Stein http://www.linkedin.com/in/charmalloc Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> */
-
Re: skype meeting on replication roadmapJun Rao 2012-01-04, 18:20
Clarification. 2pm is PST. Thanks Andrew for reminding me the geographical
diversity of the community. Jun On Wed, Jan 4, 2012 at 10:11 AM, Jun Rao <[EMAIL PROTECTED]> wrote: > Hi, > > We'd like have a meeting discussing the roadmap for replication (our 0.8 > release) and how people can contribute. How about a Skype meeting at 2pm > Jan 6 (Friday)? If you are interested, please send me your Skype id. > > Thanks, > > Jun >
-
Re: skype meeting on replication roadmapJun Rao 2012-01-05, 19:11
Hi, everyone,
So far, the following people have sent me their skype id: Joe, David, Jeffrey, and Andrew. So the meeting is on. I encourage everyone to look at the design doc in kafka-50 and the new wire format at https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore the meeting. Here is a breakdown of all the jiras and their dependencies related to the replication work: 1. kafka-47: create/delete data structures in ZK, automatically create topic, and use them (making partitions logical, supporting only 1 replica, no failure support). (L1) 1.1 kafka-237: create/delete ZK path for a topic in an admin tool (L0) 1.2 kafka-238: add a getTopicMetaData method in broker and expose it to producer 1.3 kafka-239: Wire existing producer and consumer to use the new ZK data structure 2. kafka-202: decouple request handler and socket sever; enabling long poll in the consumer (L1) 3. kafka-240: implement new producer and consumer request format (L1) 4. kafka-49: add ack to ProduceRequest (L2). depending on #3 5. kafka-48: long poll in consumer (L2). depending on #2 6. kafka-44: commit thread, replica fetcher thread (L3). depending on #1, #4, #5 7. kafka-45: broker starting up, leader election (L3). depending on #1 8. kafka-46: various ZK listeners (L3). depending on #1 9. kafka-43: move master to preferred replica when possible (L4). optimization 10. kafka-42: rebalance partition with new brokers (L4). extra feature Thanks, Jun On Wed, Jan 4, 2012 at 10:11 AM, Jun Rao <[EMAIL PROTECTED]> wrote: > Hi, > > We'd like have a meeting discussing the roadmap for replication (our 0.8 > release) and how people can contribute. How about a Skype meeting at 2pm > Jan 6 (Friday)? If you are interested, please send me your Skype id. > > Thanks, > > Jun >
-
Re: skype meeting on replication roadmapAlan D. Cabrera 2012-01-06, 00:58
I need to point out my personal understanding of the parameters of a conference call meeting. Conference calls can be useful to facilitate design discussions though their use is not encouraged at ASF. It's important that participants understand and abide by the following guidelines:
- while consensus can be built at the call no final decision can be made - meeting minutes are posted to the mailing lists - an adequate effort is made to give the larger community the ability to participate in a meaningful way after the call Regards, Alan On Jan 5, 2012, at 11:11 AM, Jun Rao wrote: > Hi, everyone, > > So far, the following people have sent me their skype id: > > Joe, David, Jeffrey, and Andrew. > > So the meeting is on. I encourage everyone to look at the design doc in > kafka-50 and the new wire format at > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > the meeting. > > Here is a breakdown of all the jiras and their dependencies related to the > replication work: > > 1. kafka-47: create/delete data structures in ZK, automatically create > topic, and use them (making partitions logical, supporting only 1 replica, > no failure support). (L1) > 1.1 kafka-237: create/delete ZK path for a topic in an admin tool (L0) > 1.2 kafka-238: add a getTopicMetaData method in broker and expose it to > producer > 1.3 kafka-239: Wire existing producer and consumer to use the new ZK data > structure > 2. kafka-202: decouple request handler and socket sever; enabling long poll > in the consumer (L1) > 3. kafka-240: implement new producer and consumer request format (L1) > 4. kafka-49: add ack to ProduceRequest (L2). depending on #3 > 5. kafka-48: long poll in consumer (L2). depending on #2 > 6. kafka-44: commit thread, replica fetcher thread (L3). depending on #1, > #4, #5 > 7. kafka-45: broker starting up, leader election (L3). depending on #1 > 8. kafka-46: various ZK listeners (L3). depending on #1 > 9. kafka-43: move master to preferred replica when possible (L4). > optimization > 10. kafka-42: rebalance partition with new brokers (L4). extra feature > > Thanks, > > Jun > > On Wed, Jan 4, 2012 at 10:11 AM, Jun Rao <[EMAIL PROTECTED]> wrote: > >> Hi, >> >> We'd like have a meeting discussing the roadmap for replication (our 0.8 >> release) and how people can contribute. How about a Skype meeting at 2pm >> Jan 6 (Friday)? If you are interested, please send me your Skype id. >> >> Thanks, >> >> Jun >>
-
Re: skype meeting on replication roadmapJun Rao 2012-01-06, 01:22
Alan,
This is fair. The purpose of the meeting is to explain the jiras related to replication and how people can help. I will post meeting minutes after the call. Thanks, Jun On Thu, Jan 5, 2012 at 4:57 PM, Alan D. Cabrera <[EMAIL PROTECTED]> wrote: > I need to point out my personal understanding of the parameters of a > conference call meeting. Conference calls can be useful to facilitate > design discussions though their use is not encouraged at ASF. It's > important that participants understand and abide by the following > guidelines: > > - while consensus can be built at the call no final decision can be made > - meeting minutes are posted to the mailing lists > - an adequate effort is made to give the larger community the ability to > participate in a meaningful way after the call > > > Regards, > Alan > > On Jan 5, 2012, at 11:11 AM, Jun Rao wrote: > > > Hi, everyone, > > > > So far, the following people have sent me their skype id: > > > > Joe, David, Jeffrey, and Andrew. > > > > So the meeting is on. I encourage everyone to look at the design doc in > > kafka-50 and the new wire format at > > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > > the meeting. > > > > Here is a breakdown of all the jiras and their dependencies related to > the > > replication work: > > > > 1. kafka-47: create/delete data structures in ZK, automatically create > > topic, and use them (making partitions logical, supporting only 1 > replica, > > no failure support). (L1) > > 1.1 kafka-237: create/delete ZK path for a topic in an admin tool (L0) > > 1.2 kafka-238: add a getTopicMetaData method in broker and expose it to > > producer > > 1.3 kafka-239: Wire existing producer and consumer to use the new ZK > data > > structure > > 2. kafka-202: decouple request handler and socket sever; enabling long > poll > > in the consumer (L1) > > 3. kafka-240: implement new producer and consumer request format (L1) > > 4. kafka-49: add ack to ProduceRequest (L2). depending on #3 > > 5. kafka-48: long poll in consumer (L2). depending on #2 > > 6. kafka-44: commit thread, replica fetcher thread (L3). depending on #1, > > #4, #5 > > 7. kafka-45: broker starting up, leader election (L3). depending on #1 > > 8. kafka-46: various ZK listeners (L3). depending on #1 > > 9. kafka-43: move master to preferred replica when possible (L4). > > optimization > > 10. kafka-42: rebalance partition with new brokers (L4). extra feature > > > > Thanks, > > > > Jun > > > > On Wed, Jan 4, 2012 at 10:11 AM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > >> Hi, > >> > >> We'd like have a meeting discussing the roadmap for replication (our 0.8 > >> release) and how people can contribute. How about a Skype meeting at 2pm > >> Jan 6 (Friday)? If you are interested, please send me your Skype id. > >> > >> Thanks, > >> > >> Jun > >> > >
-
Re: skype meeting on replication roadmapJoe Stein 2012-01-06, 14:38
so it looks like i need to take my son to a birthday party tonight (my babe
daughter is sick wife has to stay home with her) if there is any chance to move this to Monday? (sorry) if not I understand either way let me know On Thu, Jan 5, 2012 at 2:11 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > Hi, everyone, > > So far, the following people have sent me their skype id: > > Joe, David, Jeffrey, and Andrew. > > So the meeting is on. I encourage everyone to look at the design doc in > kafka-50 and the new wire format at > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > the meeting. > > Here is a breakdown of all the jiras and their dependencies related to the > replication work: > > 1. kafka-47: create/delete data structures in ZK, automatically create > topic, and use them (making partitions logical, supporting only 1 replica, > no failure support). (L1) > 1.1 kafka-237: create/delete ZK path for a topic in an admin tool (L0) > 1.2 kafka-238: add a getTopicMetaData method in broker and expose it to > producer > 1.3 kafka-239: Wire existing producer and consumer to use the new ZK data > structure > 2. kafka-202: decouple request handler and socket sever; enabling long poll > in the consumer (L1) > 3. kafka-240: implement new producer and consumer request format (L1) > 4. kafka-49: add ack to ProduceRequest (L2). depending on #3 > 5. kafka-48: long poll in consumer (L2). depending on #2 > 6. kafka-44: commit thread, replica fetcher thread (L3). depending on #1, > #4, #5 > 7. kafka-45: broker starting up, leader election (L3). depending on #1 > 8. kafka-46: various ZK listeners (L3). depending on #1 > 9. kafka-43: move master to preferred replica when possible (L4). > optimization > 10. kafka-42: rebalance partition with new brokers (L4). extra feature > > Thanks, > > Jun > > On Wed, Jan 4, 2012 at 10:11 AM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > Hi, > > > > We'd like have a meeting discussing the roadmap for replication (our 0.8 > > release) and how people can contribute. How about a Skype meeting at 2pm > > Jan 6 (Friday)? If you are interested, please send me your Skype id. > > > > Thanks, > > > > Jun > > > -- /* Joe Stein http://www.linkedin.com/in/charmalloc Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> */
-
Re: skype meeting on replication roadmapJun Rao 2012-01-06, 16:31
Joe,
I am ok with moving the meeting to Monday. If nobody objects, how about we meet at 2pm PST Monday (Jan 9) instead? This actually will give people a bit more time to read the docs and wiki. Jun On Fri, Jan 6, 2012 at 6:38 AM, Joe Stein <[EMAIL PROTECTED]> wrote: > so it looks like i need to take my son to a birthday party tonight (my babe > daughter is sick wife has to stay home with her) > > if there is any chance to move this to Monday? (sorry) if not I understand > either way let me know > > On Thu, Jan 5, 2012 at 2:11 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > Hi, everyone, > > > > So far, the following people have sent me their skype id: > > > > Joe, David, Jeffrey, and Andrew. > > > > So the meeting is on. I encourage everyone to look at the design doc in > > kafka-50 and the new wire format at > > > > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > > the meeting. > > > > Here is a breakdown of all the jiras and their dependencies related to > the > > replication work: > > > > 1. kafka-47: create/delete data structures in ZK, automatically create > > topic, and use them (making partitions logical, supporting only 1 > replica, > > no failure support). (L1) > > 1.1 kafka-237: create/delete ZK path for a topic in an admin tool (L0) > > 1.2 kafka-238: add a getTopicMetaData method in broker and expose it to > > producer > > 1.3 kafka-239: Wire existing producer and consumer to use the new ZK > data > > structure > > 2. kafka-202: decouple request handler and socket sever; enabling long > poll > > in the consumer (L1) > > 3. kafka-240: implement new producer and consumer request format (L1) > > 4. kafka-49: add ack to ProduceRequest (L2). depending on #3 > > 5. kafka-48: long poll in consumer (L2). depending on #2 > > 6. kafka-44: commit thread, replica fetcher thread (L3). depending on #1, > > #4, #5 > > 7. kafka-45: broker starting up, leader election (L3). depending on #1 > > 8. kafka-46: various ZK listeners (L3). depending on #1 > > 9. kafka-43: move master to preferred replica when possible (L4). > > optimization > > 10. kafka-42: rebalance partition with new brokers (L4). extra feature > > > > Thanks, > > > > Jun > > > > On Wed, Jan 4, 2012 at 10:11 AM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > > > Hi, > > > > > > We'd like have a meeting discussing the roadmap for replication (our > 0.8 > > > release) and how people can contribute. How about a Skype meeting at > 2pm > > > Jan 6 (Friday)? If you are interested, please send me your Skype id. > > > > > > Thanks, > > > > > > Jun > > > > > > > > > -- > > /* > Joe Stein > http://www.linkedin.com/in/charmalloc > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > */ >
-
Re: skype meeting on replication roadmapJun Rao 2012-01-06, 17:34
How about Tue (Jan 10) at 12 noon? Can everyone make that?
If not, another choice will be Tue (Jan 10) at 2:30pm PST. Jun On Fri, Jan 6, 2012 at 9:25 AM, Jeffrey Damick <[EMAIL PROTECTED]>wrote: > Any are fine with me too, if it was a little earlier than 2PM PST (5PM EST) > it would be better for me personally due to commuting constraints :) > > > > > On Fri, Jan 6, 2012 at 12:03 PM, Joe Stein <[EMAIL PROTECTED]> wrote: > > > check that Tuesday -> Friday work :) as long as we start 2pm PST > > > > On Fri, Jan 6, 2012 at 11:51 AM, Joe Stein <[EMAIL PROTECTED]> wrote: > > > > > Thursday or Friday would work best for me > > > > > > > > > On Fri, Jan 6, 2012 at 11:48 AM, Chris Burroughs < > > > [EMAIL PROTECTED]> wrote: > > > > > >> I agree it's best to be patient and find a time that works for > everyone > > >> who wants to participate. In my particular case I can do Friday, or > > >> Tuesday-->Friday next week, but not Monday the 9th. > > >> > > >> On 01/06/2012 11:31 AM, Jun Rao wrote: > > >> > Joe, > > >> > > > >> > I am ok with moving the meeting to Monday. If nobody objects, how > > about > > >> we > > >> > meet at 2pm PST Monday (Jan 9) instead? This actually will give > > people a > > >> > bit more time to read the docs and wiki. > > >> > > > >> > Jun > > >> > > > >> > On Fri, Jan 6, 2012 at 6:38 AM, Joe Stein <[EMAIL PROTECTED]> > wrote: > > >> > > > >> >> so it looks like i need to take my son to a birthday party tonight > > (my > > >> babe > > >> >> daughter is sick wife has to stay home with her) > > >> >> > > >> >> if there is any chance to move this to Monday? (sorry) if not I > > >> understand > > >> >> either way let me know > > >> >> > > >> >> On Thu, Jan 5, 2012 at 2:11 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > > >> >> > > >> >>> Hi, everyone, > > >> >>> > > >> >>> So far, the following people have sent me their skype id: > > >> >>> > > >> >>> Joe, David, Jeffrey, and Andrew. > > >> >>> > > >> >>> So the meeting is on. I encourage everyone to look at the design > doc > > >> in > > >> >>> kafka-50 and the new wire format at > > >> >>> > > >> >>> > > >> >> > > >> > > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > > >> >>> the meeting. > > >> >>> > > >> >>> Here is a breakdown of all the jiras and their dependencies > related > > to > > >> >> the > > >> >>> replication work: > > >> >>> > > >> >>> 1. kafka-47: create/delete data structures in ZK, automatically > > create > > >> >>> topic, and use them (making partitions logical, supporting only 1 > > >> >> replica, > > >> >>> no failure support). (L1) > > >> >>> 1.1 kafka-237: create/delete ZK path for a topic in an admin tool > > >> (L0) > > >> >>> 1.2 kafka-238: add a getTopicMetaData method in broker and expose > > it > > >> to > > >> >>> producer > > >> >>> 1.3 kafka-239: Wire existing producer and consumer to use the new > > ZK > > >> >> data > > >> >>> structure > > >> >>> 2. kafka-202: decouple request handler and socket sever; enabling > > long > > >> >> poll > > >> >>> in the consumer (L1) > > >> >>> 3. kafka-240: implement new producer and consumer request format > > (L1) > > >> >>> 4. kafka-49: add ack to ProduceRequest (L2). depending on #3 > > >> >>> 5. kafka-48: long poll in consumer (L2). depending on #2 > > >> >>> 6. kafka-44: commit thread, replica fetcher thread (L3). depending > > on > > >> #1, > > >> >>> #4, #5 > > >> >>> 7. kafka-45: broker starting up, leader election (L3). depending > on > > #1 > > >> >>> 8. kafka-46: various ZK listeners (L3). depending on #1 > > >> >>> 9. kafka-43: move master to preferred replica when possible (L4). > > >> >>> optimization > > >> >>> 10. kafka-42: rebalance partition with new brokers (L4). extra > > feature > > >> >>> > > >> >>> Thanks, > > >> >>> > > >> >>> Jun > > >> >>> > > >> >>> On Wed, Jan 4, 2012 at 10:11 AM, Jun Rao <[EMAIL PROTECTED]> > wrote: > > >> >>> > > >> >>>> Hi, > > >> >>>> > > >> >>>> We'd like have a meeting discussing the roadmap for replication
-
Re: skype meeting on replication roadmapDavid Ormsbee 2012-01-06, 17:43
Either of those works great for me. In fact, any day next week works for
me, though my preference would be Monday, Tuesday, or Friday. Thank you. Dave On Fri, Jan 6, 2012 at 12:34 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > How about Tue (Jan 10) at 12 noon? Can everyone make that? > > If not, another choice will be Tue (Jan 10) at 2:30pm PST. > > Jun > > On Fri, Jan 6, 2012 at 9:25 AM, Jeffrey Damick <[EMAIL PROTECTED] > >wrote: > > > Any are fine with me too, if it was a little earlier than 2PM PST (5PM > EST) > > it would be better for me personally due to commuting constraints :) > > > > > > > > > > On Fri, Jan 6, 2012 at 12:03 PM, Joe Stein <[EMAIL PROTECTED]> wrote: > > > > > check that Tuesday -> Friday work :) as long as we start 2pm PST > > > > > > On Fri, Jan 6, 2012 at 11:51 AM, Joe Stein <[EMAIL PROTECTED]> wrote: > > > > > > > Thursday or Friday would work best for me > > > > > > > > > > > > On Fri, Jan 6, 2012 at 11:48 AM, Chris Burroughs < > > > > [EMAIL PROTECTED]> wrote: > > > > > > > >> I agree it's best to be patient and find a time that works for > > everyone > > > >> who wants to participate. In my particular case I can do Friday, or > > > >> Tuesday-->Friday next week, but not Monday the 9th. > > > >> > > > >> On 01/06/2012 11:31 AM, Jun Rao wrote: > > > >> > Joe, > > > >> > > > > >> > I am ok with moving the meeting to Monday. If nobody objects, how > > > about > > > >> we > > > >> > meet at 2pm PST Monday (Jan 9) instead? This actually will give > > > people a > > > >> > bit more time to read the docs and wiki. > > > >> > > > > >> > Jun > > > >> > > > > >> > On Fri, Jan 6, 2012 at 6:38 AM, Joe Stein <[EMAIL PROTECTED]> > > wrote: > > > >> > > > > >> >> so it looks like i need to take my son to a birthday party > tonight > > > (my > > > >> babe > > > >> >> daughter is sick wife has to stay home with her) > > > >> >> > > > >> >> if there is any chance to move this to Monday? (sorry) if not I > > > >> understand > > > >> >> either way let me know > > > >> >> > > > >> >> On Thu, Jan 5, 2012 at 2:11 PM, Jun Rao <[EMAIL PROTECTED]> > wrote: > > > >> >> > > > >> >>> Hi, everyone, > > > >> >>> > > > >> >>> So far, the following people have sent me their skype id: > > > >> >>> > > > >> >>> Joe, David, Jeffrey, and Andrew. > > > >> >>> > > > >> >>> So the meeting is on. I encourage everyone to look at the design > > doc > > > >> in > > > >> >>> kafka-50 and the new wire format at > > > >> >>> > > > >> >>> > > > >> >> > > > >> > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > > > >> >>> the meeting. > > > >> >>> > > > >> >>> Here is a breakdown of all the jiras and their dependencies > > related > > > to > > > >> >> the > > > >> >>> replication work: > > > >> >>> > > > >> >>> 1. kafka-47: create/delete data structures in ZK, automatically > > > create > > > >> >>> topic, and use them (making partitions logical, supporting only > 1 > > > >> >> replica, > > > >> >>> no failure support). (L1) > > > >> >>> 1.1 kafka-237: create/delete ZK path for a topic in an admin > tool > > > >> (L0) > > > >> >>> 1.2 kafka-238: add a getTopicMetaData method in broker and > expose > > > it > > > >> to > > > >> >>> producer > > > >> >>> 1.3 kafka-239: Wire existing producer and consumer to use the > new > > > ZK > > > >> >> data > > > >> >>> structure > > > >> >>> 2. kafka-202: decouple request handler and socket sever; > enabling > > > long > > > >> >> poll > > > >> >>> in the consumer (L1) > > > >> >>> 3. kafka-240: implement new producer and consumer request format > > > (L1) > > > >> >>> 4. kafka-49: add ack to ProduceRequest (L2). depending on #3 > > > >> >>> 5. kafka-48: long poll in consumer (L2). depending on #2 > > > >> >>> 6. kafka-44: commit thread, replica fetcher thread (L3). > depending > > > on > > > >> #1, > > > >> >>> #4, #5 > > > >> >>> 7. kafka-45: broker starting up, leader election (L3). depending > > on > > > #1 > > > >> >>> 8. kafka-46: various ZK listeners (L3). depending on #1
-
Re: skype meeting on replication roadmapJoe Stein 2012-01-06, 18:08
Tue (Jan 10) at 12 noon PST works for me, so does the other time if this is
not good for others On Fri, Jan 6, 2012 at 12:43 PM, David Ormsbee <[EMAIL PROTECTED]> wrote: > Either of those works great for me. In fact, any day next week works for > me, though my preference would be Monday, Tuesday, or Friday. > > Thank you. > > Dave > > On Fri, Jan 6, 2012 at 12:34 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > How about Tue (Jan 10) at 12 noon? Can everyone make that? > > > > If not, another choice will be Tue (Jan 10) at 2:30pm PST. > > > > Jun > > > > On Fri, Jan 6, 2012 at 9:25 AM, Jeffrey Damick <[EMAIL PROTECTED] > > >wrote: > > > > > Any are fine with me too, if it was a little earlier than 2PM PST (5PM > > EST) > > > it would be better for me personally due to commuting constraints :) > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 12:03 PM, Joe Stein <[EMAIL PROTECTED]> wrote: > > > > > > > check that Tuesday -> Friday work :) as long as we start 2pm PST > > > > > > > > On Fri, Jan 6, 2012 at 11:51 AM, Joe Stein <[EMAIL PROTECTED]> > wrote: > > > > > > > > > Thursday or Friday would work best for me > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 11:48 AM, Chris Burroughs < > > > > > [EMAIL PROTECTED]> wrote: > > > > > > > > > >> I agree it's best to be patient and find a time that works for > > > everyone > > > > >> who wants to participate. In my particular case I can do Friday, > or > > > > >> Tuesday-->Friday next week, but not Monday the 9th. > > > > >> > > > > >> On 01/06/2012 11:31 AM, Jun Rao wrote: > > > > >> > Joe, > > > > >> > > > > > >> > I am ok with moving the meeting to Monday. If nobody objects, > how > > > > about > > > > >> we > > > > >> > meet at 2pm PST Monday (Jan 9) instead? This actually will give > > > > people a > > > > >> > bit more time to read the docs and wiki. > > > > >> > > > > > >> > Jun > > > > >> > > > > > >> > On Fri, Jan 6, 2012 at 6:38 AM, Joe Stein <[EMAIL PROTECTED]> > > > wrote: > > > > >> > > > > > >> >> so it looks like i need to take my son to a birthday party > > tonight > > > > (my > > > > >> babe > > > > >> >> daughter is sick wife has to stay home with her) > > > > >> >> > > > > >> >> if there is any chance to move this to Monday? (sorry) if not I > > > > >> understand > > > > >> >> either way let me know > > > > >> >> > > > > >> >> On Thu, Jan 5, 2012 at 2:11 PM, Jun Rao <[EMAIL PROTECTED]> > > wrote: > > > > >> >> > > > > >> >>> Hi, everyone, > > > > >> >>> > > > > >> >>> So far, the following people have sent me their skype id: > > > > >> >>> > > > > >> >>> Joe, David, Jeffrey, and Andrew. > > > > >> >>> > > > > >> >>> So the meeting is on. I encourage everyone to look at the > design > > > doc > > > > >> in > > > > >> >>> kafka-50 and the new wire format at > > > > >> >>> > > > > >> >>> > > > > >> >> > > > > >> > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > > > > >> >>> the meeting. > > > > >> >>> > > > > >> >>> Here is a breakdown of all the jiras and their dependencies > > > related > > > > to > > > > >> >> the > > > > >> >>> replication work: > > > > >> >>> > > > > >> >>> 1. kafka-47: create/delete data structures in ZK, > automatically > > > > create > > > > >> >>> topic, and use them (making partitions logical, supporting > only > > 1 > > > > >> >> replica, > > > > >> >>> no failure support). (L1) > > > > >> >>> 1.1 kafka-237: create/delete ZK path for a topic in an admin > > tool > > > > >> (L0) > > > > >> >>> 1.2 kafka-238: add a getTopicMetaData method in broker and > > expose > > > > it > > > > >> to > > > > >> >>> producer > > > > >> >>> 1.3 kafka-239: Wire existing producer and consumer to use the > > new > > > > ZK > > > > >> >> data > > > > >> >>> structure > > > > >> >>> 2. kafka-202: decouple request handler and socket sever; > > enabling > > > > long > > > > >> >> poll > > > > >> >>> in the consumer (L1) > > > > >> >>> 3. kafka-240: implement new producer and consumer request /* Joe Stein http://www.linkedin.com/in/charmalloc Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> */
-
RE: skype meeting on replication roadmapAndrew Psaltis 2012-01-06, 18:52
Tue (Jan 10) at 12 noon PST works for me as well as does Friday.
-----Original Message----- From: Joe Stein [mailto:[EMAIL PROTECTED]] Sent: Friday, January 06, 2012 11:09 AM To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Subject: Re: skype meeting on replication roadmap Tue (Jan 10) at 12 noon PST works for me, so does the other time if this is not good for others On Fri, Jan 6, 2012 at 12:43 PM, David Ormsbee <[EMAIL PROTECTED]> wrote: > Either of those works great for me. In fact, any day next week works for > me, though my preference would be Monday, Tuesday, or Friday. > > Thank you. > > Dave > > On Fri, Jan 6, 2012 at 12:34 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > How about Tue (Jan 10) at 12 noon? Can everyone make that? > > > > If not, another choice will be Tue (Jan 10) at 2:30pm PST. > > > > Jun > > > > On Fri, Jan 6, 2012 at 9:25 AM, Jeffrey Damick <[EMAIL PROTECTED] > > >wrote: > > > > > Any are fine with me too, if it was a little earlier than 2PM PST (5PM > > EST) > > > it would be better for me personally due to commuting constraints :) > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 12:03 PM, Joe Stein <[EMAIL PROTECTED]> wrote: > > > > > > > check that Tuesday -> Friday work :) as long as we start 2pm PST > > > > > > > > On Fri, Jan 6, 2012 at 11:51 AM, Joe Stein <[EMAIL PROTECTED]> > wrote: > > > > > > > > > Thursday or Friday would work best for me > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 11:48 AM, Chris Burroughs < > > > > > [EMAIL PROTECTED]> wrote: > > > > > > > > > >> I agree it's best to be patient and find a time that works for > > > everyone > > > > >> who wants to participate. In my particular case I can do Friday, > or > > > > >> Tuesday-->Friday next week, but not Monday the 9th. > > > > >> > > > > >> On 01/06/2012 11:31 AM, Jun Rao wrote: > > > > >> > Joe, > > > > >> > > > > > >> > I am ok with moving the meeting to Monday. If nobody objects, > how > > > > about > > > > >> we > > > > >> > meet at 2pm PST Monday (Jan 9) instead? This actually will give > > > > people a > > > > >> > bit more time to read the docs and wiki. > > > > >> > > > > > >> > Jun > > > > >> > > > > > >> > On Fri, Jan 6, 2012 at 6:38 AM, Joe Stein <[EMAIL PROTECTED]> > > > wrote: > > > > >> > > > > > >> >> so it looks like i need to take my son to a birthday party > > tonight > > > > (my > > > > >> babe > > > > >> >> daughter is sick wife has to stay home with her) > > > > >> >> > > > > >> >> if there is any chance to move this to Monday? (sorry) if not I > > > > >> understand > > > > >> >> either way let me know > > > > >> >> > > > > >> >> On Thu, Jan 5, 2012 at 2:11 PM, Jun Rao <[EMAIL PROTECTED]> > > wrote: > > > > >> >> > > > > >> >>> Hi, everyone, > > > > >> >>> > > > > >> >>> So far, the following people have sent me their skype id: > > > > >> >>> > > > > >> >>> Joe, David, Jeffrey, and Andrew. > > > > >> >>> > > > > >> >>> So the meeting is on. I encourage everyone to look at the > design > > > doc > > > > >> in > > > > >> >>> kafka-50 and the new wire format at > > > > >> >>> > > > > >> >>> > > > > >> >> > > > > >> > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > > > > >> >>> the meeting. > > > > >> >>> > > > > >> >>> Here is a breakdown of all the jiras and their dependencies > > > related > > > > to > > > > >> >> the > > > > >> >>> replication work: > > > > >> >>> > > > > >> >>> 1. kafka-47: create/delete data structures in ZK, > automatically > > > > create > > > > >> >>> topic, and use them (making partitions logical, supporting > only > > 1 > > > > >> >> replica, > > > > >> >>> no failure support). (L1) > > > > >> >>> 1.1 kafka-237: create/delete ZK path for a topic in an admin > > tool > > > > >> (L0) > > > > >> >>> 1.2 kafka-238: add a getTopicMetaData method in broker and > > expose > > > > it > > > > >> to > > > > >> >>> producer > > > > >> >>> 1.3 kafka-239: Wire existing producer and consumer to use the /* Joe Stein http://www.linkedin.com/in/charmalloc Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> */
-
Re: skype meeting on replication roadmapJun Rao 2012-01-06, 18:55
OK. Let's make it Tue (Jan 10) at 12 noon PST then. If you are interested
but haven't sent me your skype id, please do so before the meeting. So far, I got the skype id for the following people: Joe, David, Jeffrey, Andrew and Chris. Thanks, Jun On Fri, Jan 6, 2012 at 10:08 AM, Joe Stein <[EMAIL PROTECTED]> wrote: > Tue (Jan 10) at 12 noon PST works for me, so does the other time if this is > not good for others > > On Fri, Jan 6, 2012 at 12:43 PM, David Ormsbee <[EMAIL PROTECTED]> wrote: > > > Either of those works great for me. In fact, any day next week works for > > me, though my preference would be Monday, Tuesday, or Friday. > > > > Thank you. > > > > Dave > > > > On Fri, Jan 6, 2012 at 12:34 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > > > How about Tue (Jan 10) at 12 noon? Can everyone make that? > > > > > > If not, another choice will be Tue (Jan 10) at 2:30pm PST. > > > > > > Jun > > > > > > On Fri, Jan 6, 2012 at 9:25 AM, Jeffrey Damick < > [EMAIL PROTECTED] > > > >wrote: > > > > > > > Any are fine with me too, if it was a little earlier than 2PM PST > (5PM > > > EST) > > > > it would be better for me personally due to commuting constraints :) > > > > > > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 12:03 PM, Joe Stein <[EMAIL PROTECTED]> > wrote: > > > > > > > > > check that Tuesday -> Friday work :) as long as we start 2pm PST > > > > > > > > > > On Fri, Jan 6, 2012 at 11:51 AM, Joe Stein <[EMAIL PROTECTED]> > > wrote: > > > > > > > > > > > Thursday or Friday would work best for me > > > > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 11:48 AM, Chris Burroughs < > > > > > > [EMAIL PROTECTED]> wrote: > > > > > > > > > > > >> I agree it's best to be patient and find a time that works for > > > > everyone > > > > > >> who wants to participate. In my particular case I can do > Friday, > > or > > > > > >> Tuesday-->Friday next week, but not Monday the 9th. > > > > > >> > > > > > >> On 01/06/2012 11:31 AM, Jun Rao wrote: > > > > > >> > Joe, > > > > > >> > > > > > > >> > I am ok with moving the meeting to Monday. If nobody objects, > > how > > > > > about > > > > > >> we > > > > > >> > meet at 2pm PST Monday (Jan 9) instead? This actually will > give > > > > > people a > > > > > >> > bit more time to read the docs and wiki. > > > > > >> > > > > > > >> > Jun > > > > > >> > > > > > > >> > On Fri, Jan 6, 2012 at 6:38 AM, Joe Stein <[EMAIL PROTECTED] > > > > > > wrote: > > > > > >> > > > > > > >> >> so it looks like i need to take my son to a birthday party > > > tonight > > > > > (my > > > > > >> babe > > > > > >> >> daughter is sick wife has to stay home with her) > > > > > >> >> > > > > > >> >> if there is any chance to move this to Monday? (sorry) if > not I > > > > > >> understand > > > > > >> >> either way let me know > > > > > >> >> > > > > > >> >> On Thu, Jan 5, 2012 at 2:11 PM, Jun Rao <[EMAIL PROTECTED]> > > > wrote: > > > > > >> >> > > > > > >> >>> Hi, everyone, > > > > > >> >>> > > > > > >> >>> So far, the following people have sent me their skype id: > > > > > >> >>> > > > > > >> >>> Joe, David, Jeffrey, and Andrew. > > > > > >> >>> > > > > > >> >>> So the meeting is on. I encourage everyone to look at the > > design > > > > doc > > > > > >> in > > > > > >> >>> kafka-50 and the new wire format at > > > > > >> >>> > > > > > >> >>> > > > > > >> >> > > > > > >> > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > > > > > >> >>> the meeting. > > > > > >> >>> > > > > > >> >>> Here is a breakdown of all the jiras and their dependencies > > > > related > > > > > to > > > > > >> >> the > > > > > >> >>> replication work: > > > > > >> >>> > > > > > >> >>> 1. kafka-47: create/delete data structures in ZK, > > automatically > > > > > create > > > > > >> >>> topic, and use them (making partitions logical, supporting > > only > > > 1 > > > > > >> >> replica, > > > > > >> >>> no failure support). (L1) > > > > > >> >>> 1.1 kafka-237
-
Re: skype meeting on replication roadmapPrashanth Menon 2012-01-16, 19:42
Oh my gosh!!!! I completely missed this meeting and I really wanted to be
apart of it! Did anyone happen to record the meeting? If so, would they be willing to share it? On Fri, Jan 6, 2012 at 1:55 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > OK. Let's make it Tue (Jan 10) at 12 noon PST then. If you are interested > but haven't sent me your skype id, please do so before the meeting. So far, > I got the skype id for the following people: > > Joe, David, Jeffrey, Andrew and Chris. > > Thanks, > > Jun > > On Fri, Jan 6, 2012 at 10:08 AM, Joe Stein <[EMAIL PROTECTED]> wrote: > > > Tue (Jan 10) at 12 noon PST works for me, so does the other time if this > is > > not good for others > > > > On Fri, Jan 6, 2012 at 12:43 PM, David Ormsbee <[EMAIL PROTECTED]> > wrote: > > > > > Either of those works great for me. In fact, any day next week works > for > > > me, though my preference would be Monday, Tuesday, or Friday. > > > > > > Thank you. > > > > > > Dave > > > > > > On Fri, Jan 6, 2012 at 12:34 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > > > > > How about Tue (Jan 10) at 12 noon? Can everyone make that? > > > > > > > > If not, another choice will be Tue (Jan 10) at 2:30pm PST. > > > > > > > > Jun > > > > > > > > On Fri, Jan 6, 2012 at 9:25 AM, Jeffrey Damick < > > [EMAIL PROTECTED] > > > > >wrote: > > > > > > > > > Any are fine with me too, if it was a little earlier than 2PM PST > > (5PM > > > > EST) > > > > > it would be better for me personally due to commuting constraints > :) > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 12:03 PM, Joe Stein <[EMAIL PROTECTED]> > > wrote: > > > > > > > > > > > check that Tuesday -> Friday work :) as long as we start 2pm PST > > > > > > > > > > > > On Fri, Jan 6, 2012 at 11:51 AM, Joe Stein <[EMAIL PROTECTED]> > > > wrote: > > > > > > > > > > > > > Thursday or Friday would work best for me > > > > > > > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 11:48 AM, Chris Burroughs < > > > > > > > [EMAIL PROTECTED]> wrote: > > > > > > > > > > > > > >> I agree it's best to be patient and find a time that works for > > > > > everyone > > > > > > >> who wants to participate. In my particular case I can do > > Friday, > > > or > > > > > > >> Tuesday-->Friday next week, but not Monday the 9th. > > > > > > >> > > > > > > >> On 01/06/2012 11:31 AM, Jun Rao wrote: > > > > > > >> > Joe, > > > > > > >> > > > > > > > >> > I am ok with moving the meeting to Monday. If nobody > objects, > > > how > > > > > > about > > > > > > >> we > > > > > > >> > meet at 2pm PST Monday (Jan 9) instead? This actually will > > give > > > > > > people a > > > > > > >> > bit more time to read the docs and wiki. > > > > > > >> > > > > > > > >> > Jun > > > > > > >> > > > > > > > >> > On Fri, Jan 6, 2012 at 6:38 AM, Joe Stein < > [EMAIL PROTECTED] > > > > > > > > wrote: > > > > > > >> > > > > > > > >> >> so it looks like i need to take my son to a birthday party > > > > tonight > > > > > > (my > > > > > > >> babe > > > > > > >> >> daughter is sick wife has to stay home with her) > > > > > > >> >> > > > > > > >> >> if there is any chance to move this to Monday? (sorry) if > > not I > > > > > > >> understand > > > > > > >> >> either way let me know > > > > > > >> >> > > > > > > >> >> On Thu, Jan 5, 2012 at 2:11 PM, Jun Rao <[EMAIL PROTECTED]> > > > > wrote: > > > > > > >> >> > > > > > > >> >>> Hi, everyone, > > > > > > >> >>> > > > > > > >> >>> So far, the following people have sent me their skype id: > > > > > > >> >>> > > > > > > >> >>> Joe, David, Jeffrey, and Andrew. > > > > > > >> >>> > > > > > > >> >>> So the meeting is on. I encourage everyone to look at the > > > design > > > > > doc > > > > > > >> in > > > > > > >> >>> kafka-50 and the new wire format at > > > > > > >> >>> > > > > > > >> >>> > > > > > > >> >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposalbefore > > > > > > >> >>> the meeting. > > > > > > >> >>>
-
Re: skype meeting on replication roadmapJun Rao 2012-01-16, 21:23
Prashanth,
Here is the meeting minutes. Here is an update on the Skype meeting on Jan 10: Attendees: Neha Narkhede Jay Kreps Joel Koshy Jun Rao Andrew.Psaltis Joe Stein David Ormsbee Jeffrey Damick Patricio Echagüe We went through the high level design of replication as described in kafka-50. We discussed the dependency of the sub-tasks in kafka-50 and which one can be worked on immediately. A few people volunteered to take on some of the tasks. Some people had ideas on improving the non-java client support and will be filling new jiras for that. Thanks, Jun On Mon, Jan 16, 2012 at 11:42 AM, Prashanth Menon < [EMAIL PROTECTED]> wrote: > Oh my gosh!!!! I completely missed this meeting and I really wanted to be > apart of it! Did anyone happen to record the meeting? If so, would they > be willing to share it? > > On Fri, Jan 6, 2012 at 1:55 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > OK. Let's make it Tue (Jan 10) at 12 noon PST then. If you are interested > > but haven't sent me your skype id, please do so before the meeting. So > far, > > I got the skype id for the following people: > > > > Joe, David, Jeffrey, Andrew and Chris. > > > > Thanks, > > > > Jun > > > > On Fri, Jan 6, 2012 at 10:08 AM, Joe Stein <[EMAIL PROTECTED]> wrote: > > > > > Tue (Jan 10) at 12 noon PST works for me, so does the other time if > this > > is > > > not good for others > > > > > > On Fri, Jan 6, 2012 at 12:43 PM, David Ormsbee <[EMAIL PROTECTED]> > > wrote: > > > > > > > Either of those works great for me. In fact, any day next week works > > for > > > > me, though my preference would be Monday, Tuesday, or Friday. > > > > > > > > Thank you. > > > > > > > > Dave > > > > > > > > On Fri, Jan 6, 2012 at 12:34 PM, Jun Rao <[EMAIL PROTECTED]> wrote: > > > > > > > > > How about Tue (Jan 10) at 12 noon? Can everyone make that? > > > > > > > > > > If not, another choice will be Tue (Jan 10) at 2:30pm PST. > > > > > > > > > > Jun > > > > > > > > > > On Fri, Jan 6, 2012 at 9:25 AM, Jeffrey Damick < > > > [EMAIL PROTECTED] > > > > > >wrote: > > > > > > > > > > > Any are fine with me too, if it was a little earlier than 2PM PST > > > (5PM > > > > > EST) > > > > > > it would be better for me personally due to commuting constraints > > :) > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 12:03 PM, Joe Stein <[EMAIL PROTECTED]> > > > wrote: > > > > > > > > > > > > > check that Tuesday -> Friday work :) as long as we start 2pm > PST > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 11:51 AM, Joe Stein <[EMAIL PROTECTED] > > > > > > wrote: > > > > > > > > > > > > > > > Thursday or Friday would work best for me > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Jan 6, 2012 at 11:48 AM, Chris Burroughs < > > > > > > > > [EMAIL PROTECTED]> wrote: > > > > > > > > > > > > > > > >> I agree it's best to be patient and find a time that works > for > > > > > > everyone > > > > > > > >> who wants to participate. In my particular case I can do > > > Friday, > > > > or > > > > > > > >> Tuesday-->Friday next week, but not Monday the 9th. > > > > > > > >> > > > > > > > >> On 01/06/2012 11:31 AM, Jun Rao wrote: > > > > > > > >> > Joe, > > > > > > > >> > > > > > > > > >> > I am ok with moving the meeting to Monday. If nobody > > objects, > > > > how > > > > > > > about > > > > > > > >> we > > > > > > > >> > meet at 2pm PST Monday (Jan 9) instead? This actually will > > > give > > > > > > > people a > > > > > > > >> > bit more time to read the docs and wiki. > > > > > > > >> > > > > > > > > >> > Jun > > > > > > > >> > > > > > > > > >> > On Fri, Jan 6, 2012 at 6:38 AM, Joe Stein < > > [EMAIL PROTECTED] > > > > > > > > > > wrote: > > > > > > > >> > > > > > > > > >> >> so it looks like i need to take my son to a birthday > party > > > > > tonight > > > > > > > (my > > > > > > > >> babe > > > > > > > >> >> daughter is sick wife has to stay home with her) > > > > > > > >> >> > > > > > > > >> >> if there is any chance to move this to Monday? (sorry) if |