Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 21 (0.174s).
Loading phrases to help you
refine your search...
New broker not receiving any data - Kafka - [mail # user]
...Hey guys,I think I remember this being a known issue, but thought I should ping thelist anyway.I just added a new broker to the cluster (0.7.1), but it won't startreceiving data until I manu...
   Author: Matthew Rathbone, 2013-04-30, 00:48
Re: We have an invalid message in a segment, how to deal with it? - Kafka - [mail # user]
...Ok, so yeah it doesn't sound like that is what happened. on this partition.FWIW all other 8 partitions were fine.What I ended up doing was deleting partition N + all partitions > N (which...
   Author: Matthew Rathbone, 2013-04-13, 18:51
We have an invalid message on a broker, how to deal with it? - Kafka - [mail # user]
...Hey guys,Due to a disk filling up, one of the segments has an invalid message in it.I have verified this using DumpLogSegments.How do I deal with this now? the invalid message is causing our...
   Author: Matthew Rathbone, 2013-04-13, 17:03
Re: .net (c#) kafka client - Kafka - [mail # user]
...Maybe you could write a C# client. I don't think it would be super hard towrite a basic one (that doesn't require zookeeper for example). C# has alot of great features that would make it gre...
   Author: Matthew Rathbone, 2013-04-03, 21:24
Re: Limit on number of Kafka Topic - Kafka - [mail # user]
...We've seen big performace degradation when we tested 1024 topics, so we'veopted to go for a much smaller topic count (< 100).On the read side, I think performance is largely driven by the...
   Author: Matthew Rathbone, 2013-03-27, 16:49
Re: Is anyone able to consume from Kafka 0.7.x and write into Hadoop CDH 4.x ? - Kafka - [mail # user]
...=david, we use a subset of the KafkaETLJob in cdh4 with great success. Justmake sure to compile your mapreduce against CDH4On Thu, Mar 14, 2013 at 10:28 PM, David Arthur  wrote:> I h...
   Author: Matthew Rathbone, 2013-03-15, 16:20
Kafka talk tomorrow night in Madison WI - Kafka - [mail # user]
...Hey all,If any of you are in the midwest I'll get giving a talk on Kafka at theBigDataMadison meetup [1] in Madison WI. Stop by if you're around, therewill be pizza :-).It's at 6pm tomorrow ...
   Author: Matthew Rathbone, 2013-02-25, 21:16
Re: S3 Consumer - Kafka - [mail # user]
...So the hadoop consumer does use the latest offset, it reads it from the'input' directory in the record reader.We have a heavily modified version of the hadoop consumer that reads /writes off...
   Author: Matthew Rathbone, 2012-12-28, 14:32
Re: Kafka + Maven - Kafka - [mail # user]
...++ to both Maven packages and multiple Scala versions.  As above, we host our own 2.9.2 build in Nexus. Seems crazy everyone is doing the same thing and constantly repeating work.  ...
   Author: Matthew Rathbone, 2012-11-21, 00:18
Re: Kafka on EC2 - Kafka - [mail # user]
...If you raid EBS volumes you're pretty much protected from data loss as an added benefit. So yeah if a broker goes down, you don't have the data until you bring it back up, but you CAN bring ...
   Author: Matthew Rathbone, 2012-11-19, 21:44
Kafka (21)
Hive (4)
mail # user (17)
issue (4)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (21)
Jun Rao (848)
Neha Narkhede (578)
"Neha Narkhede (412)
Jay Kreps (300)
"Jun Rao (277)
Joe Stein (161)
Joel Koshy (145)
Guozhang Wang (124)
John Fung (95)
"Joe Stein (94)
"Jay Kreps (90)
"Guozhang Wang (89)
Jason Rosenberg (68)
Swapnil Ghike (62)
David Arthur (61)
Matthew Rathbone