Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 11 to 20 from 27 (0.254s).
Loading phrases to help you
refine your search...
Kafka events to S3? - Kafka - [mail # user]
...Is there a simple way to dump Kafka events to S3 yet?  Russell Jurney http://datasyndrome.com...
   Author: Russell Jurney, 2012-05-23, 05:23
Too bad Kafka can't consume events to S3 - Kafka - [mail # user]
...Since it is the most common need in the cloud data Kafka world?  Russell Jurney http://datasyndrome.com...
   Author: Russell Jurney, 2012-05-04, 18:05
Re: Kafka in AWS? - Kafka - [mail # user]
...bump  On Wed, Mar 21, 2012 at 10:01 PM, Vaibhav Puranik wrote:     Russell Jurney twitter.com/rjurney [EMAIL PROTECTED] datasyndrome.com...
   Author: Russell Jurney, 2012-03-23, 02:15
Re: Kafka in AWS? - Kafka - [mail # user]
...You have code that puts records in bigger blocks on s3? Plz to share? :)  Russell Jurney http://datasyndrome.com  On Mar 21, 2012, at 1:37 PM, Vaibhav Puranik  wrote:  ...
   Author: Russell Jurney, 2012-03-21, 20:44
Re: Kafka in AWS? - Kafka - [mail # user]
...I want the S3 files to be organized by type and date. Folders for types, subfolders for date down to the hour: year/month/day/hour. All payloads of a given type get written together.  I...
   Author: Russell Jurney, 2012-03-21, 20:33
Re: Kafka in AWS? - Kafka - [mail # user]
...I don't want avro to have an opinion on the serialization format.  Russell Jurney http://datasyndrome.com  On Mar 21, 2012, at 12:50 PM, Tim Lossen  wrote:  ...
   Author: Russell Jurney, 2012-03-21, 19:52
Re: Kafka in AWS? - Kafka - [mail # user]
...I'm going to use thrift, avro or protobuf for serialization.  Russell Jurney http://datasyndrome.com  On Mar 21, 2012, at 11:59 AM, Vaibhav Puranik  wrote:  ...
   Author: Russell Jurney, 2012-03-21, 19:46
Re: Kafka in AWS? - Kafka - [mail # user]
...I want events in S3 to process them in Hadoop. I'd like to emit them in my app, and have them magically show up in 64MB chunks on S3. Like most everyone else.  Russell Jurney http://dat...
   Author: Russell Jurney, 2012-03-21, 05:07
Re: Kafka in AWS? - Kafka - [mail # user]
...I think as soon as someone commits code that reliably sinks events to S3, Kafka adoption will skyrocket.  There is no good solution to this yet.  MANY people want one.  Russ &...
   Author: Russell Jurney, 2012-03-20, 23:51
Re: Kafka in AWS? - Kafka - [mail # user]
...Yeah, that is the part I am hoping someone will contribute :)  I know I can write that myself.  I also know it will be buggy and that I will have lots of trouble.  If you cont...
   Author: Russell Jurney, 2012-03-20, 22:23
Sort:
project
Pig (485)
Avro (40)
Kafka (27)
Hadoop (20)
Hive (18)
MapReduce (14)
HBase (7)
HDFS (2)
type
mail # user (27)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (4)
last 9 months (27)
author
Jun Rao (1175)
Neha Narkhede (764)
Jay Kreps (489)
"Neha Narkhede (257)
Joe Stein (183)
Chris Burroughs (172)
"Jun Rao (160)
Joel Koshy (154)
Alan D. Cabrera (141)
David Arthur (120)
Jason Rosenberg (119)
Taylor Gautier (98)
John Fung (92)
S Ahmed (92)
Chris Curtin (68)
Russell Jurney