| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
27 (0.173s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: ETL with Kafka - Kafka - [mail # user]
|
|
...I previously posted a link to contrib in this thread. No, its not acascading tap. Its a complete job. One to read kafka events to hdfs, one togenerate kafka events from hdfs. ETL can happen ...
|
|
|
Author: Russell Jurney,
2013-01-07, 22:06
|
|
|
Re: ETL with Kafka - Kafka - [mail # user]
|
|
...Just to be clear - a Kafka 'Tap' of sorts exists in contrib: it scansHadoop records, which may be ETL'd first, and emits new Kafka events.On Mon, Jan 7, 2013 at 9:57 AM, Ken Krugler wrote:&g...
|
|
|
Author: Russell Jurney,
2013-01-07, 20:48
|
|
|
Re: ETL with Kafka - Kafka - [mail # user]
|
|
...You can use Kafka to store data on Hadoop via the Hadoop consumer incontrib, and then use Talend or Pig to ETL it, before finally emitting theETL's records via the Hadoop producer in contrib...
|
|
|
Author: Russell Jurney,
2013-01-07, 07:00
|
|
|
Re: S3 Consumer - Kafka - [mail # user]
|
|
...Would you please contribute this to open source? What you've writtenhas been asked for many times. FWIW, I would immediately incorporateit into my book, Agile Data.Russell Jurney http://data...
|
|
|
Author: Russell Jurney,
2012-12-28, 23:46
|
|
|
Re: Strata/Hadoop World NYC - Kafka - [mail # user]
|
|
...Anyone up for a Kafka meetup? There may be space and time for one, if we ask. Russell Jurney twitter.com/rjurney On Oct 9, 2012, at 10:28 AM, Wouter de Bie wrote: ...
|
|
|
Author: Russell Jurney,
2012-10-09, 17:42
|
|
|
Re: S3 Consumer for Super Duper Blog Post! - Kafka - [mail # user]
|
|
...Thanks, I'll check this out. On Sun, Aug 19, 2012 at 7:09 AM, Russell Jurney wrote: Russell Jurney twitter.com/rjurney [EMAIL PROTECTED] datasyndrome.com...
|
|
|
Author: Russell Jurney,
2012-08-19, 14:10
|
|
|
Re: S3 Consumer for Super Duper Blog Post! - Kafka - [mail # user]
|
|
...Thanks for your response, and glad to hear you need this as well and are working on it. Does using s3n:// file-path require that you have a Hadoop cluster running? I use S3 and EMR, so...
|
|
|
Author: Russell Jurney,
2012-08-19, 14:09
|
|
|
S3 Consumer for Super Duper Blog Post! - Kafka - [mail # user]
|
|
...Ok, this is the last time I'm gonna beg for an S3 sink for Kafka. I'm not trolling, and this is Your Big Chance to help! I'm gonna blog about using Whirr to boot Zookeeper and then to ...
|
|
|
Author: Russell Jurney,
2012-08-18, 04:49
|
|
|
Re: Kafka events to S3? - Kafka - [mail # user]
|
|
...I've always hoped that since Kafka is agnostic about message payload format (right?), that written format might be too... but maybe that is a bit over simplified. Russell Jurney http:/...
|
|
|
Author: Russell Jurney,
2012-05-23, 18:34
|
|
|
Re: Kafka events to S3? - Kafka - [mail # user]
|
|
...Yeah, no kidding. I keep waiting on one :) Russell Jurney http://datasyndrome.com On May 22, 2012, at 10:31 PM, Jay Kreps wrote: ...
|
|
|
Author: Russell Jurney,
2012-05-23, 05:35
|
|
|
|
