Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Mapping MySQL schema to Avro


Copy link to this message
-
Re: Mapping MySQL schema to Avro
As i pressed 'send', i noticed i sent it to the Flume mailing list
instead of hadoop, my apologies!

Bart Verwilst schreef op 23.11.2012 14:11:
> Hello!
>
> I'm currently writing an importer to import our MySQL data into
> hadoop ( as Avro files ). Attached you can find the schema i'm
> converting to Avro, along with the corresponding Avro schema i would
> like to use for my imported data. I was wondering if you guys could
> go
> over the schema and determine if this is sane/optimal, and if not,
> how
> i should improve it.
>
> As a sidenote, i converted bigints to long, and had 1 occurrence of
> double, which i also converted to long in the avro, not sure if
> that's
> the correct type?
>
> Thanks in advance for your expert opinions! ;)
>
> Kind regards,
>
> Bart
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB