Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Mapping MySQL schema to Avro


Copy link to this message
-
Mapping MySQL schema to Avro
Hello!

I'm currently writing an importer to import our MySQL data into hadoop
( as Avro files ). Attached you can find the schema i'm converting to
Avro, along with the corresponding Avro schema i would like to use for
my imported data. I was wondering if you guys could go over the schema
and determine if this is sane/optimal, and if not, how i should improve
it.

As a sidenote, i converted bigints to long, and had 1 occurrence of
double, which i also converted to long in the avro, not sure if that's
the correct type?

Thanks in advance for your expert opinions! ;)

Kind regards,

Bart
+
Ted Dunning 2012-11-24, 18:26
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB