Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Avro >> mail # user >> text files to avro


+
Ranjith 2012-10-31, 04:52
+
Miki Tebeka 2012-10-31, 12:28
+
ranjith raghunath 2012-10-31, 16:04
+
Miki Tebeka 2012-11-01, 04:08
+
Miki Tebeka 2012-11-01, 04:10
Copy link to this message
-
Re: text files to avro
An example of doing this is here:
https://github.com/rjurney/Collecting-Data/blob/master/src/python/cat_avro

Russell Jurney http://datasyndrome.com

On Oct 31, 2012, at 5:29 AM, Miki Tebeka <[EMAIL PROTECTED]> wrote:

You can use the "avro" tool that comes with the Python package
(easy_install avro).
It can convert both JSON (one per line) or CSV files to avro.
On Tue, Oct 30, 2012 at 9:52 PM, Ranjith <[EMAIL PROTECTED]>wrote:

> what is the best way to convert a text file into avro format? does the
> file need to contain a header? sorry if this is a basic question and has
> been answered several times.
>
> Thanks,
> Ranjith
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB