Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro, mail # user - text files to avro


Copy link to this message
-
Re: text files to avro
Russell Jurney 2012-10-31, 15:52
An example of doing this is here:
https://github.com/rjurney/Collecting-Data/blob/master/src/python/cat_avro

Russell Jurney http://datasyndrome.com

On Oct 31, 2012, at 5:29 AM, Miki Tebeka <[EMAIL PROTECTED]> wrote:

You can use the "avro" tool that comes with the Python package
(easy_install avro).
It can convert both JSON (one per line) or CSV files to avro.
On Tue, Oct 30, 2012 at 9:52 PM, Ranjith <[EMAIL PROTECTED]>wrote:

> what is the best way to convert a text file into avro format? does the
> file need to contain a header? sorry if this is a basic question and has
> been answered several times.
>
> Thanks,
> Ranjith