what is the best way to convert a text file into avro format? does the file need to contain a header? sorry if this is a basic question and has been answered several times.

Thanks,
Ranjith

You can use the "avro" tool that comes with the Python package
(easy_install avro).
It can convert both JSON (one per line) or CSV files to avro.
On Tue, Oct 30, 2012 at 9:52 PM, Ranjith <[EMAIL PROTECTED]>wrote:

> what is the best way to convert a text file into avro format? does the
> file need to contain a header? sorry if this is a basic question and has
> been answered several times.
>
> Thanks,
> Ranjith

An example of doing this is here:
https://github.com/rjurney/Collecting-Data/blob/master/src/python/cat_avro

Russell Jurney http://datasyndrome.com

On Oct 31, 2012, at 5:29 AM, Miki Tebeka <[EMAIL PROTECTED]> wrote:

You can use the "avro" tool that comes with the Python package
(easy_install avro).
It can convert both JSON (one per line) or CSV files to avro.
On Tue, Oct 30, 2012 at 9:52 PM, Ranjith <[EMAIL PROTECTED]>wrote:

> what is the best way to convert a text file into avro format? does the
> file need to contain a header? sorry if this is a basic question and has
> been answered several times.
>
> Thanks,
> Ranjith

Thanks going to give that a shot.
On Oct 31, 2012 7:29 AM, "Miki Tebeka" <[EMAIL PROTECTED]> wrote:

> You can use the "avro" tool that comes with the Python package
> (easy_install avro).
> It can convert both JSON (one per line) or CSV files to avro.
>
>
> On Tue, Oct 30, 2012 at 9:52 PM, Ranjith <[EMAIL PROTECTED]>wrote:
>
>> what is the best way to convert a text file into avro format? does the
>> file need to contain a header? sorry if this is a basic question and has
>> been answered several times.
>>
>> Thanks,
>> Ranjith
>
>
>

Actually, I meant something like:
    avro write --schema=/path/to/schema/file input.json > output.avro
On Wed, Oct 31, 2012 at 9:04 AM, ranjith raghunath <
[EMAIL PROTECTED]> wrote:

> Thanks going to give that a shot.
> On Oct 31, 2012 7:29 AM, "Miki Tebeka" <[EMAIL PROTECTED]> wrote:
>
>> You can use the "avro" tool that comes with the Python package
>> (easy_install avro).
>> It can convert both JSON (one per line) or CSV files to avro.
>>
>>
>> On Tue, Oct 30, 2012 at 9:52 PM, Ranjith <[EMAIL PROTECTED]>wrote:
>>
>>> what is the best way to convert a text file into avro format? does the
>>> file need to contain a header? sorry if this is a basic question and has
>>> been answered several times.
>>>
>>> Thanks,
>>> Ranjith
>>
>>
>>

Note that input.json is one JSON record per line.
On Wed, Oct 31, 2012 at 9:08 PM, Miki Tebeka <[EMAIL PROTECTED]> wrote:

> Actually, I meant something like:
>     avro write --schema=/path/to/schema/file input.json > output.avro
>
>
> On Wed, Oct 31, 2012 at 9:04 AM, ranjith raghunath <
> [EMAIL PROTECTED]> wrote:
>
>> Thanks going to give that a shot.
>> On Oct 31, 2012 7:29 AM, "Miki Tebeka" <[EMAIL PROTECTED]> wrote:
>>
>>> You can use the "avro" tool that comes with the Python package
>>> (easy_install avro).
>>> It can convert both JSON (one per line) or CSV files to avro.
>>>
>>>
>>> On Tue, Oct 30, 2012 at 9:52 PM, Ranjith <[EMAIL PROTECTED]>wrote:
>>>
>>>> what is the best way to convert a text file into avro format? does the
>>>> file need to contain a header? sorry if this is a basic question and has
>>>> been answered several times.
>>>>
>>>> Thanks,
>>>> Ranjith
>>>
>>>
>>>
>