Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> text files to avro


Copy link to this message
-
Re: text files to avro
Note that input.json is one JSON record per line.
On Wed, Oct 31, 2012 at 9:08 PM, Miki Tebeka <[EMAIL PROTECTED]> wrote:

> Actually, I meant something like:
>     avro write --schema=/path/to/schema/file input.json > output.avro
>
>
> On Wed, Oct 31, 2012 at 9:04 AM, ranjith raghunath <
> [EMAIL PROTECTED]> wrote:
>
>> Thanks going to give that a shot.
>> On Oct 31, 2012 7:29 AM, "Miki Tebeka" <[EMAIL PROTECTED]> wrote:
>>
>>> You can use the "avro" tool that comes with the Python package
>>> (easy_install avro).
>>> It can convert both JSON (one per line) or CSV files to avro.
>>>
>>>
>>> On Tue, Oct 30, 2012 at 9:52 PM, Ranjith <[EMAIL PROTECTED]>wrote:
>>>
>>>> what is the best way to convert a text file into avro format? does the
>>>> file need to contain a header? sorry if this is a basic question and has
>>>> been answered several times.
>>>>
>>>> Thanks,
>>>> Ranjith
>>>
>>>
>>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB