Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Avro >> mail # user >> Question about Map Only AvroJob


+
hodgesz 2012-09-25, 03:35
Copy link to this message
-
Re: Question about Map Only AvroJob
Hi Jonathan,

Yes. Here's an example.
http://contrail-bio.git.sourceforge.net/git/gitweb.cgi?p=contrail-bio/contrail-bio;a=blob;f=src/main/java/contrail/stages/ConvertAvroGraphToOldFormat.java;h=99262823fd8267fb36c5a28de3af223213c0c5d9;hb=HEAD

I was using a SpecificAvroRecord but I imagine it would work with
GenericRecord just as well.
The way I did it was to use a regular map reduce mapper and use AvroWrapper
for the key and nothing for the value.

If you have questions let me know and I'll try to answer them.

J

On Mon, Sep 24, 2012 at 8:35 PM, hodgesz <[EMAIL PROTECTED]> wrote:

> Hi,
>
> Is it possible to have a map only job take an Avro GenericRecord as input
> and output a non-Avro key/value text file?  The text file will contain a
> LongWritable key and a LongWritable value.
>
> Thanks in advance,
>
> Jonathan
>
>
>
>
> --
> View this message in context:
> http://apache-avro.679487.n3.nabble.com/Question-about-Map-Only-AvroJob-tp4025290.html
> Sent from the Avro - Users mailing list archive at Nabble.com.
>
+
hodgesz 2012-09-28, 13:51
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB