Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> a possible bug in Avro MapReduce


Copy link to this message
-
a possible bug in Avro MapReduce

Hi,
We got an Avro MapReduce job with the signature of the map function as follows:

public void map(ByteBuffer input, AvroCollector<Pair<Utf8, GenericRecord>> collector, Reporter reporter) throws IOException;

However, the position of the ByteBuffer input, i.e. input.position(), is always set to 0 when map() gets invoked.  With this, we can not extract data from input.  This is for the version of avro 1.5.4.  For the older versions of avro, input.position() is set to the end of the input data.  Is there anybody knows why this gets set to 0?  Or is this a bug?  
Ey-Chih Chow    
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB