Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Avro, mail # user - a possible bug in Avro MapReduce


+
ey-chih chow 2012-03-19, 22:34
Copy link to this message
-
Re: a possible bug in Avro MapReduce
Scott Carey 2012-03-21, 02:35
Perhaps it is
https://issues.apache.org/jira/browse/AVRO-1045

Are you creating a copy of the GenericRecord?

-Scott
On 3/19/12 3:34 PM, "ey-chih chow" <[EMAIL PROTECTED]> wrote:

> Hi,
>
> We got an Avro MapReduce job with the signature of the map function as
> follows:
>
>
> public void map(ByteBuffer input, AvroCollector<Pair<Utf8, GenericRecord>>
> collector, Reporter reporter) throws IOException;
>
>
> However, the position of the ByteBuffer input, i.e. input.position(), is
> always set to 0 when map() gets invoked.  With this, we can not extract data
> from input.  This is for the version of avro 1.5.4.  For the older versions of
> avro, input.position() is set to the end of the input data.  Is there anybody
> knows why this gets set to 0?  Or is this a bug?
>
> Ey-Chih Chow
>        
+
Ey-Chih chow 2012-03-21, 05:36