Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> Map Reduce Jobs bound to "String" StringType


Copy link to this message
-
Re: Map Reduce Jobs bound to "String" StringType
Doug, thanks for the response after such a long time. We're looking forward
to 1.7.5 and this feature.
On Tue, Aug 13, 2013 at 7:28 PM, Doug Cutting <[EMAIL PROTECTED]> wrote:

> This is fixed in AVRO-1353 and will be in (soon to be released) 1.7.5.
>
> https://issues.apache.org/jira/browse/AVRO-1353
>
> Doug
>
> On Mon, Jun 3, 2013 at 9:18 AM, Johannes Schulte
> <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > am I right with saying: When using the Map Reduce new API, there are
> always
> > Java Strings created for avro string types?
> >
> > I know about the "avro.string.type" property but even when leaving this
> > untouched, I get Strings.
> >
> > In AvroRecordReaderBase there is a ReflectDatumReader instantiated
> >
> >  mAvroFileReader = createAvroFileReader(seekableFileInput,
> >
> >         new ReflectDatumReader<T>(mReaderSchema));
> >
> >
> > and in this this method is always called:
> >
> >
> >   @Override
> >
> >   protected Object readString(Object old, Decoder in) throws IOException
> {
> >
> >     return super.readString(null, in).toString();
> >
> >   }
> >
> >
> > Is there a way to circumvent this and keep using Utf8?
> >
> >
> > Cheers,
> >
> >
> > Johannnes
> >
> >
> >
>