Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Avro, mail # user - Map Reduce Jobs bound to "String" StringType

Copy link to this message
Map Reduce Jobs bound to "String" StringType
Johannes Schulte 2013-06-03, 16:18

am I right with saying: When using the Map Reduce new API, there are always
Java Strings created for avro string types?

I know about the "avro.string.type" property but even when leaving this
untouched, I get Strings.

In AvroRecordReaderBase there is a ReflectDatumReader instantiated

 mAvroFileReader = createAvroFileReader(seekableFileInput,

        new ReflectDatumReader<T>(mReaderSchema));
and in this this method is always called:

  protected Object readString(Object old, Decoder in) throws IOException {

    return super.readString(null, in).toString();

Is there a way to circumvent this and keep using Utf8?
Doug Cutting 2013-08-13, 17:28
Johannes Schulte 2013-08-13, 20:31