Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> Map Reduce Jobs bound to "String" StringType


Copy link to this message
-
Re: Map Reduce Jobs bound to "String" StringType
Doug, thanks for the response after such a long time. We're looking forward
to 1.7.5 and this feature.
On Tue, Aug 13, 2013 at 7:28 PM, Doug Cutting <[EMAIL PROTECTED]> wrote:

> This is fixed in AVRO-1353 and will be in (soon to be released) 1.7.5.
>
> https://issues.apache.org/jira/browse/AVRO-1353
>
> Doug
>
> On Mon, Jun 3, 2013 at 9:18 AM, Johannes Schulte
> <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > am I right with saying: When using the Map Reduce new API, there are
> always
> > Java Strings created for avro string types?
> >
> > I know about the "avro.string.type" property but even when leaving this
> > untouched, I get Strings.
> >
> > In AvroRecordReaderBase there is a ReflectDatumReader instantiated
> >
> >  mAvroFileReader = createAvroFileReader(seekableFileInput,
> >
> >         new ReflectDatumReader<T>(mReaderSchema));
> >
> >
> > and in this this method is always called:
> >
> >
> >   @Override
> >
> >   protected Object readString(Object old, Decoder in) throws IOException
> {
> >
> >     return super.readString(null, in).toString();
> >
> >   }
> >
> >
> > Is there a way to circumvent this and keep using Utf8?
> >
> >
> > Cheers,
> >
> >
> > Johannnes
> >
> >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB