Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro, mail # user - map/reduce of compressed Avro


Copy link to this message
-
Re: map/reduce of compressed Avro
nir_zamir 2013-04-23, 06:47
Thanks Martin.

What will happen if I try to use an indexed LZO-compressed avro file? Will
it work and utilize the index to allow multiple mappers?

I think that for Snappy for example, the file is splittable and can use
multiple mappers, but I haven't tested it yet - would be glad if anyone has
any experience with that.

Thanks!
Nir.

--
View this message in context: http://apache-avro.679487.n3.nabble.com/map-reduce-of-compressed-Avro-tp4026947p4027009.html
Sent from the Avro - Users mailing list archive at Nabble.com.