Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> pojo writables


+
Jay Vyas 2012-10-08, 14:13
Copy link to this message
-
Re: pojo writables
Hi Jay

Hadoop supports this already using the JavaSerialization class. I'm
not sure it is very performant though, when compared to usual Writable
serialization.

Alternatively you could use Avro (SpecificRecord objects
auto-generated from a schema file).

Cheers
Dave

On 8 October 2012 15:13, Jay Vyas <[EMAIL PROTECTED]> wrote:
> One of the benefits of using autogenerated objects for serialization, we
> are finding, is just the fact that there is a strong, semantically
> meaningful API.  This could seemingly be done by using a custom writable
> class though, as well.  So... Does anyone know if there is a POJO writable
> framework for Hadoop?  I think it would be relatively easy to implement one
> by just extending, for example, MapWritable.
>
> --
> Jay Vyas
> MMSB/UCHC
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB