Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Hadoop Serialization mechanisms


Copy link to this message
-
Re: Hadoop Serialization mechanisms

- You can override the RPC serialisation module and engine with a
custom class if you wish to, but it would not be trivial task.
- You can easily use custom data serialisation modules for I/O.
While MR's built-in examples in Apache Hadoop continue to use
Writables, the RPCs have moved to using Protocol buffers for
themselves in 2.x onwards.
Yes "partially", see above.
Yes, you should see a gain in using a more efficient data
serialisation format for data files.

On Sun, Mar 30, 2014 at 9:09 PM, Jay Vyas <[EMAIL PROTECTED]> wrote:

Harsh J

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB