Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Hadoop Serialization mechanisms


Copy link to this message
-
Re: Hadoop Serialization mechanisms
Harsh J 2014-03-30, 21:08

- You can override the RPC serialisation module and engine with a
custom class if you wish to, but it would not be trivial task.
- You can easily use custom data serialisation modules for I/O.
While MR's built-in examples in Apache Hadoop continue to use
Writables, the RPCs have moved to using Protocol buffers for
themselves in 2.x onwards.
Yes "partially", see above.
Yes, you should see a gain in using a more efficient data
serialisation format for data files.

On Sun, Mar 30, 2014 at 9:09 PM, Jay Vyas <[EMAIL PROTECTED]> wrote:

Harsh J