Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - MapReduce for complex key/value pairs?


Copy link to this message
-
Re: MapReduce for complex key/value pairs?
Jay Vyas 2014-04-08, 18:36
- Adding parsing logic in mappers/reducers is the simplest, least elegant
way to do it, or just writing json  strings is one simple way to do it.

- You get more advanced by writing custom writables which parse the data
are the first way to do it.

- The truly portable and "right" way is to do it is to define a schema and
use Avro to parse it.   Unlike manually adding parsing to app logic, or
adding json deser to your mapper/reducers, proper Avro serialization has
the benefit of increasing performance and app portability while also code
more maintainable (it interoperates with pure java domain objects)
On Tue, Apr 8, 2014 at 2:30 PM, Harsh J <[EMAIL PROTECTED]> wrote:
Jay Vyas
http://jayunit100.blogspot.com