Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> Grouping comparators - old vs new mapreduce APIs

Copy link to this message
Re: Grouping comparators - old vs new mapreduce APIs
On Tue, Dec 11, 2012 at 7:11 AM, Dave Beech <[EMAIL PROTECTED]> wrote:
> What this means is, if you want to use a grouping comparator with the "new"
> mapreduce API and Avro, you absolutely must provide an implementation of
> RawComparator, or do the deserialization and delegating method call to
> compare(x,y) yourself. This really isn't obvious and I haven't found it to
> be documented anywhere.

Sounds like we should at least add some documentation and probably
also make this simpler.  Perhaps we could provide a subclass of
AvroKeyComparator that does the deserialization and delegates to
compare(x,y)?  Then folks can subclass this and override compare(x,y)?