Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - Re: Reduce Task Clarification


Copy link to this message
-
Re: Reduce Task Clarification
Shahab Yunus 2013-08-14, 12:55
Also Sam, following are is a link giving example about how to implement
secondary sort and what it is...

http://codingjunkie.net/secondary-sort/

Regards,
Shahab
On Tue, Aug 13, 2013 at 3:51 PM, Sam Garrett <[EMAIL PROTECTED]> wrote:

> I am working on a MapReduce job where I would like to have the output
> sorted by a LongWritable value. I read the Anatomy of a MapReduce Run in
> the Definitive Guide and it didn't say explicitly whether reduce() gets
> called only once per map output key. If it does get called only once I was
> thinking that I could use this:
> http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapreduce/Job.html#setSortComparatorClass(java.lang.Class)to do the sorting.
>
> Thank you for your time.
>
> --
> Sam Garrett
> ActionX, NYC
>
+
Harsh J 2013-08-14, 05:28