Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> what is the difference between mapper and identity mapper, reducer and identity reducer?


+
mallik arjun 2013-09-05, 13:43
Copy link to this message
-
Re: what is the difference between mapper and identity mapper, reducer and identity reducer?
Identity Mapper and Reducer just like the concept of Identity function in
mathematics i.e. do not transform the input and return it as it is in
output form. Identity Mapper takes the input key/value pair and spits it
out without any processing.

The case of identity reducer is a bit different. It does not mean that the
reduce step will not take place. It will take place and the related sorting
and shuffling will also be performed but there will be no aggregation. So
you can use identity reducer if you want to sort your data that is coming
from map but don't care for any grouping and also fine with multiple
reducer outputs (unlike using 1 reducer.)

Regards,
Shahab

On Thu, Sep 5, 2013 at 9:43 AM, mallik arjun <[EMAIL PROTECTED]> wrote:

> hi  all,
>
> please  tell me what is the difference between mapper and identtiy mapper
> , reducer and identity reducer.
>
> thanks in advance.
>
+
梁李印 2014-01-13, 11:31
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB