Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> Where is the map input transfered to the 'map worker'/container?


Copy link to this message
-
Re: Where is the map input transfered to the 'map worker'/container?
Hi Christian,

The input will be read using the InputFormat's record reader.

for example,

In case of  TexInputformat, *LineRecordReader#nextKeyValue(..)* will do the
job of reading one line from input file for every map call and storing the
offset as *key *and *text* as  *value, *and same will be passed to *map(..)*

You can go through *org.apache.hadoop.mapreduce.lib.input.LineRecordReader.java
*for more details.

Regards,
Vinay
On Mon, Jul 7, 2014 at 10:06 AM, Sandy Ryza <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB