Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> How does mapper process partial records?

Copy link to this message
Re: How does mapper process partial records?
Hi Praveen,

This is explained at http://wiki.apache.org/hadoop/HadoopMapReduce
[Map section].

On Thu, Jan 24, 2013 at 10:20 PM, Praveen Sripati
> Hi,
> HDFS splits the file across record boundaries. So, how does the mapper
> processing the second block (b2) determine that the first record is
> incomplete and should process starting from the second record in the block
> (b2)?
> Thanks,
> Praveen

Harsh J