Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - How does mapper process partial records?


+
Praveen Sripati 2013-01-24, 16:50
Copy link to this message
-
Re: How does mapper process partial records?
Harsh J 2013-01-24, 19:22
Hi Praveen,

This is explained at http://wiki.apache.org/hadoop/HadoopMapReduce
[Map section].

On Thu, Jan 24, 2013 at 10:20 PM, Praveen Sripati
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> HDFS splits the file across record boundaries. So, how does the mapper
> processing the second block (b2) determine that the first record is
> incomplete and should process starting from the second record in the block
> (b2)?
>
> Thanks,
> Praveen

--
Harsh J
+
Praveen Sripati 2013-01-25, 00:37
+
Harsh J 2013-01-25, 08:50
+
Mohammad Tariq 2013-01-24, 17:13