Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> How does mapper process partial records?


+
Praveen Sripati 2013-01-24, 16:50
Copy link to this message
-
Re: How does mapper process partial records?
Hi Praveen,

This is explained at http://wiki.apache.org/hadoop/HadoopMapReduce
[Map section].

On Thu, Jan 24, 2013 at 10:20 PM, Praveen Sripati
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> HDFS splits the file across record boundaries. So, how does the mapper
> processing the second block (b2) determine that the first record is
> incomplete and should process starting from the second record in the block
> (b2)?
>
> Thanks,
> Praveen

--
Harsh J
+
Praveen Sripati 2013-01-25, 00:37
+
Harsh J 2013-01-25, 08:50
+
Mohammad Tariq 2013-01-24, 17:13
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB