Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Relations ship between HDFS_BYTE_READ and Map input bytes


+
Pralabh Kumar 2013-04-29, 08:50
+
Vinod Kumar Vavilapalli 2013-04-29, 17:05
Copy link to this message
-
Re: Relations ship between HDFS_BYTE_READ and Map input bytes
Hi Pralabh
*   *
 1.The Map input bytes couter belongs to the MapReduce FrameWork. The
hadoop defintive explains that:
   The number of bytes of uncompressed input consumed by all the maps in the
   job. Incremented every time a record is read from a RecordReader and
passed
   to the map’s map() method by the framework.

 2.HDFS_BYTE_READ is the bulid in counter of the  HDFS filesystem :
   The number of bytes read by each filesystem by map and reduce tasks.

2013/4/29 Pralabh Kumar <[EMAIL PROTECTED]>

> Hi
>
> What's the relationship between HDFS_BYTE_READ and Map input bytes counter
> . Why can they be different for particular MR job.
>
> Thanks and Regards
>
>> Pralabh Kumar
>
>
>