Pralabh Kumar 2013-04-29, 08:50
Vinod Kumar Vavilapalli 2013-04-29, 17:05
-Re: Relations ship between HDFS_BYTE_READ and Map input bytes
YouPeng Yang 2013-04-30, 10:33
1.The Map input bytes couter belongs to the MapReduce FrameWork. The
hadoop defintive explains that:
The number of bytes of uncompressed input consumed by all the maps in the
job. Incremented every time a record is read from a RecordReader and
to the map’s map() method by the framework.
2.HDFS_BYTE_READ is the bulid in counter of the HDFS filesystem :
The number of bytes read by each filesystem by map and reduce tasks.
2013/4/29 Pralabh Kumar <[EMAIL PROTECTED]>
> What's the relationship between HDFS_BYTE_READ and Map input bytes counter
> . Why can they be different for particular MR job.
> Thanks and Regards
>> Pralabh Kumar