Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Relations ship between HDFS_BYTE_READ and Map input bytes


+
Pralabh Kumar 2013-04-29, 08:50
Copy link to this message
-
Re: Relations ship between HDFS_BYTE_READ and Map input bytes

They can be different if maps read HDFS files directly instead of or on top of getting key-val pairs via the map interface.

HDFS_BYTES_READ will always be greater than or equal to map-input-bytes.

Thanks,
+Vinod

On Apr 29, 2013, at 1:50 AM, Pralabh Kumar wrote:

> Hi
>
> What's the relationship between HDFS_BYTE_READ and Map input bytes counter . Why can they be different for particular MR job.
>
> Thanks and Regards
> Pralabh Kumar
>

+
YouPeng Yang 2013-04-30, 10:33
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB