Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Relations ship between HDFS_BYTE_READ and Map input bytes


Copy link to this message
-
Re: Relations ship between HDFS_BYTE_READ and Map input bytes
Hi Pralabh
*   *
 1.The Map input bytes couter belongs to the MapReduce FrameWork. The
hadoop defintive explains that:
   The number of bytes of uncompressed input consumed by all the maps in the
   job. Incremented every time a record is read from a RecordReader and
passed
   to the map’s map() method by the framework.

 2.HDFS_BYTE_READ is the bulid in counter of the  HDFS filesystem :
   The number of bytes read by each filesystem by map and reduce tasks.

2013/4/29 Pralabh Kumar <[EMAIL PROTECTED]>

> Hi
>
> What's the relationship between HDFS_BYTE_READ and Map input bytes counter
> . Why can they be different for particular MR job.
>
> Thanks and Regards
>
>> Pralabh Kumar
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB