Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # dev - "Map input bytes" vs HDFS_BYTES_READ


Copy link to this message
-
"Map input bytes" vs HDFS_BYTES_READ
Ted Yu 2011-02-02, 02:36
In hadoop 0.20.2, what's the relationship between "Map input bytes" and
HDFS_BYTES_READ ?

<counter group="FileSystemCounters"
name="HDFS_BYTES_READ">203446204073</counter>
<counter group="FileSystemCounters"
name="HDFS_BYTES_WRITTEN">23413127561</counter>
<counter group="Map-Reduce Framework" name="Map input
records">163502600</counter>
<counter group="Map-Reduce Framework" name="Spilled Records">0</counter>
<counter group="Map-Reduce Framework" name="Map input
bytes">965922136488</counter>
<counter group="Map-Reduce Framework" name="Map output
records">296754600</counter>

Thanks