Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Compressing map only output

Copy link to this message
Compressing map only output
Is there a way to compress map only jobs to compress map output that gets
stored on hdfs as part-m-* files? In pig I used :

Would these work form plain map reduce jobs as well?
set output.compression.enabled true;

set output.compression.codec org.apache.hadoop.io.compress.SnappyCodec;