Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Compressing map only output


Copy link to this message
-
Compressing map only output
Mohit Anchlia 2012-05-01, 00:25
Is there a way to compress map only jobs to compress map output that gets
stored on hdfs as part-m-* files? In pig I used :

Would these work form plain map reduce jobs as well?
set output.compression.enabled true;

set output.compression.codec org.apache.hadoop.io.compress.SnappyCodec;