Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Compressing map only output


Copy link to this message
-
Re: Compressing map only output
Thanks! When I tried to search for this property I couldn't find it. Is
there a page that has complete list of properties and it's usage?

On Mon, Apr 30, 2012 at 5:44 PM, Prashant Kommireddi <[EMAIL PROTECTED]>wrote:

> Yes. These are hadoop properties - using "set" is just a way for Pig to set
> those properties in your job conf.
>
>
> On Mon, Apr 30, 2012 at 5:25 PM, Mohit Anchlia <[EMAIL PROTECTED]
> >wrote:
>
> > Is there a way to compress map only jobs to compress map output that gets
> > stored on hdfs as part-m-* files? In pig I used :
> >
> > Would these work form plain map reduce jobs as well?
> >
> >
> > set output.compression.enabled true;
> >
> > set output.compression.codec org.apache.hadoop.io.compress.SnappyCodec;
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB