Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Compressing map only output


Copy link to this message
-
Re: Compressing map only output
Thanks! When I tried to search for this property I couldn't find it. Is
there a page that has complete list of properties and it's usage?

On Mon, Apr 30, 2012 at 5:44 PM, Prashant Kommireddi <[EMAIL PROTECTED]>wrote:

> Yes. These are hadoop properties - using "set" is just a way for Pig to set
> those properties in your job conf.
>
>
> On Mon, Apr 30, 2012 at 5:25 PM, Mohit Anchlia <[EMAIL PROTECTED]
> >wrote:
>
> > Is there a way to compress map only jobs to compress map output that gets
> > stored on hdfs as part-m-* files? In pig I used :
> >
> > Would these work form plain map reduce jobs as well?
> >
> >
> > set output.compression.enabled true;
> >
> > set output.compression.codec org.apache.hadoop.io.compress.SnappyCodec;
> >
>