Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> How do I make sure my map output of pig script in lzo compressed?


Copy link to this message
-
Re: How do I make sure my map output of pig script in lzo compressed?
Check the Job Counters for "Map Output bytes" before and after setting
compression.

On Mon, Jun 18, 2012 at 7:47 PM, unionx <[EMAIL PROTECTED]> wrote:

> I have set up hadoop-lzo and elephant-bird, and I see them well loaded
> before the job, and the pig scripts can handle lzo files.
>
>
> The question is, how do I know they have worked? If there is some way to
> see the map output? I just want to know the map output has been compressed.