+
unionx 2012-06-19, 02:47
-
Re: How do I make sure my map output of pig script in lzo compressed?Prashant Kommireddi 2012-06-19, 02:51
Check the Job Counters for "Map Output bytes" before and after setting
compression.
On Mon, Jun 18, 2012 at 7:47 PM, unionx <[EMAIL PROTECTED]> wrote:
> I have set up hadoop-lzo and elephant-bird, and I see them well loaded
> before the job, and the pig scripts can handle lzo files.
>
>
> The question is, how do I know they have worked? If there is some way to
> see the map output? I just want to know the map output has been compressed.
compression.
On Mon, Jun 18, 2012 at 7:47 PM, unionx <[EMAIL PROTECTED]> wrote:
> I have set up hadoop-lzo and elephant-bird, and I see them well loaded
> before the job, and the pig scripts can handle lzo files.
>
>
> The question is, how do I know they have worked? If there is some way to
> see the map output? I just want to know the map output has been compressed.
