Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> How do I make sure my map output of pig script in lzo compressed?


Copy link to this message
-
Re: How do I make sure my map output of pig script in lzo compressed?
Check the Job Counters for "Map Output bytes" before and after setting
compression.

On Mon, Jun 18, 2012 at 7:47 PM, unionx <[EMAIL PROTECTED]> wrote:

> I have set up hadoop-lzo and elephant-bird, and I see them well loaded
> before the job, and the pig scripts can handle lzo files.
>
>
> The question is, how do I know they have worked? If there is some way to
> see the map output? I just want to know the map output has been compressed.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB