Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> LZO support for Pig-0.9.1


Copy link to this message
-
Re: LZO support for Pig-0.9.1
btw, for simple use cases, you can load/store lzo files using PigStorage().
While stor

Only disadvantage is that files are not splittable.

grunt> set output.compression.enabled true;
grunt> set output.compression.codec com.hadoop.compression.lzo.LzopCodec;
grunt> x = load 'x.txt' using PigStorage();
grunt> store x into 'xout';
grunt> fs -ls xout;
Found 1 items
-rw-r--r--   3 raghu users         68 2012-01-24 00:29
/user/raghu/xout/part-m-00000.lzo
Raghu.

On Mon, Jan 23, 2012 at 1:42 PM, Sam William <[EMAIL PROTECTED]> wrote:

> Hi,
>  Im  looking for  a solution to load/store   lzo compressed files   for
> Pig-0.9.1 .   Any pointers would be useful.
>
> Thanks,
>
> Sam William
> [EMAIL PROTECTED]
>
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB