Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> LZO support for Pig-0.9.1


Copy link to this message
-
Re: LZO support for Pig-0.9.1
btw, for simple use cases, you can load/store lzo files using PigStorage().
While stor

Only disadvantage is that files are not splittable.

grunt> set output.compression.enabled true;
grunt> set output.compression.codec com.hadoop.compression.lzo.LzopCodec;
grunt> x = load 'x.txt' using PigStorage();
grunt> store x into 'xout';
grunt> fs -ls xout;
Found 1 items
-rw-r--r--   3 raghu users         68 2012-01-24 00:29
/user/raghu/xout/part-m-00000.lzo
Raghu.

On Mon, Jan 23, 2012 at 1:42 PM, Sam William <[EMAIL PROTECTED]> wrote:

> Hi,
>  Im  looking for  a solution to load/store   lzo compressed files   for
> Pig-0.9.1 .   Any pointers would be useful.
>
> Thanks,
>
> Sam William
> [EMAIL PROTECTED]
>
>
>
>