Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Using compression with IndexedStorage


Copy link to this message
-
Using compression with IndexedStorage
I've just started playing around with IndexedStorage in Pig 0.10, as a
means to an end to use sparse merge join.  Seems to be working, but is
there a way to use compression with the IndexedStorage StoreFunc?

I've tried setting output.compression.enabled and
output.compression.codec to use Snappy, but IndexedStorage seems to be
ignoring them and just outputs uncompressed data.

Thanks,
Kevin