Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Using compression with IndexedStorage


Copy link to this message
-
Using compression with IndexedStorage
I've just started playing around with IndexedStorage in Pig 0.10, as a
means to an end to use sparse merge join.  Seems to be working, but is
there a way to use compression with the IndexedStorage StoreFunc?

I've tried setting output.compression.enabled and
output.compression.codec to use Snappy, but IndexedStorage seems to be
ignoring them and just outputs uncompressed data.

Thanks,
Kevin
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB