Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Unable to disable compression of output

Copy link to this message
Unable to disable compression of output
Hello, I'm running a pretty simple pig job but despite my best efforts to
disable compression, the output parts are written in in .lzo_deflate form


I'm launching the job like this JAVA_OPTS=-Dmapred.output.compress=false
PIG_OPTS=-Dmapred.output.compress=false ../pig-0.10.0/bin/pig test.pig

in a vain effort to turn that off.

Can someone please point me in the right direction?
The store statement looks like this:

STORE bothcountedp into '/user/jkebinger/pigresults3.gz' USING

(the filename there has varied from no extension to .gz with no effect on
how the files inside it are treated)