Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Regarding Insert Overwrite Directory in case of LZO compression


Copy link to this message
-
Re: Regarding Insert Overwrite Directory in case of LZO compression
If you do not want compression

set hive.exec.compress.output=false
If you want to compress-
set hive.exec.compress.output=false

and specify

mapred.map.output.compression.codec and mapred.output.compression.codec
depending upon query is map-only or map-reduce.

If your question is about changing record structure, I am not sure if you
can do it--

Check- https://issues.apache.org/jira/browse/HIVE-634

Thanks,

Aniket
On Thu, Jan 5, 2012 at 3:10 PM, Abhishek Pratap Singh
<[EMAIL PROTECTED]>wrote:

> Hi All,
>
> I have enabled my hive to use LZO codec from Hadoop, due to which all the
> output from hive is by default LZO compressed unless and until Storage
> format as textfile etc has not been specified.
>
> While using the query
>
> INSERT OVERWRITE DIRECTORY '/path' SELECT * FROM tableA. It is storing
> output lzo compressed, which i don't want. is there a way to specify the
> format to store in directory?
>
>
> Thanks,
> Abhishek
>

--
"...:::Aniket:::... Quetzalco@tl"
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB