Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> io.compression.codecs not found

Copy link to this message
Re: io.compression.codecs not found
These are the default, add snappy as well along


Bejoy KS

Sent from remote device, Please excuse typos

-----Original Message-----
From: Sachin Sudarshana <[EMAIL PROTECTED]>
Date: Thu, 23 May 2013 20:01:17
Subject: Re: io.compression.codecs not found

Hi Bejoy,

Thanks for the reply.
I would like to know "what" are the codecs that are available by default in
the Hadoop system, among which i can choose to set in the core-site.xml.

For ex: LZO compression codecs are not available by default and we have to
install the required libraries for it.

Thank you,
On Thu, May 23, 2013 at 7:55 PM, <[EMAIL PROTECTED]> wrote:

> **
> Go to $HADOOP_HOME/config open and edit core-site.xml
> Add a new property 'io.compression.codecs' and assign the required
> compression codecs as its value.
> Regards
> Bejoy KS
> Sent from remote device, Please excuse typos
> ------------------------------
> *From: * Sachin Sudarshana <[EMAIL PROTECTED]>
> *Date: *Thu, 23 May 2013 19:46:37 +0530
> *Subject: *Re: io.compression.codecs not found
> Hi,
> I'm not using CM. I have installed CDH 4.2.1 using Linux packages.
> Thank you,
> Sachin
> On Thu, May 23, 2013 at 7:13 PM, Sanjay Subramanian <
>> This property needs to be set in core-site.xml. If u r using
>> clouderamanager then ping me I will tell u how to set it there. Out of the
>> box hive works beautifully with gzip and snappy.  And if u r using lzo then
>> needs some plumbing. Depends on what ur usecase is I can provide guidance.
>> Regards
>> Sanjay
>> Sent from my iPhone
>> On May 23, 2013, at 3:33 AM, "Sachin Sudarshana" <[EMAIL PROTECTED]>
>> wrote:
>> > Hi,
>> >
>> > I'm trying to run some queries on compressed tables in Hive 0.10. I
>> wish to know what all compression codecs are available which i can make use
>> of.
>> > However, when i run set io.compression.codecs in the hive CLI, it
>> throws an error saying the io.compression.codecs is not found.
>> >
>> > I'm unable to figure out why its happening. Has it (the hiveconf
>> property) been removed from 0.10?
>> >
>> > Any help is greatly appreciated!
>> >
>> > Thank you,
>> > Sachin
>> >
>> =====================>> This email message and any attachments are for the exclusive use of the
>> intended recipient(s) and may contain confidential and privileged
>> information. Any unauthorized review, use, disclosure or distribution is
>> prohibited. If you are not the intended recipient, please contact the
>> sender by reply email and destroy all copies of the original message along
>> with any attachments, from your computer system. If you are the intended
>> recipient, please be advised that the content of this message is subject to
>> access, review and disclosure by the sender's Email System Administrator.