These are the default, add snappy as well along
Sent from remote device, Please excuse typos
From: Sachin Sudarshana <[EMAIL PROTECTED]>
Date: Thu, 23 May 2013 20:01:17
To: <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Re: io.compression.codecs not found
Thanks for the reply.
I would like to know "what" are the codecs that are available by default in
the Hadoop system, among which i can choose to set in the core-site.xml.
For ex: LZO compression codecs are not available by default and we have to
install the required libraries for it.
On Thu, May 23, 2013 at 7:55 PM, <[EMAIL PROTECTED]> wrote:
> Go to $HADOOP_HOME/config open and edit core-site.xml
> Add a new property 'io.compression.codecs' and assign the required
> compression codecs as its value.
> Bejoy KS
> Sent from remote device, Please excuse typos
> *From: * Sachin Sudarshana <[EMAIL PROTECTED]>
> *Date: *Thu, 23 May 2013 19:46:37 +0530
> *To: *<[EMAIL PROTECTED]>
> *ReplyTo: * [EMAIL PROTECTED]
> *Subject: *Re: io.compression.codecs not found
> I'm not using CM. I have installed CDH 4.2.1 using Linux packages.
> Thank you,
> On Thu, May 23, 2013 at 7:13 PM, Sanjay Subramanian <
> [EMAIL PROTECTED]> wrote:
>> This property needs to be set in core-site.xml. If u r using
>> clouderamanager then ping me I will tell u how to set it there. Out of the
>> box hive works beautifully with gzip and snappy. And if u r using lzo then
>> needs some plumbing. Depends on what ur usecase is I can provide guidance.
>> Sent from my iPhone
>> On May 23, 2013, at 3:33 AM, "Sachin Sudarshana" <[EMAIL PROTECTED]>
>> > Hi,
>> > I'm trying to run some queries on compressed tables in Hive 0.10. I
>> wish to know what all compression codecs are available which i can make use
>> > However, when i run set io.compression.codecs in the hive CLI, it
>> throws an error saying the io.compression.codecs is not found.
>> > I'm unable to figure out why its happening. Has it (the hiveconf
>> property) been removed from 0.10?
>> > Any help is greatly appreciated!
>> > Thank you,
>> > Sachin
>> CONFIDENTIALITY NOTICE
>> =====================>> This email message and any attachments are for the exclusive use of the
>> intended recipient(s) and may contain confidential and privileged
>> information. Any unauthorized review, use, disclosure or distribution is
>> prohibited. If you are not the intended recipient, please contact the
>> sender by reply email and destroy all copies of the original message along
>> with any attachments, from your computer system. If you are the intended
>> recipient, please be advised that the content of this message is subject to
>> access, review and disclosure by the sender's Email System Administrator.