Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Default Compression


Copy link to this message
-
Re: Default Compression
Try getting rid of the extra spaces and new lines.

-Joey

On Mon, Oct 31, 2011 at 1:49 PM, Mark <[EMAIL PROTECTED]> wrote:
> I recently added the following to my core-site.xml
>
> <property>
> <name>io.compression.codecs</name>
> <value>
>  org.apache.hadoop.io.compress.DefaultCodec,
> org.apache.hadoop.io.compress.GzipCodec,
> org.apache.hadoop.io.compress.BZip2Codec
> </value>
> </property>
>
> However when I try and test a simple MR job I am seeing the following errors
> in my log.
>
> java.lang.IllegalArgumentException: Compression codec
>      org.apache.hadoop.io.compress.DefaultCodec not found.
>    at
> org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:116)
>    at
> org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:156)
>    at
> org.apache.hadoop.mapreduce.lib.input.TextInputFormat.isSplitable(TextInputFormat.java:51)
>    at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:254)
>    at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:944)
>
> Aren't these codecs installed by default? If not, how would I enable them?
>
> Thanks
>
>

--
Joseph Echeverria
Cloudera, Inc.
443.305.9434