Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Default Compression


Copy link to this message
-
Re: Default Compression
Try getting rid of the extra spaces and new lines.

-Joey

On Mon, Oct 31, 2011 at 1:49 PM, Mark <[EMAIL PROTECTED]> wrote:
> I recently added the following to my core-site.xml
>
> <property>
> <name>io.compression.codecs</name>
> <value>
>  org.apache.hadoop.io.compress.DefaultCodec,
> org.apache.hadoop.io.compress.GzipCodec,
> org.apache.hadoop.io.compress.BZip2Codec
> </value>
> </property>
>
> However when I try and test a simple MR job I am seeing the following errors
> in my log.
>
> java.lang.IllegalArgumentException: Compression codec
>      org.apache.hadoop.io.compress.DefaultCodec not found.
>    at
> org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:116)
>    at
> org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:156)
>    at
> org.apache.hadoop.mapreduce.lib.input.TextInputFormat.isSplitable(TextInputFormat.java:51)
>    at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:254)
>    at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:944)
>
> Aren't these codecs installed by default? If not, how would I enable them?
>
> Thanks
>
>

--
Joseph Echeverria
Cloudera, Inc.
443.305.9434
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB